Scaling Kafka at Blinkit & Zomato - Confluent DSWT 2026
Pradeep Khileri
0:00 / 0:00
Scaling Kafka at Blinkit & Zomato - Confluent DSWT 2026
182 458 просмотров · 3 недели назад
Pradeep Khileri
609 подписчиков
182 458 просмотров · 3 недели назад
In this talk from Confluent's Data Streaming World Tour (DSWT) Delhi 2026,
i will share how we use Warpstream(Kafka) at Eternal (Blinkit, Zomato) and things we unlocked when we separated compute from storage layer.
00:00 Introduction
01:30 What Eternal(Blinkit, Zomato and District) do
03:00 How we used to manage our own Kafka cluster with EC2
05:18 How does warpstream work?
08:29 Second Story - Batch Workloads and Compaction
10:50 Using Compacted Topic like database table
16:48 QnA Session
19:19 Q: What happens if your cluster goes down and the recovery?
25:25 Q: What happens if data reaches S3 but offsets are not updated?
28:25 Q: Multiple Streams and how to do concurrent database updates?
32:10 Q: How to make Mirrormaker work and copy consumer offsets?
Slides: https://docs.google.com/presentation/...