Перейти к содержимому

Scaling Kafka at Blinkit & Zomato - Confluent DSWT 2026

Pradeep Khileri

0:00 / 0:00

Scaling Kafka at Blinkit & Zomato - Confluent DSWT 2026

182 458 просмотров · 3 недели назад
Pradeep Khileri
609 подписчиков
182 458 просмотров · 3 недели назад
In this talk from Confluent's Data Streaming World Tour (DSWT) Delhi 2026, i will share how we use Warpstream(Kafka) at Eternal (Blinkit, Zomato) and things we unlocked when we separated compute from storage layer. 00:00 Introduction 01:30 What Eternal(Blinkit, Zomato and District) do 03:00 How we used to manage our own Kafka cluster with EC2 05:18 How does warpstream work? 08:29 Second Story - Batch Workloads and Compaction 10:50 Using Compacted Topic like database table 16:48 QnA Session 19:19 Q: What happens if your cluster goes down and the recovery? 25:25 Q: What happens if data reaches S3 but offsets are not updated? 28:25 Q: Multiple Streams and how to do concurrent database updates? 32:10 Q: How to make Mirrormaker work and copy consumer offsets? Slides: https://docs.google.com/presentation/...