Перейти к содержимому

Kafka Connect Explained | Real CDC Project with Debezium, JDBC & S3 (Ep 14)

LevelUp With Suhail

0:00 / 0:00

Kafka Connect Explained | Real CDC Project with Debezium, JDBC & S3 (Ep 14)

3 424 просмотра · 8 мес. назад
LevelUp With Suhail
2 тыс. подписчиков
3 424 просмотра · 8 мес. назад
Kafka Connect explained with a real CDC project using Debezium, JDBC sink connector, and S3 sink connector. In this video, we deep dive into Kafka Connect architecture and build a complete working example step-by-step using core Apache Kafka APIs. You’ll learn: What is Kafka Connect and why it exists Kafka Connect architecture explained clearly Source connector using Debezium (CDC implementation) Sink connectors (JDBC and S3) End-to-end message flow from database to Kafka to sinks Real working project in Java How Kafka Connect simplifies data integration This is a complete hands-on Kafka Connect tutorial for developers and backend engineers who want to understand CDC and real-world data pipelines. #Kafka #KafkaConnect #Debezium #CDC #ApacheKafka #BackendEngineering #DistributedSystems 📌 GitHub Repository- https://github.com/suhailgupta/kafka Discord Link-   / discord   Instagram Link-   / levelupwithsuhail   Twitter Link- https://x.com/SuhailTechTalks Other Zero to Hero Playlists: Kafka-    • Kafka- Zero to Hero   Redis-    • Плейлист   LLD-    • LLD   Multithreading-    • Multithreading: Zero to Hero   System Design-    • System Design at Scale   Chapters: 00:00:00 Introduction 00:00:53 What is Kafka Connect? (Why It Exists) 00:06:19 Kafka Connect Architecture Explained 00:27:32 Project Setup (Kafka Connect + CDC) 00:30:09 Building the Complete Kafka Connect Project 00:51:10 Source Connector (Debezium) Configuration 00:53:15 Sink Connector (JDBC) Configuration 00:54:04 Sink Connector (S3) Configuration 00:56:42 Running the CDC Pipeline (End-to-End Demo)