Kafka Connect - 4.5. Internal Topics
CentralMeshIO
0:00 / 0:00
Kafka Connect - 4.5. Internal Topics
15 просмотров · 3 дня назад
CentralMeshIO
18 подписчиков
15 просмотров · 3 дня назад
https://centralmesh.io
Chapter 4: Deep Dive into Connect Internals
In this section, we focus on the internal Kafka topics that coordinate a distributed Connect cluster.
You’ll learn:
The config topic stores connector configurations.
The offset topic stores connector progress.
The status topic tracks connector and task states.
Compaction and replication preserve current state and improve fault tolerance.
By the end of this section, you’ll be able to:
Explain the purpose of each internal topic.
Describe how workers use shared Kafka-backed state.
Identify important durability requirements for internal topics.