cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

What is the actual role of ZooKeeper in Kafka 2.1?

Kaniz
Community Manager
Community Manager
 
1 ACCEPTED SOLUTION

Accepted Solutions

Hubert-Dudek
Esteemed Contributor III

"Zookeeper keeps track of status of the Kafka cluster nodes and it also keeps track of Kafka topics, partitions etc. Zookeeper it self is allowing multiple clients to perform simultaneous reads and writes and acts as a shared configuration service within the system."

zookeeper is central point of Kafka without it cluster will not work properly. Zookeeper store metadata.

In future kafka versions (kafka roadmap on confluent) architecture will be simplified and zookeeper can be removed (rather step by step).

View solution in original post

1 REPLY 1

Hubert-Dudek
Esteemed Contributor III

"Zookeeper keeps track of status of the Kafka cluster nodes and it also keeps track of Kafka topics, partitions etc. Zookeeper it self is allowing multiple clients to perform simultaneous reads and writes and acts as a shared configuration service within the system."

zookeeper is central point of Kafka without it cluster will not work properly. Zookeeper store metadata.

In future kafka versions (kafka roadmap on confluent) architecture will be simplified and zookeeper can be removed (rather step by step).

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.