Speaker: Colin McCabe
Software Engineer @confluentinc
Colin McCabe is a Kafka committer at Confluent, working on the scalability and extensibility of Kafka. Previously, he worked on the Hadoop Distributed Filesystem and the Ceph Filesystem. Colin studied Computer Science and Computer Engineering at Carnegie Mellon University. In his free time, he enjoys homebrewing and scuba diving.
Find Colin McCabe at:
SESSION + Live Q&A
Kafka Needs No Keeper
We have been served well by Zookeeper over the years, but it is time for Kafka to stand on its own. This is a talk on the ongoing effort to replace the use of Zookeeper in Kafka: why we want to do it and how it will work. We will discuss the limitations we have found and how Kafka benefits both in terms of stability and scalability by bringing consensus in house. This effort will not be completed over night, but we will discuss our progress, what work is remaining, and how contributors can help.
