Presentation: Kafka Needs No Keeper

Track: Modern Data Architectures

Location: Bayview AB

Duration: 4:10pm - 5:00pm

Day of week: Tuesday

Share this on:

Abstract

We have been served well by Zookeeper over the years, but it is time for Kafka to stand on its own. This is a talk on the ongoing effort to replace the use of Zookeeper in Kafka: why we want to do it and how it will work. We will discuss the limitations we have found and how Kafka benefits both in terms of stability and scalability by bringing consensus in house. This effort will not be completed over night, but we will discuss our progress, what work is remaining, and how contributors can help.

Speaker: Colin McCabe

Software Engineer @confluentinc

Colin McCabe is a Kafka committer at Confluent, working on the scalability and extensibility of Kafka. Previously, he worked on the Hadoop Distributed Filesystem and the Ceph Filesystem. Colin studied Computer Science and Computer Engineering at Carnegie Mellon University. In his free time, he enjoys homebrewing and scuba diving.

Find Colin McCabe at

Tracks

Monday, 11 November

Tuesday, 12 November

Wednesday, 13 November