Using Kafka-Leader-Election to Improve Scalability and Performance

https://is1-ssl.mzstatic.com/image/thumb/Podcasts211/v4/57/09/b6/5709b60f-7c03-a2b5-c522-6313d4257083/mza_18135812347693630014.jpg/600x600bb.jpg

Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov

Confluent

265 episodes

2 months ago

Hi, I'm Tim Berglund. It's been about four years since I've been podcasting at Confluent, and "Streaming Audio" has been on hiatus for a little more than two, but I've got great news: we are back! We're back with a new name, a new format, and new hosts. Welcome to the Confluent Developer Podcast, where we talk to software developers of all stripes about some of the most interesting problems they've solved in their career. I'll be joined by my co-hosts, Adi Polak and Viktor Gamov.&...

All content for Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov is the property of Confluent and is served directly from their servers with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.

Using Kafka-Leader-Election to Improve Scalability and Performance

Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov

51 minutes

2 years ago

Using Kafka-Leader-Election to Improve Scalability and Performance

How does leader election work in Apache Kafka®? For the past 2 ½ years, Adithya Chandra, Staff Software Engineer at Confluent, has been working on Kafka scalability and performance, specifically partition leader election. In this episode, he gives Kris Jenkins a deep dive into the power of leader election in Kafka replication, why we need it, how it works, what can go wrong, and how it's being improved.Adithya explains that you can configure a certain number of replicas to be distributed acro...