The Computing Podcast where we talk about all things computer science, direct from Silicon Valley. Into databases distributed system and building large scale software products? Then this is the Podcast for you. Hosted by Alex Feinberg and Vikram Rangnekar. Between the two of us we have worked for companies like Linkedin, Amazon, Microsoft, Cloudera building stateful distributed systems and ad serving engines.
All content for The Computing Podcast is the property of Alex Feinberg & Vikram Rangnekar and is served directly from their servers
with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.
The Computing Podcast where we talk about all things computer science, direct from Silicon Valley. Into databases distributed system and building large scale software products? Then this is the Podcast for you. Hosted by Alex Feinberg and Vikram Rangnekar. Between the two of us we have worked for companies like Linkedin, Amazon, Microsoft, Cloudera building stateful distributed systems and ad serving engines.
Part 1: Apache Kafka - Walkthrough of a distributed system
The Computing Podcast
22 minutes 33 seconds
5 years ago
Part 1: Apache Kafka - Walkthrough of a distributed system
Welcome to our 2nd episode. This is the first part of a two part series where we walk through a stateful distributed system. Join us as we take apart the famous Apache Kafka so as to look under the hood and understand more of the amazing engineering and computer science that has gone into building it. We’ll touch upon consensus algorithms, guarantees and the path taken by a message making its way through Kafka.
Follow us on Twitter
@dosco
@strlen
Links
Kafka design
Virtual synchrony
The Log
ZooKeeper Atomic Broadcast
Kafka Replication Design
Kafka design: replication
Amazon Aurora under the hood: quorums and correlated failure
The Computing Podcast
The Computing Podcast where we talk about all things computer science, direct from Silicon Valley. Into databases distributed system and building large scale software products? Then this is the Podcast for you. Hosted by Alex Feinberg and Vikram Rangnekar. Between the two of us we have worked for companies like Linkedin, Amazon, Microsoft, Cloudera building stateful distributed systems and ad serving engines.