The Computing Podcast where we talk about all things computer science, direct from Silicon Valley. Into databases distributed system and building large scale software products? Then this is the Podcast for you. Hosted by Alex Feinberg and Vikram Rangnekar. Between the two of us we have worked for companies like Linkedin, Amazon, Microsoft, Cloudera building stateful distributed systems and ad serving engines.
All content for The Computing Podcast is the property of Alex Feinberg & Vikram Rangnekar and is served directly from their servers
with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.
The Computing Podcast where we talk about all things computer science, direct from Silicon Valley. Into databases distributed system and building large scale software products? Then this is the Podcast for you. Hosted by Alex Feinberg and Vikram Rangnekar. Between the two of us we have worked for companies like Linkedin, Amazon, Microsoft, Cloudera building stateful distributed systems and ad serving engines.
Part 2: Apache Kafka - Walkthrough of a distributed system
The Computing Podcast
27 minutes 19 seconds
5 years ago
Part 2: Apache Kafka - Walkthrough of a distributed system
Welcome to our 3nd episode. This is the second part of a two part series where we walk through a stateful distributed system. Join us as we take apart the famous Apache Kafka so as to look under the hood and understand more of the amazing engineering and computer science that has gone into building it. In this part we’ll talk about Apache Zookeeper the best kept secret in a lot of open source distributed systems. We’ll also touch upon clients, atomic broadcasts and things that can hurt availability. Hope you enjoy the ride as we walk the route taken by messages through Apache Kafka. Remember to subscribe for more interesting, deep tech conversations.
Follow us on Twitter
@dosco
@strlen
Links
ZooKeeper: Wait-free coordination for Internet-scale systems
ZooKeeper’s atomic broadcast protocol: Theory and practice
PacificA: Replication in Log-Based Distributed Storage Systems
Bigtable: A Distributed Storage System for Structured Data
The Chubby lock service for loosely-coupled distributed systems
The Computing Podcast
The Computing Podcast where we talk about all things computer science, direct from Silicon Valley. Into databases distributed system and building large scale software products? Then this is the Podcast for you. Hosted by Alex Feinberg and Vikram Rangnekar. Between the two of us we have worked for companies like Linkedin, Amazon, Microsoft, Cloudera building stateful distributed systems and ad serving engines.