Hello everyone and welcome to the very first season of Modern Data Show- a podcast where you can hear stories from data practitioners and enthusiasts - the folks in the arena, on their journey of building and operating a modern data stack. I’m your host - Aayush and we’re super happy you’re here.
In this first season of our show, we’d be talking about all things ETL - how organisations at a large scale manage their ETL processes, the tools and technologies they use, common pitfalls and much more
All content for The Modern Data Show is the property of Modern Data Stack and is served directly from their servers
with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.
Hello everyone and welcome to the very first season of Modern Data Show- a podcast where you can hear stories from data practitioners and enthusiasts - the folks in the arena, on their journey of building and operating a modern data stack. I’m your host - Aayush and we’re super happy you’re here.
In this first season of our show, we’d be talking about all things ETL - how organisations at a large scale manage their ETL processes, the tools and technologies they use, common pitfalls and much more
S02 E12 Unveiling Twilio’s Data Transformation: A Journey into Modern Data Stack with Don Oriti, Head of Data Platform and Engineering at Twilio
The Modern Data Show
36 minutes 14 seconds
2 years ago
S02 E12 Unveiling Twilio’s Data Transformation: A Journey into Modern Data Stack with Don Oriti, Head of Data Platform and Engineering at Twilio
Twilio has built an open source data lake using AWS technologies and Databricks, processing billions of events daily through their Kafka environment. They aim to provide a cohesive view of data across platforms and enable other businesses to use data wherever they want. Don, the Head of Data Platform and Engineering at Twilio, shares insights into Twilio's data stack in the latest episode of the Modern Data Show. The conversation covers the Twilio data stack, which begins with data ingestion through Kafka or CDC for Aurora databases, followed by storage in S3, high-level aggregation and curation using Spark, and the use of tools such as Kudu, Reverse ETL, data governance, cataloging, and BI tools.
The Modern Data Show
Hello everyone and welcome to the very first season of Modern Data Show- a podcast where you can hear stories from data practitioners and enthusiasts - the folks in the arena, on their journey of building and operating a modern data stack. I’m your host - Aayush and we’re super happy you’re here.
In this first season of our show, we’d be talking about all things ETL - how organisations at a large scale manage their ETL processes, the tools and technologies they use, common pitfalls and much more
