GDW CE Workshop 1 - Getting Started with Dremio: Build a Data Lakehouse on your Laptop

https://is1-ssl.mzstatic.com/image/thumb/Podcasts123/v4/cd/15/1f/cd151f78-f991-3eb5-9f46-b5c03f662b7a/mza_8628777921508908673.jpg/600x600bb.jpg

Gnarly Data Waves by Dremio

Dremio (The Open Data Lakehouse Platform)

62 episodes

1 week ago

Gnarly Data Waves is a weekly show about the world of Data Analytics and Data Architecture. Learn about the technologies giving the company access to cutting-edge insights. If you work datasets, data warehouses, data lakes or data lakehouses, this show it for you! Join us for our live recordings to participate in the Q&A: dremio.com/events Subscribe to the Dremio youtube channel on: youtube.com/dremio Take the Dremio Platform for a free test-drive: https://www.dremio.com/test-drive/

Technology

RSS

All content for Gnarly Data Waves by Dremio is the property of Dremio (The Open Data Lakehouse Platform) and is served directly from their servers with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.

Technology

https://d3t3ozftmdmh3i.cloudfront.net/production/podcast_uploaded_nologo/36409154/36409154-1674312722367-468dda51c2b03.jpg

GDW CE Workshop 1 - Getting Started with Dremio: Build a Data Lakehouse on your Laptop

Gnarly Data Waves by Dremio

57 minutes 38 seconds

1 year ago

GDW CE Workshop 1 - Getting Started with Dremio: Build a Data Lakehouse on your Laptop

Ready to revolutionize your data management approach and learn how to maximize your environment with Dremio? Watch Alex Merced in this workshop where he’ll guide you step-by-step through building a lakehouse on your laptop with Dremio, Nessie and Minio. This is a great opportunity to try out many of the best features Dremio offers. You'll learn how to: - Read and write Apache Iceberg tables on your object storage, cataloged by Nessie, - Create views in the semantic layer, - And much more GDW Community Edition Workshop Description: This hands-on workshop, participants will embark on a journey to construct their very own data lakehouse platform using their laptops. The workshop is designed to introduce and guide participants through the setup and utilization of three pivotal tools in the data lakehouse architecture: Dremio, Nessie, and Apache Iceberg. Each of these tools plays a crucial role in enabling the flexibility of data lakes with the efficiency and ease of use of data warehouses aiming to simplify and economize data management. You will start by setting up a Docker environment to run all necessary services, including a notebook server, Nessie for catalog tracking with Git-like versioning, Minio as an S3-compatible storage layer, and Dremio as the core lakehouse platform. The workshop will provide a practical, step-by-step guide to federating data sources, organizing and documenting data, and performing queries with Dremio; tracking table changes and branching with Nessie; and creating, querying, and managing Apache Iceberg tables for an ACID-compliant data lakehouse. Prerequisites for the workshop include having Docker installed on your laptop. You will be taken through the process of creating a docker-compose file to spin up the required services, configuring Dremio to connect with Nessie and Minio, and finally, executing SQL queries to manipulate and query data within their lakehouse. This immersive session aims to not just educate but to empower attendees with the knowledge and tools needed to experiment with and implement their data lakehouse solutions. By the end of the workshop, participants will have a functional data lakehouse environment on their laptops, enabling them to explore further and apply what they have learned to real-world scenarios. Whether you're looking to improve your data management strategies or curious about the data lakehouse architecture, this workshop will provide a solid foundation and practical experience.