Hosted by Mark and Shashank, software engineers and organizers in Silicon Valley. Get their grounded perspective each week as they explore the generative AI landscape through news analysis, tech discussions, hands-on experiments, and clear explanations.
Dive into the latest language models, AI agent capabilities, and RAG techniques. Understand the hardware race, key research, startup trends, benchmarks, and the real-world impact of AI across industries like healthcare, robotics, and creative work. We also test AI limits, explain core concepts, discuss ethics, and interview builders shaping the field.
For engineers, developers, researchers, and anyone seeking a practical understanding of AI’s rapid evolution and its applications.
All content for The Generative AI Meetup Podcast is the property of Mark and Shashank and is served directly from their servers
with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.
Hosted by Mark and Shashank, software engineers and organizers in Silicon Valley. Get their grounded perspective each week as they explore the generative AI landscape through news analysis, tech discussions, hands-on experiments, and clear explanations.
Dive into the latest language models, AI agent capabilities, and RAG techniques. Understand the hardware race, key research, startup trends, benchmarks, and the real-world impact of AI across industries like healthcare, robotics, and creative work. We also test AI limits, explain core concepts, discuss ethics, and interview builders shaping the field.
For engineers, developers, researchers, and anyone seeking a practical understanding of AI’s rapid evolution and its applications.
The $6 Reasoning Model: Breaking Down Stanford's S1 Paper
The Generative AI Meetup Podcast
1 hour 17 minutes 2 seconds
8 months ago
The $6 Reasoning Model: Breaking Down Stanford's S1 Paper
Podcast: https://podcast.genaimeetup.com/
Youtube: https://www.youtube.com/@GenerativeAIMeetup
In this episode, we explore Stanford's groundbreaking S1 paper, which introduces a technique to transform any language model into a reasoning model for just $6 in computation costs. We dive deep into the implications of this research, discussing budget forcing techniques, the true costs of AI development, and the philosophical limits of artificial intelligence across different domains - from mathematical reasoning to language translation. The conversation extends to broader questions about superhuman AI capabilities and the fundamental limitations in various fields like translation, history, and agriculture. Join us for an insightful discussion on the future of AI reasoning and its practical applications.
0:00 - Intro and weekly AI news overview1:06 - Introduction to the S1 paper from Stanford1:40 - Explanation of reasoning models vs single-shot models2:22 - Details of Stanford's S1 technique and QEN32B model3:00 - Cost comparison with other models ($6 training cost)4:04 - Discussion of model distillation technique5:00 - Budget forcing explanation6:33 - Story about building an AI stock research agent8:22 - Philosophical discussion on reasoning limits
The Generative AI Meetup Podcast
Hosted by Mark and Shashank, software engineers and organizers in Silicon Valley. Get their grounded perspective each week as they explore the generative AI landscape through news analysis, tech discussions, hands-on experiments, and clear explanations.
Dive into the latest language models, AI agent capabilities, and RAG techniques. Understand the hardware race, key research, startup trends, benchmarks, and the real-world impact of AI across industries like healthcare, robotics, and creative work. We also test AI limits, explain core concepts, discuss ethics, and interview builders shaping the field.
For engineers, developers, researchers, and anyone seeking a practical understanding of AI’s rapid evolution and its applications.
