Why Your AI Product Needs Evals with Hamel Husain and Swyx

https://is1-ssl.mzstatic.com/image/thumb/Podcasts211/v4/8e/5c/9b/8e5c9b02-4ff6-3a87-27f2-45109b55b59f/mza_7327152238593718654.jpg/600x600bb.jpg

High Agency: The Podcast for AI Builders

Raza Habib

34 episodes

5 months ago

High Agency is the podcast for AI builders. If you’re trying to understand how to successfully build AI products with Large Language Models and Generative AI then this podcast is made for you. Each week we interview leaders at companies building on the frontier who have already succeeded with AI in production. We share their stories, lessons and playbooks so you can build more quickly and with confidence. AI is moving incredibly fast and no-one is truly an expert yet, High Agency is for people who are learning by doing and will share knowledge through the community. Where to find us: https://hubs.ly/Q02z2HR40

Technology

RSS

All content for High Agency: The Podcast for AI Builders is the property of Raza Habib and is served directly from their servers with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.

Technology

Why Your AI Product Needs Evals with Hamel Husain and Swyx

High Agency: The Podcast for AI Builders

1 hour 9 minutes

1 year ago

Why Your AI Product Needs Evals with Hamel Husain and Swyx

Hamel Husain is a seasoned AI consultant and engineer with experience at companies like GitHub, DataRobot, and Airbnb. He is a trailblazer in AI development, known for his innovative work in literate programming and AI-assisted development tools. Shawn Wang (aka Swyx) is the host of the Latent Space podcast, the author of the essay 'Rise of the AI Engineer,' and the founder of the AI Engineer World Fair. In this episode, Hamel and Swyx share their unique insights on building effective AI products, the critical importance of evaluations, and their vision for the future of AI engineering.

Chapters
00:00 - Introduction and recent AI advancements

06:14 - The critical role of evals in AI product development

15:33 - Common pitfalls in AI product development

26:33 - Literate programming: A new paradigm for AI development

39:58 - Answer AI and innovative approaches to software development

51:56 - Integrating AI with literate programming environments

58:47 - The importance of understanding AI prompts

01:00:37 - Assessing the current state of AI adoption

01:07:10 - Challenges in evaluating AI models

--------------------------------------------------------------------------------------------------------------------------------------------------
Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com