Safe and Sound AI is your go-to podcast for staying ahead in predictive and generative AI development. From pre-production design and post-production monitoring to governance and compliance, we deliver bite-sized episodes packed with technical insights and best practices. Designed for data scientists, engineers, trust and safety teams, and business leaders, our focus is to help you deliver and scale AI innovations with safety, trust, and transparency in mind. Safe and Sound AI is brought to you by Fiddler AI.
All content for Safe and Sound AI is the property of Fiddler AI and is served directly from their servers
with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.
Safe and Sound AI is your go-to podcast for staying ahead in predictive and generative AI development. From pre-production design and post-production monitoring to governance and compliance, we deliver bite-sized episodes packed with technical insights and best practices. Designed for data scientists, engineers, trust and safety teams, and business leaders, our focus is to help you deliver and scale AI innovations with safety, trust, and transparency in mind. Safe and Sound AI is brought to you by Fiddler AI.
In this episode, we discuss how to monitor the performance of Large Language Models (LLMs) in production environments. We explore common enterprise approaches to LLM deployment and evaluate the importance of monitoring for LLM quality or the quality of LLM responses over time. We discuss strategies for "drift monitoring" — tracking changes in both input prompts and output responses — allowing for proactive troubleshooting and improvement via techniques like fine-tuning or augmenting data sources.
Read the article by Fiddler AI and explore additional resources on how AI observability can help developers build trust into AI services.
Safe and Sound AI
Safe and Sound AI is your go-to podcast for staying ahead in predictive and generative AI development. From pre-production design and post-production monitoring to governance and compliance, we deliver bite-sized episodes packed with technical insights and best practices. Designed for data scientists, engineers, trust and safety teams, and business leaders, our focus is to help you deliver and scale AI innovations with safety, trust, and transparency in mind. Safe and Sound AI is brought to you by Fiddler AI.
