The AI Agent Trust Gap: Bridging Risk to Reliability

https://is1-ssl.mzstatic.com/image/thumb/Podcasts221/v4/1a/72/64/1a726482-7083-a5cc-8297-64a41bf00914/mza_14516134343677659949.jpg/600x600bb.jpg

Chain of Thought

Galileo + Conor Bronsdon

43 episodes

4 days ago

Introducing Chain of Thought, the weekly podcast for software engineers and leaders that demystifies artificial intelligence. Join host Conor Bronsdon each week as we tell the stories of the people building the AI revolution, unravel actionable strategies for agents and share practical techniques for building effective GenerativeAI applications.

Technology

RSS

All content for Chain of Thought is the property of Galileo + Conor Bronsdon and is served directly from their servers with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.

Technology

https://d3t3ozftmdmh3i.cloudfront.net/staging/podcast_uploaded_nologo/42310277/42310277-1748630694291-4f161b64beb06.jpg

The AI Agent Trust Gap: Bridging Risk to Reliability | Elastic’s Philipp Krenn

Chain of Thought

44 minutes 11 seconds

4 months ago

The AI Agent Trust Gap: Bridging Risk to Reliability | Elastic’s Philipp Krenn

The age of ubiquitous AI agents is here, bringing immense potential - and unprecedented risk.

Hosts Conor Bronsdon and Vikram Chatterji open the episode by discussing the urgent need for building trust and reliability into next-generation AI agents. Vikram unveils Galileo's free AI reliability platform for agents, featuring Luna 2 SLMs for real-time guardrails and its Insights Engine for automatic failure mode analysis. This platform enables cost-effective, low-latency production evaluations, significantly transforming debugging. Achieving trustworthy AI agents demands rigorous testing, continuous feedback, and robust guardrailing—complex challenges requiring powerful solutions from partners like Elastic.

Conor welcomes Philipp Krenn, Director of Developer Relations at Elastic, to discuss their collaboration in ensuring AI agent reliability, including how Elastic leverages Galileo's platform for evaluation. Philipp details Elastic's evolution from a search powerhouse to a key AI enabler, transforming data access with Retrieval-Augmented Generation (RAG) and new interaction modes. He discusses Elastic's investment in SLMs for efficient re-ranking and embeddings, emphasizing robust evaluation and observability for production. This collaborative effort aims to equip developers to build reliable, high-performing AI systems for every enterprise.

Chapters:

00:00 Introduction

01:09 Galileo's AI Reliability Platform

01:43 Challenges in AI Agent Reliability

06:17 Insights Engine and Its Importance

11:00 Luna 2: Small Language Models

14:42 Custom Metrics and Agent Leaderboard

19:16 Galileo's Integrations and Partnerships

21:04 Philipp Krenn from Elastic

24:47 Optimizing LLM Responses

25:41 Galileo and Elastic: A Powerful Partnership

28:20 Challenges in AI Production and Trust