Running LLMs on Kubernetes: From GPU Bottlenecks to Reliable, Production-Grade Inference

https://is1-ssl.mzstatic.com/image/thumb/Podcasts221/v4/f6/a8/9a/f6a89ad1-27bb-193a-99bd-b7476c11279a/mza_14834482786112159798.jpg/600x600bb.jpg

The SoftwarePlaza IT Podcast

SoftwarePlaza

29 episodes

6 days ago

The SoftwarePlaza IT podcast keeps you up-to-date with all that’s happening in the world of the IT community. Learn about the latest news, best practices, reviews, and how-to’s. Subscribe and listen to more SoftwarePlaza podcast episodes or visit www.softwareplaza.com.

Tech News

News

RSS

All content for The SoftwarePlaza IT Podcast is the property of SoftwarePlaza and is served directly from their servers with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.

Tech News

News

https://d3t3ozftmdmh3i.cloudfront.net/staging/podcast_uploaded_nologo/42205257/42205257-1728652616269-b994cebb9384f.jpg

Running LLMs on Kubernetes: From GPU Bottlenecks to Reliable, Production-Grade Inference

The SoftwarePlaza IT Podcast

45 minutes 46 seconds

1 month ago

Running LLMs on Kubernetes: From GPU Bottlenecks to Reliable, Production-Grade Inference

In this episode, Abdel SGHIOUAR, Senior Cloud Developer Advocate at Google and CNCF Ambassador, unpacks the technical and cultural shifts happening in the Kubernetes ecosystem. As co-host of the Kubernetes Podcast, he shares how enterprises, from LinkedIn to CERN, are pushing Kubernetes beyond microservices into powering GenAI workloads. Abdel dives into the hardware bottlenecks, operational hurdles, and community-driven innovations shaping the future of Kubernetes.