Ep05: "Deploy Local LLMs 𝐢𝐧 the Cloud (𝟏𝟎𝟎% 𝐃𝐚𝐭𝐚 𝐏𝐫𝐢𝐯𝐚𝐜𝐲)"

https://is1-ssl.mzstatic.com/image/thumb/Podcasts126/v4/e2/69/ac/e269ac3a-fe0d-8b89-80dc-4d31b162bb21/mza_6753880242152877511.jpg/600x600bb.jpg

Tech Beats Unplugged

Cloud Dude

8 episodes

1 day ago

Welcome to Tech Beats Unplugged, the podcast where we dive into the dynamic world of technology, open source, cloud innovation, devops, Tech economics, and much more. Join us as we bring together experts, thought leaders, and innovators from diverse tech arenas and leading tech vendors. Here, we believe in creating a safe space where guests can freely share their opinions, insights, and experiences without any strings attached. It's a platform dedicated to unlocking knowledge, fostering meaningful discussions, and exploring the latest trends that shape the tech industry. Time to Tune in !

Technology

RSS

All content for Tech Beats Unplugged is the property of Cloud Dude and is served directly from their servers with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.

Technology

https://d3t3ozftmdmh3i.cloudfront.net/staging/podcast_uploaded_episode/6967131/6967131-1727127173001-b721f3adc9a82.jpg

Ep05: "Deploy Local LLMs 𝐢𝐧 the Cloud (𝟏𝟎𝟎% 𝐃𝐚𝐭𝐚 𝐏𝐫𝐢𝐯𝐚𝐜𝐲)"

Tech Beats Unplugged

11 minutes 5 seconds

1 year ago

Ep05: "Deploy Local LLMs 𝐢𝐧 the Cloud (𝟏𝟎𝟎% 𝐃𝐚𝐭𝐚 𝐏𝐫𝐢𝐯𝐚𝐜𝐲)"

👨🏽‍🚀 Welcome to Episode 05 of "Tech Beats unplugged"

This time, we tried something completely crazy – we're letting the AI hosts take over! That's right 😎. We're flipping the script and giving the AI the mic to guide us through the fascinating world of local LLMs. but that's not all as this episode is actually inspired by my recent talk at Oracle Cloud World in Vegas. The topic? You guessed it: Local LLMs in the cloud.

🌟 We’re so excited to share our latest tech Beats show with you🧡!

We hope you'll enjoy it!!!

Topics discussed:

(00:00) Introduction
(01:00) Why OpenAI Might Not Be Your BFF?
(02:40) Local/Open LLMs to the Rescue!
(03:38) What's Quantization!
(04:30) Where to find these Open LLMs?
(05:02) Inference Engines (Ollama)!
(05:50) What's a modelfile!
(06:40) What about deploying local AI to the cloud?(OKE/managed kubernetes)
(07:30) From zero to cloud deployment Hero
(08:28) What's Next (LLM ethic benchmark)
(09:55) Outro.

Show Notes

My local LLM GitRepo: Ollama_lab

Helm leaderboard for model safety: Sandford Helm model leaderboard
My talks in Oracle cloud world 2024: OCW2024LLM