👋🏼 Hey AI heads 🎙️
Join us for the very first Tech Beats Live 🔴, hosted by Kosseila—aka @CloudDude from @CloudThrill.
🎯 This chill & laid-back livestream will unpack LLM quantization 🔥:
We’ll be joined by two incredible guest stars to talk Enterprise vs Consumer Quantz 🗣️:
🔷 Eldar Kurtić – bringing the enterprise perspective with vLLM.
🔷 Colin Kealty – aka Bartowski, creator of the top-downloaded GGUF quantized LLMs on Hugging Face.
🫵🏼 Come learn and have some fun 😎.
𝐂𝐡𝐚𝐩𝐭𝐞𝐫𝐬:
(00:00) Host Introduction
(04:07) Eldar Intro
(07:33) Bartowski Intro
(13:04) What’s Quantization!
(16:19) Why LLM Quantization Matters?
(20:39) Training vs Inference – “The New Deal”
(27:46) Biggest Misconception About Quantization
(33:22) Enterprise Quantization in Production (vLLM)
(48:48) Consumer LLMs & Quantization (Ollama, llama.cpp, GGUF) – “LLMs for the People”
(01:06:45) BitNet 1-Bit Quantization from Microsoft
(01:28:14) How Long It Takes to Quantize a Model (Llama-3 70B) – GGUF or lm-compressor
(01:34:23) What Is I-Matrix & Why People Confuse It with IQ Quantization?
(01:39:36) What’s LoRA & LoRA-Q?
(01:42:36) What Is Sparsity?
(01:47:42) What Is Distillation?
(01:52:34) Extreme Quantization (Unsloth) of Big Models (DeepSeek) at 2-bits 70 % Size Cut
(01:57:27) Will Future Models (Llama-5) Be Trained on FP4 Tensor Cores?
(02:02:15) The Future of LLMs on Edge Devices (Google AI Edge)
(02:08:00) How to Evaluate the Quality of a Quantized Model
(02:26:09) Hugging Face’s Role in the World of LLM/Quantization
(02:33:46) Hugging Face’s Role in the World of LLM/Quantization
(02:36:41) LocalLlama Sub-Reddit Down (Moderator Goes Bananas)
(02:40:11) Guests’ Hope for the Future of LLMs & AI in General
📖 Check out the quantization blog: https://bitly/LLMQuant
#AI #LLM #Quantization #TechBeatsLive #LocalLlama #vLLM #Ollama
👨🏽🚀 Welcome to Episode 06 of "Tech Beats unplugged"
This time, we’re diving headfirst into 𝐭𝐡𝐞 𝐜𝐫𝐚𝐳𝐢𝐞𝐬𝐭 𝐆𝐢𝐭𝐇𝐮𝐛 𝐬𝐞𝐜𝐮𝐫𝐢𝐭𝐲 𝐬𝐭𝐨𝐫𝐢𝐞𝐬, and who better to join us than Steve Giguere, an industry veteran and security expert who’s seen it all.
From supply chain security mayhem to GitHub Actions gone wrong, we uncover real-world security blunders, attack vectors, and best practices to keep your repos and workflows safe.
🌟 We’re so excited to share our latest tech Beats show with you🧡! Please share away 🤗
We hope you'll enjoy it!!!
Topics discussed:
Show Notes
CI/CD Goat (Deliberately vulnerable CI/CD environment): GitHub
GitHub cache poisoning: Cacheract Attack | ScribeSecurity
Your GitHub Secrets in Plain Text: CloudThrill
Ghat tool (Updating dependencies in GitHub Actions): GitHub
OpenSSF Scorecard: Website
The GitHub Worm (Asi Greenholts): Palo Alto Blog
OWASP Top 10 CI/CD Risks: OWASP
Heartbleed OpenSSL Exploit: Wikipedia
🎙About Steve Giguere:
LinkedIn: Steve Giguere
Book: Cloud Native Application Protection Platforms – O'Reilly
Personal Blog: Codifyre
Talk Lessons Learned from OSS and GitOps Journey: YouTube
OWASP Lisbon Talk: YouTube
StayWiredIn YouTube Show: StayWiredIn
DevSecOps Podcast: Spotify
👨🏽🚀 Welcome to Episode 05 of "Tech Beats unplugged"
This time, we tried something completely crazy – we're letting the AI hosts take over! That's right 😎. We're flipping the script and giving the AI the mic to guide us through the fascinating world of local LLMs. but that's not all as this episode is actually inspired by my recent talk at Oracle Cloud World in Vegas. The topic? You guessed it: Local LLMs in the cloud.
🌟 We’re so excited to share our latest tech Beats show with you🧡!
We hope you'll enjoy it!!!
Topics discussed:
Show Notes
👨🏽🚀 Welcome to Episode 04 of "Tech Beats unplugged"
This time, we dared to tackle the big, yet exciting topic which is "𝐍𝐞𝐭𝐰𝐨𝐫𝐤𝐢𝐧𝐠 𝐢𝐧 𝐭𝐡𝐞 𝐜𝐥𝐨𝐮𝐝", and to help us with this challenge we summoned our expert and networking GURU "Jose Moreno" all the way from Munich Germany.
As an Azure Principal Engineer at Microsoft, he comes to share his knowledge and demystify all those mysterious networking concepts, answering questions you never dared to ask in the universe of SDN and cloud networking😀( SDWAN, Hub&Spoke, migrations, Cloud lies, you name it).
🌟 We’re so excited to share our latest tech Beats show with you🧡!
We hope you'll enjoy it!!!
Topics discussed:
Show Notes
Jose Moreno:
👨🏽🚀 Welcome to Episode 03 of "Tech Beats unplugged"
This time, we have been incredibly honored and fortunate to host one of the most prolific speakers, storyteller, and thought leader of his generation. He was kind enough to bless us with his presence for an exclusive interview filled with priceless wisdom and life hacks💡.
Beyond his groundbreaking contributions to Kubernetes, Cloud Native and Open-Source software, he's been one the most influential figures in the tech industry over the past decade.
Today, despite his retirement, he continues to inspire engineers across the world to build smarter, scalable, and highly usable systems🌟.
We’re so excited to share our privileged exchange with the one and only, Kelsey HighTower🧡!
We hope you'll enjoy it!!!
Topics discussed:
Show Notes
Crunchbase news:
👨🏽🚀 Welcome to Episode 02 of "Tech Beats unplugged" After part 1 where we covered the Fundamentals of Linux distributions ,The RHEL DownStream/UpStream story ,who were the Freeloaders, Redhat's shenanigans behind the whole Open Source drama.
This time , we'll explore how, the open source community, and rebuilders are coping with Redhat's decision to close their source.. And what it means for the future of enterprise Linux?
To help us close this final part of this Open Source debate , we brought back our guest is Erik Benner, the VP of Enterprise Transformation at Mythics to explain how the community and the rebuilders are fighting back this hostile Era to ensure the continuity and freedom of the enterprise linux ecosystem for all its users .
Topics discussed:
Show Notes
Although OPEN LA announcements we're already known by the public we decided to keep the chronology of events in our talk because it was recorded 2 days after it happened.
Links:
Open Enterprise Linux Association (OELA):
👨🏽🚀 Welcome to the first Episode of "Tech Beats unplugged" Today's session is all about the thrilling "Open Source Debate - Part One." Joining us as a special guest is Erik Benner, the VP of Enterprise Transformation at Mythics .
Erik brings a wealth of experience to our discussion, having used and sold RedHat over the years but also expert in another enterprise Linux distro and helped customers manage their license and migrate when needed.
💡Together, we'll venture into the heart of the recent open source developments, that made a lot of noise igniting passionate debates among the OSS community. All that thanks to RedHat announcement to go closed source not so long ago.
Topics discussed:
Show Notes
Although the most recent developments weren't completely covered in part 1 we decided to stay faithful to the chronology of events while keeping the episode under 50 minutes. Part 2 will cover the rest.
Links:
Open source definition and GPL:
Tech beats unplugged trailer . Episode "0"
