Welcome to Mixture of Experts, your weekly deep dive into the ever-evolving landscape of artificial intelligence—bringing you insightful discussions on the latest AI trends, innovations, and their impact on business.
From breakthrough research to practical applications, each episode offers a balanced blend of expertise and analysis. Explore how AI is reshaping industries, driving efficiency, and unlocking new opportunities for growth. Whether you're a seasoned professional seeking to stay ahead of the curve or an enthusiast curious about the future of technology, Mixture of Experts delivers the perfect mix of insights and practical knowledge. Tune in and stay informed as we navigate the dynamic intersection of AI and business.
Welcome to Mixture of Experts, your weekly deep dive into the ever-evolving landscape of artificial intelligence—bringing you insightful discussions on the latest AI trends, innovations, and their impact on business.
From breakthrough research to practical applications, each episode offers a balanced blend of expertise and analysis. Explore how AI is reshaping industries, driving efficiency, and unlocking new opportunities for growth. Whether you're a seasoned professional seeking to stay ahead of the curve or an enthusiast curious about the future of technology, Mixture of Experts delivers the perfect mix of insights and practical knowledge. Tune in and stay informed as we navigate the dynamic intersection of AI and business.
Is Kimi K2 actually better than Claude? In episode 64 of Mixture of Experts, host Tim Hwang is joined by Abraham Daniels, Chris Hay and Kaoutar El Maghraoui. First, Moonshot AI released Kimi K2, their trillion-parameter MoE model, and our experts analyze the benchmarks and what this really means. Then, we reflect on DeepSeek-R1 6 months later; did it live up to the hype? Next, Google is investing $25 billion in AI infrastructure, and it’s not just AI chips. How does this compare to their competitors? Finally, Anthropic’s Claude for Enterprise announced an expansion with Lawrence Livermore National Laboratory —what AI safety concerns might this raise? Tune in to today’s episode of Mixture of Experts to find out.
00:00 – Intro
01:18 – Kimi K2
12:07 – DeepSeek-R1 vibe check
28:49 – Google's data center investments
41:20 – Claude powers LLNL research
The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Resources:
How will AI agents change search? In episode 63 of Mixture of Experts, host Tim Hwang is joined by Aaron Baughman, Chris Hay and Kate Soule. First, Perplexity released their Comet browser, and there are rumors that OpenAI is next. Who will win the AI browser war? Then, we discuss frontier model transparency amid Anthropic’s call for a “targeted transparency framework”. Does this only support large model developers? Later, Cloudflare blocks AI scrapers. Is this a good thing? Finally, we discuss how AI is showing up at Wimbledon this year and enhancing the fan experience via Match Chat. Tune in to today’s episode of Mixture of Experts.
00:00 – Intro
1:06 -- AI browser wars
13:10 -- Anthropic on model transparency
28:57 -- Cloudflare scrapers
41:32 -- Wimbledon Match Chat
The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Will AI agents run all businesses? In episode 62 of Mixture of Experts, host Tim Hwang is joined by Gabe Goodhart, Kush Varshney and Marina Danilevsky to debrief Anthropic’s Project Vend. Next, do we still need massive data centers? We analyze DiLoCoX and discuss the possibility of distributed model training. Then, the New York Times released an article discussing how computer science education has changed in the era of AI; should people still study computer science? Finally, is the paper review process broken? And is it AI’s fault? All that and more on today’s episode of Mixture of Experts.
00:00 – Intro
01:07 -- Anthropic’s Project Vend
13:38 -- DiLoCoX
25:56 -- Computer science education
40:57 -- AI prompts in papers
The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
In episode 61 of Mixture of Experts, host Tim Hwang is joined by Kaoutar El Maghraoui, Gabe Goodhart and, joining us for the first time, Ann Funai. First up, a new paper from MIT: “Your brain on ChatGPT”. Are we using AI and LLMs to augment our intelligence, or are we becoming optimally lazy? Next, our experts explore the surprising evolution of autonomous vehicles: they are driving more aggressively, and the results might actually be... safer? Finally, a conversation about AI-generated ads, AI-video generation and the risks that come with them.
The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Could AI take your job? In episode 60 of Mixture of Experts, host Tim Hwang is joined by Phaedra Boinodiris, Chris Hay and Volkmar Uhlig. First, the impact of AI on the job market is all the rage online. Between the Godfather of AI revealing which jobs he feels are safe, and Jensen Huang responding to Dario Amodei’s thoughts, our experts analyze the chatter. Next, Scale AI is facing some fallout. What can we learn about data security? Then, an article from the New York Times details how chatbots can take users down “conspiratorial rabbit holes,” Who is benefitting from these conversations? Finally, how is AI affecting the startup ecosystem?Tune in to Mixture of Experts to find out!
00:01 – Intro
01:17 -- AI and jobs
12:28 -- Scale AI fallout
22:00 -- Chatbot conspiracies
35:20 -- AI startup ecosystem
The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Did Apple’s WWDC 2025 live up to expectations? In episode 59 of Mixture of Experts, host Tim Hwang is joined by Chris Hay, Kaoutar El Magrahoui and Shobhit Varshney. Today, the experts analyze all things Apple—from Apple Research’s recent paperThe Illusion of Thinking to Apple Intelligence. Next, OpenAI released o3-pro: we continue the analysis on AI reasoning. Then, Meta purchased Scale AI for a whopping $15 billion. Why? Finally, an exciting new announcement on fault-tolerant quantum computing: IBM Quantum Starling will arrive by 2029. What does this mean and why should we care? All that and more on this week’s Mixture of Experts.
00:01 – Intro
01:58 -- Apple's WWDC
16:47 -- OpenAI o3-pro
30:43 -- Meta & Scale AI's "superintelligence" lab
37:56 -- Fault-tolerant quantum computing
The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Resources:
How IBM will build the world's first large-scale, fault-tolerant quantum computer: https://www.ibm.com/quantum/blog/large-scale-ftqc
Visit the Mixture of Experts podcast page to learn more: https://www.ibm.com/think/podcasts/mixture-of-experts
Subscribe for AI updates: https://www.ibm.com/account/reg/us-en/signup?formid=news-urx-52120
Learn more about artificial intelligence: https://www.ibm.com/think/artificial-intelligence
Is open source winning the AI race? In episode 58 of Mixture of Experts, host Tim Hwang is joined by Anthony Annunziata, Ash Minhas and Sarah Amos live from New York Tech Week. First, we dive into the various themes coming out of NY Tech Week, specifically practical uses of AI. Next, we analyze a couple of different reports about the impact of open source on AI. Finally, Claude 4 has some really weird behaviors. What does this teach us about AI safety and model development? All that and more on this week’s Mixture of Experts.
00:01 -- Intro
01:09 -- New York Tech Week 2025
11:36 -- Open source AI reports
31:33 -- Weird behaviors from Claude 4
The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Claude 4’s system prompt leaked? In episode 57 of Mixture of Experts, host Tim Hwang is joined by Chris Hay, Kate Soule and Aaron Baughman to debrief a hectic week in AI. First, Anthropic’s system prompt for Claude 4 was leaked; what stuck out to our experts? Then, Rick Rubin and Anthropic are vibe coding? We debrief “The Way of Code.” Next, OpenAI paid $6.5 billion for Jony Ive’s company, LoveFrom . Finally, Microsoft theorizes the development of “agent factories”. Is there a “winner takes all” in the AI agent's space? Tune in to this week’s Mixture of Experts for more!
00:01 – Intro
00:51 -- Claude 4 system prompt
13:23 -- The Way of Code
23:03 -- Jony Ive and OpenAI
32:30 -- Microsoft’s “agent factory”
The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
How long until Anthropic drops Claude 5.0? On today’s bonus episode of Mixture of Experts, guest host Bryan Casey is joined by Chris Hay, Marina Danilevsky and Shobhit Varshney to analyze the newly released Claude 4.0 family: Opus 4 and Sonnet 4. What do we know about the model architecture vs. What is speculation? In this special episode we talk Anthropic, OpenAI, Google and the rest of the competition in the AI race! Who will win? Tune-in to this bonus Mixture of Experts for more!
00:01 – Intro
00:32 – Claude 4.0
12:48 – OpenAI and Jony Ives
22:27 – Anthropic full-stack
The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Should you pay for Google’s AI Ultra subscription plan? In episode 56 of Mixture of Experts, host Tim Hwang is joined by Abraham Daniels, Gabe Goodhart and Marina Danilevsky to debrief the announcements from Google I/O 2025. Next, RedHat dropped llm-d, a Kubernetes-native distributed inference serving stack; what is it and why does it matter? Then, we analyze Microsoft’s NLWeb: is everything becoming conversational? Finally, Stack Overflow has been on a decline. Is AI to blame? Find out more on this week’s Mixture of Experts!
00:01 – Intro
00:52 --Google I/O 2025 announcements
11:36 -- Stack Overflow
22:04 -- llm-d
30:08 -- NLWeb
The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Can Mistral make Europe a global AI contender? In episode 55 of Mixture of Experts, host Tim Hwang is joined by Chris Hay, Volkmar Uhlig and Kaoutar El Maghraoui to discuss the drop of Mistral Medium 3. Next, we analyze the AI chip sales both NVIDIA and AMD made to Saudi Arabia. Then, with IBM’s new ITBench and OpenAI’s HealthBench, we dive deeper into benchmarks for AI evaluation. Tune in to this week’s Mixture of Experts for more!
00:01 – Intro
00:47 -- Mistral Medium 3
12:26 -- AI chips to Saudi Arabia
21:21 -- AI evaluation benchmarks
31:47 -- Amazon's AI-generated pause ads
The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Has AI hallucination gotten out of control? In episode 54 of Mixture of Experts, host Tim Hwang is joined by Kate Soule, Skyler Speakman and Kaoutar El Maghraoui to analyze reasoning models and rising hallucinations. Next, as IBM Think 2025 wraps, the experts unpack the biggest highlights from IBM’s biggest show of the year: new AI agents, Ferraris and ... penguins? Then, OpenAI is making moves with its acquisition of Windsurf. What does this mean? Tune in to this week’s Mixture of Experts for more!
00:01 – Intro
01:12 – IBM Think 2025
09:27 – Reasoning models and hallucinations
19:23 – OpenAI Windsurf acquisition
The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
We are celebrating MoE podcast’s one year anniversary! In episode 53 of Mixture of Experts, host Tim Hwang is joined by the O.G. panel of experts from our pilot—Chris Hay, Shobhit Varshney and Kush Varshney. This week, we cover some exciting announcements at LlamaCon. Then, we discuss some new Chinese AI models from Qwen3 to the rumored DeepSeek-R2. Next, J.P. Morgan’s CISO, Patrick Opet, released “An open letter to our third-party suppliers,” covering the need for AI security. Are we doomed? Finally, we look back at some of the topics we discussed in episode 1—the Rabbit AI device, GPT-2 chatbot, Apple Intelligence—after all that, who was the first person to say “agents” on the podcast? Tune in to find out, on today’s one-year celebration of Mixture of Experts.
00:00 -- Intro
00:38 -- LlamaCon
10:34 -- Qwen3 and DeepSeek-R2
23:23 -- J.P. Morgan’s open letter
39:45 -- One year of MoE
The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Is OpenAI going to enter the social media game? In episode 52 of Mixture of Experts host, Tim Hwang is joined by Gabe Goodhart, Kate Soule and Marina Danilevsky. First, Sam Altman is rumored to be testing an internal prototype social network; why is this a potential next move for the AI giant? Next, for our paper of the week, we analyze Anthropic’s study on chain-of-thought reasoning, “Reasoning Models Don’t Always Say What They Think.” Then, AI scraping puts a strain on Wikimedia; what’s the impact of this? Finally, China held a humanoid robot half-marathon, where humans raced alongside robot competitors. Who wins this AI race? All that and more on today’s Mixture of Experts.
00:41 -- OpenAI social network
10:02 -- Anthropic’s reasoning study
20:56 -- AI bots strain Wikimedia
31:33 -- Humanoid half-marathon
The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
OpenAI just dropped o3 and o4-mini! In episode 51 of Mixture of Experts host, Tim Hwang is joined by Chris Hay, Vyoma Gajjar and special guest John Willis, Owner of Botchagalupe Technologies. Today, we analyze Sam Altman’s new AI models, o3 and o4-mini. Next, Google announced that by Q3 you can run Gemini on-prem; what does this mean for enterprise AI adoption? Then, John is on the show today to take us through AI evaluation tools and why we need them. Finally, NVIDIA is planning to move AI chip manufacturing to the U.S. Can they pull this off? All that and more on today’s Mixture of Experts.
00:01 – Intro
00:56 – OpenAI o3 and o4 mini
14:57 – Google Gemini on-prem
23:43 – AI evaluation tools
34:59 – NVIDIA's U.S. chip manufacturing
The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
IBM z17 is here! In episode 50 of Mixture of Experts, host Tim Hwang is joined by Kate Soule, Shobhit Varshney and Hillery Hunter to debrief the launch of a new mainframe with robust AI infrastructure. Next, Meta dropped Llama 4 over the weekend;, how's it going? Then, Shobhit is recording live from Google Cloud Next in Las Vegas, along with Gemini 2.5 Pro. What are some of the most exciting announcements? Finally, the Pew Research Center shows perception of AI, how does this impact the industry? All that and more on today’s 50th Mixture of Experts.
00:01 -- Intro
00:55 -- IBM z17
11:42 -- Llama 4
25:02 -- Google Cloud Next 2025
34:29 -- Pew's research on perception of AI
The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Explore the new features of IBM z17: https://www.ibm.com/products/z17
Read the Pew Research: https://www.pewresearch.org/internet/2025/04/03/how-the-us-public-and-ai-experts-view-artificial-intelligence/
Subscribe for AI updates: https://ibm.biz/Think_newsletter
Visit Mixture of Experts podcast page to learn more AI content: https://www.ibm.com/think/podcasts/mixture-of-experts
Will OpenAI be fully open source by 2027? In episode 49 of Mixture of Experts, host Tim Hwang is joined by Aaron Baughman, Ash Minhas and Chris Hay to analyze Sam Altman’s latest move towards open source. Next, we explore Anthropic's mechanistic interpretability results and the progress the AI research community is making. Then, can Apple catch up? We analyze the latest critiques on Apple Intelligence. Finally, Amazon enters the chat with AI agents. How does this elevate the competition? All that and more on today’s Mixture of Experts.
00:01 -- Introduction
00:48 -- OpenAI goes open
11:36 -- Anthropic interpretability results
24:55 -- Daring Fireball on Apple Intelligence
34:22 -- Amazon’s AI agents
The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Subscribe for AI updates: https://www.ibm.com/account/reg/us-en/signup?formid=news-urx-52120
Learn more about artificial intelligence → https://www.ibm.com/think/artificial-intelligence
Visit Mixture of Experts podcast page to learn more AI content → https://www.ibm.com/think/podcasts/mixture-of-experts
What’s the best open-source model? In episode 48 of Mixture of Experts, host Tim Hwang is joined by Kate Soule, Kush Varshney and Skyler Speakman to explore the future of open-source AI models. First, we chat about the release of DeepSeek-V3-0324. Then, more announcements coming out of Google including Gemini Canvas and Gemini 2.5. Next, Extropic has entered the chat with a thermodynamic chip. Finally, AI image generation is on the rise as OpenAI released GPT-4o image generation. All that, and more on today’s Mixture of Experts.
00:01 – Intro
00:42– DeepSeek-V3-0324
09:48 – Gemini 2.5 and Canvas
21:27– Extropic’s thermodynamic chip
30:20 – OpenAI image generation
The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
What’s the most exciting announcement coming out of NVIDIA GTC? In episode 47 of Mixture of Experts, host Tim Hwang is joined by Nathalie Baracaldo, Kaoutar El Maghraoui and Vyoma Gajjar. First, we dive into the latest announcements from NVIDIA GTC, including the Groot N1 model for humanoid robotics. Next, Baidu released some new AI reasoning models, and they’re not open source? Then, for our paper of the week we discuss the flaws of Chain-of-Thought reasoning. Finally, Gemini Flash 2.0 has released image generation models for developer experimentation., Iis Google catching up on the AI game? Tune -in to today’s Mixture of Experts to find out!
00:01 – Intro
01:27– NVIDIA GTC
14:18– New Baidu AI models
21:19– Chain-of-Thought reasoning
32:18 – Gemini image generation
The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Is Manus a second DeepSeek moment? In episode 46 of Mixture of Experts, host Tim Hwang is joined by Chris Hay, Kaoutar El Maghraoui and Vyoma Gajjar to talk Manus! Next, the rise of vibe coding—what started as a joke has now become a thing? Then, we dive deep into the future of scaling laws. Finally, Perplexity is teaming up with Deutsche Telekom to release an AI phone—what’s the motivation here? Tune-in to today’s Mixture of Experts to find out more!
00:01 – Intro
00:37 -- Manus
14:09 – Vibe coding
30:13 – Scaling laws
39:07 – Perplexity's AI phone
The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
