What does it really mean when GPT-5 “thinks”? In this conversation, OpenAI’s VP of Research Jerry Tworek explains how modern reasoning models work in practice—why pretraining and reinforcement learning (RL/RLHF) are both essential, what that on-screen “thinking” actually does, and when extra test-time compute helps (or doesn’t). We trace the evolution from O1 (a tech demo good at puzzles) to O3 (the tool-use shift) to GPT-5 (Jerry calls it “03.1-ish”), and talk through verifiers, reward design, and the real trade-offs behind “auto” reasoning modes.
We also go inside OpenAI: how research is organized, why collaboration is unusually transparent, and how the company ships fast without losing rigor. Jerry shares the backstory on competitive-programming results like ICPC, what they signal (and what they don’t), and where agents and tool use are genuinely useful today. Finally, we zoom out: could pretraining + RL be the path to AGI?
This is the MAD Podcast —AI for the 99%. If you’re curious about how these systems actually work (without needing a PhD), this episode is your map to the current AI frontier.
OpenAI
Website - https://openai.com
X/Twitter - https://x.com/OpenAI
Jerry Tworek
LinkedIn - https://www.linkedin.com/in/jerry-tworek-b5b9aa56
X/Twitter - https://x.com/millionint
FIRSTMARK
Website - https://firstmark.com
X/Twitter - https://twitter.com/FirstMarkCap
Matt Turck (Managing Director)
LinkedIn - https://www.linkedin.com/in/turck/
X/Twitter - https://twitter.com/mattturck
(00:00) Intro
(01:01) What Reasoning Actually Means in AI
(02:32) Chain of Thought: Models Thinking in Words
(05:25) How Models Decide Thinking Time
(07:24) Evolution from O1 to O3 to GPT-5
(11:00) Before OpenAI: Growing up in Poland, Dropping out of School, Trading
(20:32) Working on Robotics and Rubik's Cube Solving
(23:02) A Day in the Life: Talking to Researchers
(24:06) How Research Priorities Are Determined
(26:53) Collaboration vs IP Protection at OpenAI
(29:32) Shipping Fast While Doing Deep Research
(31:52) Using OpenAI's Own Tools Daily
(32:43) Pre-Training Plus RL: The Modern AI Stack
(35:10) Reinforcement Learning 101: Training Dogs
(40:17) The Evolution of Deep Reinforcement Learning
(42:09) When GPT-4 Seemed Underwhelming at First
(45:39) How RLHF Made GPT-4 Actually Useful
(48:02) Unsupervised vs Supervised Learning
(49:59) GRPO and How DeepSeek Accelerated US Research
(53:05) What It Takes to Scale Reinforcement Learning
(55:36) Agentic AI and Long-Horizon Thinking
(59:19) Alignment as an RL Problem
(1:01:11) Winning ICPC World Finals Without Specific Training
(1:05:53) Applying RL Beyond Math and Coding
(1:09:15) The Path from Here to AGI
(1:12:23) Pure RL vs Language Models