Two Stanford friends who flooded their kitchen using dish soap instead of dishwasher detergent have somehow become AI experts. One builds startups, the other studies at Cambridge - together they break down LLMs and machine learning with zero BS and maximum banter.
All content for Pretrained is the property of Pierce Freeman & Richard Diehl Martinez and is served directly from their servers
with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.
Two Stanford friends who flooded their kitchen using dish soap instead of dishwasher detergent have somehow become AI experts. One builds startups, the other studies at Cambridge - together they break down LLMs and machine learning with zero BS and maximum banter.
Kimi K2 and Moonshot AI's history, avoiding loss spikes during training, the muon optimizer, and data parallelism
Pretrained
Two Stanford friends who flooded their kitchen using dish soap instead of dishwasher detergent have somehow become AI experts. One builds startups, the other studies at Cambridge - together they break down LLMs and machine learning with zero BS and maximum banter.
