#30: Language Models, Active Inference and Latent Variables with Alejandro Daniel Noel

https://is1-ssl.mzstatic.com/image/thumb/Podcasts122/v4/e8/97/70/e89770fc-37aa-d0c7-01ff-0f4ae9d69203/mza_13298557788845608623.jpg/600x600bb.jpg

The Transformative Ideas Podcast

Manuel Brenner

36 episodes

1 week ago

The Transformative Ideas Podcast (formerly the ACIT Science Podcast). This podcast is to provide a glimpse into the life of scientists: to learn about the ideas they are passionate about, to find out what gets them out of bed every day to face the challenges and frustrations of working at the frontier to the unknown, and to share in some of the most important lessons they have learned in their career. For inquiries, reach out to manu.brenn@gmail.com.

Natural Sciences

Science

RSS

All content for The Transformative Ideas Podcast is the property of Manuel Brenner and is served directly from their servers with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.

Natural Sciences

Science

https://d3t3ozftmdmh3i.cloudfront.net/production/podcast_uploaded_episode400/9006462/9006462-1661934395376-82bab6587ada9.jpg

#30: Language Models, Active Inference and Latent Variables with Alejandro Daniel Noel

The Transformative Ideas Podcast

1 hour 42 minutes 30 seconds

3 years ago

#30: Language Models, Active Inference and Latent Variables with Alejandro Daniel Noel

In this episode, our host Manuel Brenner is joined by Alejandro Daniel Noel. Alejandro got his masters from TU Delft working with Acitive Inference and the Free Energy Principle, and is now a full time software engineer at Google in Zürich, specializing on machine learning engineering of language models for conversational AI.

We discuss the free energy principle, active inference, the role of uncertainty, latent variable models, language and tokenization, causality, diffusion models, DALL-E, paths towards AGI, JEPA, language and consciousness, attention, self-attention, and many more topics.

Stay tuned for more episodes: https://mailchi.mp/0346443b6ddf/acit-global-signup