#84- FineWeb, the best dataset to pre-train LLMs.

https://is1-ssl.mzstatic.com/image/thumb/Podcasts122/v4/b7/cc/aa/b7ccaa3b-f68f-e761-1fb8-ba46a556e460/mza_12200604887996795694.jpg/600x600bb.jpg

Life with AI

Filipe Lauar

100 episodes

1 day ago

In this podcast I explain some hard concepts of AI in a way that anyone can understand. I also show how AI is influencing our lives and we don’t know.

Technology

RSS

All content for Life with AI is the property of Filipe Lauar and is served directly from their servers with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.

In this podcast I explain some hard concepts of AI in a way that anyone can understand. I also show how AI is influencing our lives and we don’t know.

Technology

https://d3t3ozftmdmh3i.cloudfront.net/production/podcast_uploaded_nologo/15759676/15759676-1665109538049-5ff968baea9f6.jpg

#84- FineWeb, the best dataset to pre-train LLMs.

Life with AI

12 minutes 9 seconds

1 year ago

#84- FineWeb, the best dataset to pre-train LLMs.

Hey guys, in this episode I talk about the FineWeb dataset, the best pre-training open source dataset to date. In the episode I explain how they created the dataset and I also share some results.

Link to the huggingface blog: https://huggingface.co/spaces/HuggingFaceFW/blogpost-fineweb-v1

Instagram of the podcast: https://www.instagram.com/podcast.lifewithai

Linkedin of the podcast: https://www.linkedin.com/company/life-with-ai