Adapters: the game changer for fine-tuning - Geoffrey Angus

https://is1-ssl.mzstatic.com/image/thumb/Podcasts211/v4/06/34/47/06344747-4ce1-422a-aba4-8af881c3f5ba/mza_5924224731950142070.jpg/600x600bb.jpg

Daliana's Game

Daliana Liu

94 episodes

2 days ago

I'm Daliana Liu, an ex-Amazon data scientist turned career coach and content creator. I left my tech job to do this "career" thing on my own terms. This is Daliana’s Game — a podcast for tech professionals ready to carve out their own path, and create a career that aligns with their lifestyles. Ever felt you want more fulfillment and freedom beyond the 9-to-5? You’re in the right place. I share more about my career adventure and the lessons I learned with 20k subscribers, join here: https://dalianaliu.kit.com/e0dcfc214b Linkedin with 300k followers: https://www.linkedin.com/in/dalianaliu

Careers

Business

RSS

All content for Daliana's Game is the property of Daliana Liu and is served directly from their servers with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.

Careers

Business

https://d3t3ozftmdmh3i.cloudfront.net/production/podcast_uploaded_nologo/16983749/16983749-1630438232729-233173af45fd8.jpg

Adapters: the game changer for fine-tuning - Geoffrey Angus - The Data Scientist Show #084

Daliana's Game

52 minutes 45 seconds

1 year ago

Adapters: the game changer for fine-tuning - Geoffrey Angus - The Data Scientist Show #084

I interviewed Geoffery Angus, ML team lead @Predibase to talk about why adapter-based training is a game changer. We started with an overview of fine-tuning and then discussed five reasons why adapters are the future of LLMs. Later we also shared a demo and answered questions from the live audience. Try fine-tuning for free: https://pbase.ai/GetStarted Geoffrey’s LinkedIn:https://www.linkedin.com/in/geoffreyangus Daliana's Twitter: ⁠https://twitter.com/DalianaLiu⁠ Daliana’s LinkedIn: ⁠https://www.linkedin.com/in/dalianaliu/⁠

Daliana's Twitter: ⁠https://twitter.com/DalianaLiu⁠

Daliana’s LinkedIn: ⁠https://www.linkedin.com/in/dalianaliu/

Geoffrey’s LinkedIn: https://www.linkedin.com/in/geoffreyangus

Try finetuning for free: https://pbase.ai/GetStarted

(00:00:00) Intro

(00:01:19) What is Fine-tuning?

(00:08:18) Utilizing Adapters for Finetuning Enhancement

(00:09:50) 5 reasons why adapters are the future of LLMs

(00:26:34) Common Mistakes in Adapters Usage

(00:28:34) Training Your Own Adapter

(00:32:23) Behind the Scenes of the Adapter Training Process

(00:37:51) Config File Guidance for Fine-Tuning

(00:39:41) Debugging Strategies for Suboptimal Fine-Tuning Results

(00:42:23) User Queries: Creating a LoRa Adapter and Future Support

(00:51:06) Key Takeaways and Recap