#013: Prepping Your AI Model for the Wild: Building Edge AI Models That Work in the Real World

https://is1-ssl.mzstatic.com/image/thumb/Podcasts221/v4/01/70/bb/0170bbb0-9264-d141-bf56-c375c8195774/mza_14067636312550255.jpg/600x600bb.jpg

Coredump Sessions

Memfault

18 episodes

5 days ago

Coredump Sessions is a podcast for embedded engineers and product teams building connected devices. Hosted by the team at Memfault, each episode features real-world stories and technical deep dives with experts across the embedded systems space. From Bluetooth pioneers and OTA infrastructure veterans to the engineers who built Pebble, we explore the tools, techniques, and tradeoffs that power reliable, scalable devices. If you're building or debugging hardware, this is your go-to for embedded insights.

Technology

RSS

All content for Coredump Sessions is the property of Memfault and is served directly from their servers with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.

Technology

https://d3t3ozftmdmh3i.cloudfront.net/staging/podcast_uploaded_nologo/43339182/43339182-1744206360534-53342e1aed2db.jpg

#013: Prepping Your AI Model for the Wild: Building Edge AI Models That Work in the Real World

Coredump Sessions

57 minutes 40 seconds

3 months ago

#013: Prepping Your AI Model for the Wild: Building Edge AI Models That Work in the Real World

In today's Coredump Session, we dive into the fascinating world of building Edge AI models that truly work in real-world environments. Joined by David Tischler, Developer Program Manager, and Alessandro Grande, Head of Product at Edge Impulse (A Qualcomm Company), we unpack what it takes to deploy AI on tiny devices, explore practical applications from wearables to industrial use cases, and discuss why customization, hardware choices, and continuous monitoring are critical for success. Tune in to explore how Edge AI is transforming device development and enabling smarter solutions.

Key Takeaways:

Edge AI empowers devices to process data locally, significantly reducing latency, bandwidth usage, and improving privacy.
The best use cases for Edge AI today often involve video and audio analytics, wearables, and industrial sensor applications.
Customization is the key value of AI, making it easy to fine-tune models for specific tasks or customer needs without extensive traditional coding.
Effective Edge AI requires thoughtful pre-processing (DSP), not just AI models—this combination significantly improves model performance.
Hardware selection is crucial; developers must balance model complexity with device constraints, such as available RAM and compute power.
Many AI co-processors marketed for embedded systems today are essentially DSP units rebranded as AI accelerators, and usability matters more than raw performance.
Observability and OTA (over-the-air) updates are critical components in Edge AI deployment, enabling continuous monitoring, data-driven refinements, and quick responses to issues in the field.
Production readiness in Edge AI involves not only initial deployment but ongoing data collection, model retraining, and continuous improvement cycles.

Chapters:

00:00 Intro & Teasers: Edge AI's Real-World Promise01:57 Meet Our Guests: David Tischler & Alessandro Grande from Edge Impulse05:19 How Edge AI Took Off: From Hyped to Essential09:21 Beyond Voice Commands: Emerging AI Use Cases12:02 Defining the Edge: Wearables to Factories19:09 AI's Hidden Superpower: Customization and Fine-Tuning26:15 Why AI Belongs at the Edge: Latency, Privacy, and Power28:38 Building the Software Stack: Edge AI for Embedded Engineers34:17 Choosing Your Hardware: Constraints and AI Accelerators45:42 Observability and OTA Updates: Essential for Edge AI52:28 Audience Q&A: Fine-Tuning, TinyML, and the Future

Join the Interrupt Slack ⁠⁠

⁠⁠Watch this episode on YouTube

Follow Memfault

Other ways to listen:

⁠⁠Visit our website