The power driving AI models has been on an exponential climb, with computation levels far surpassing what was possible just a decade ago. This episode dives into Visual Capitalist's analysis of how computation has accelerated from the early days of AI to today’s large language models. We’ll discuss the impact of this computational growth on AI capabilities, the challenges of sustaining such a rapid increase, and what this means for the future of AI research and applications. Join us to uncover the driving forces behind AI’s remarkable leap in performance and the hardware innovations shaping the next era of artificial intelligence.
Download Link:
https://www.visualcapitalist.com/cp/charted-history-exponential-growth-in-ai-computation/
Artificial Intelligence holds the promise of transforming the global economy, driving productivity, and enhancing growth—but it also presents risks, like job displacement and increasing inequality. In this episode, we explore the IMF's analysis of AI’s dual impact on advanced and emerging economies, as well as its potential to reshape labor markets. We’ll discuss the IMF’s AI Preparedness Index, which assesses the readiness of 125 countries for AI integration, and highlight policy measures to harness AI’s benefits responsibly. Can we steer AI towards equitable growth? Join us as we unpack the strategies to ensure AI benefits humanity as a whole.
Download Link:
https://www.imf.org/en/Blogs/Articles/2024/01/14/ai-will-transform-the-global-economy-lets-make-sure-it-benefits-humanity
Will AI lead to unprecedented economic acceleration, or are there limits to its transformative potential? In this episode, we explore Epoch AI’s comprehensive review of the arguments for and against explosive growth driven by AI advancements. We’ll discuss predictions based on economic growth models, the potential regulatory and resource constraints, and the unresolved challenges of scaling AI effectively. This episode offers listeners a balanced look at both optimistic and cautious perspectives on AI’s role in reshaping global economies, giving insight into how AI could either turbocharge growth or face significant roadblocks.
Download Link:
https://epochai.org/blog/explosive-growth-from-ai-a-review-of-the-arguments
With AI models growing ever larger, are we reaching the limits of available human-generated data? This episode dives into Epoch AI's analysis of how much high-quality text data remains and when we might exhaust it at the current pace of model training. We’ll explore projections showing that we could fully utilize all available public data between 2026 and 2032, depending on training methods. What does this mean for the future of AI model development, and will synthetic data or multimodal training help fill the gap? Tune in as we break down the potential bottlenecks for future AI scaling.
Download Link:
https://epochai.org/blog/will-we-run-out-of-data-limits-of-llm-scaling-based-on-human-generated-data
Language models are improving rapidly—not just through more compute, but with smarter algorithms. In this episode, we unpack Epoch AI's analysis of how algorithmic progress in language models is advancing at a rate that doubles compute efficiency every 5 to 14 months. We’ll explore the innovations driving this efficiency, from transformer architectures to new scaling laws, and discuss what this means for the future of AI research. How far can we push AI performance through algorithmic improvements alone? Tune in for a deep dive into the data shaping AI’s future trajectory.
Download Link:
https://epochai.org/blog/algorithmic-progress-in-language-models
As the demand for powerful AI models grows, so does the compute required to train them. This episode dives into Epoch AI’s findings on how the compute for frontier AI models has been growing at a staggering 4-5x per year. We’ll discuss the implications of this rapid increase for both the capabilities and accessibility of advanced AI systems, including potential bottlenecks in hardware and energy consumption. Join us as we explore the trajectory of compute growth and what it tells us about the future of AI development, from language models to multimodal and autonomous systems.
Download Link:
https://epochai.org/blog/training-compute-of-frontier-ai-models-grows-by-4-5x-per-year
As AI becomes a key driver in economic and social landscapes, how do we measure its true impact? This episode delves into Stanford HAI’s exploration of the major challenges in assessing AI progress and its effects on society. We’ll cover six critical areas, from defining AI and analyzing bibliometric data to measuring economic and societal impacts, particularly in labor markets and inequality. Discover why establishing reliable metrics is essential for informed AI policy and the interdisciplinary efforts needed to make meaningful assessments. Join us to understand how accurate measurement shapes AI’s future in policy and beyond.
Download Link:
https://arxiv.org/pdf/2009.09071
AI’s rapid progress in 2023 is best captured through key metrics—Stanford HAI's latest AI Index presents 13 charts that reveal trends in open-source adoption, global investment, performance benchmarks, and more. In this episode, we break down what these trends mean for the future of AI, from the dominance of corporate research and skyrocketing training costs to the public’s growing concerns over job impact. We’ll discuss where the U.S. stands in the AI race, how foundation models are advancing, and why AI is both transforming industries and reshaping society. Join us to understand the data driving AI’s trajectory.
Download Link:
https://hai.stanford.edu/news/ai-index-state-ai-13-charts
AI is advancing on multiple fronts, and large language models are just one part of the story. In this episode, we explore the findings from Stanford HAI’s AI Index on five major trends in frontier AI research. From breakthroughs in multimodal models like Google’s Gemini to flexible robotics and agentic AI, we’ll discuss how these advancements are transforming areas as diverse as automation, scientific discovery, and household robotics. What’s next for AI research, and how are these trends shaping the future of AI applications? Join us to gain a comprehensive understanding of the new horizons in AI.
Download Link:
https://hai.stanford.edu/news/ai-index-five-trends-frontier-ai-research
The AI landscape is shifting at breakneck speed, with new benchmarks, massive investments, and even greater public scrutiny. This episode delves into Stanford HAI's AI Index Report 2024, unpacking major findings on AI advancements, including new data on generative AI funding, international trends in AI patents, and the rise of multimodal systems like GPT-4 and Gemini. We’ll explore the economic impacts, the rapid policy responses worldwide, and the public’s growing concerns about privacy, employment, and misinformation. If you’re keen to understand where AI is heading in 2024 and beyond, this episode provides an in-depth look at how AI continues to reshape our world.
Download Link:
https://aiindex.stanford.edu/wp-content/uploads/2024/05/HAI_AI-Index-Report-2024.pdf
As computing faces unprecedented demand from AI and data-heavy applications, new architectures are emerging to handle the load. This episode dives into the Future Today Institute’s 2024 report, exploring cutting-edge trends in computing, from quantum and photonic chips to neuromorphic and biological computing. We’ll discuss the race to address AI's voracious computational needs, the geopolitical stakes surrounding semiconductor production, and the transformative potential of human-inspired chip designs. Join us to understand how these innovations are set to redefine the future of computing, and the crucial role they’ll play in everything from AI to global data infrastructure.
Download Link:
https://futuretodayinstitute.com/wp-content/uploads/2024/03/TR2024_Computing_FINAL_LINKED.pdf
Artificial intelligence is rapidly evolving, presenting both incredible opportunities and significant challenges. In this episode, we explore the Future Today Institute’s latest insights on AI, covering trends in generative AI, autonomous systems, and industry-specific applications. We’ll discuss the growing influence of AI on global geopolitics, the race for talent, and the potential ethical and regulatory hurdles. From advancements in deep learning to the practical applications of small language models, this episode offers a comprehensive look at the trends set to shape AI’s future and the questions leaders need to consider as they navigate these changes.
Download Link:
https://futuretodayinstitute.com/wp-content/uploads/2024/03/TR2024_Artificial-Intelligence_FINAL_LINKED.pdf
The year 2024 marks the start of a tech “supercycle,” an era of intense innovation set to reshape industries and daily life. In this episode, we break down the Future Today Institute’s insights on how emerging technologies—from AI and biotechnology to the metaverse and Web3—are intersecting to form this powerful supercycle. We’ll explore key areas of disruption, such as advances in autonomous systems, sustainable energy solutions, and synthetic biology, and discuss how these technologies will create winners, losers, and unprecedented opportunities. Whether you’re a tech enthusiast or an industry leader, join us to understand the trends that are set to define the next decade.
Download Link:
https://futuretodayinstitute.com/wp-content/uploads/2024/03/TR2024_Executive_Summary_FINAL_LINKED.pdf
Scaling AI is more than just implementing technology—it’s about building a sustainable framework that integrates with your organization’s operations. In this episode, we dive into McKinsey’s Executive’s Guide to Developing AI at Scale, discussing the essential stages of AI deployment, from lab-based experimentation to production-level "factory" environments. We’ll explore key concepts like MLOps, continuous integration, and microservices, as well as the talent and processes needed to create reliable, scalable AI solutions. Whether you’re in manufacturing, finance, or retail, this episode provides a comprehensive look at what it takes to develop AI systems that deliver real value across your organization.
Download Link:
https://www.mckinsey.com/capabilities/quantumblack/our-insights/executives-guide-to-developing-ai-at-scale#intro
Artificial intelligence has moved from hype to a strategic asset, but how can executives effectively leverage it? This episode breaks down McKinsey’s Executive’s Guide to AI, offering actionable insights on how AI can address specific business challenges across industries. We’ll explore various AI technologies, from machine learning to natural language processing, and discuss real-world applications like predictive analytics, customer segmentation, and workflow automation. Whether you’re in manufacturing, retail, or finance, this episode will help you understand the essentials for making informed, impactful AI decisions in your organization.
The tech landscape in 2024 is brimming with transformative trends, from generative AI to quantum computing and sustainable technologies. In this episode, we break down McKinsey’s analysis of 15 top technology trends, exploring innovations like industrializing machine learning, the future of robotics, and advancements in climate technologies. We’ll discuss how these trends are reshaping industries, influencing investment, and creating new demand for specialized talent. Whether you’re an industry leader or a curious tech enthusiast, this episode offers insights into which technologies are set to define the future and how companies can leverage them for growth.
Download Link: https://www.mckinsey.com/capabilities/mckinsey-digital/our-insights/the-top-trends-in-tech
NVIDIA has become a central player in the AI and computing world, driving innovations that support everything from gaming to advanced AI research. In this episode, we dive into NVIDIA’s 2024 company overview, exploring how the company’s advancements in GPUs, AI infrastructure, and data center technology are shaping industries globally. We’ll discuss NVIDIA’s strategy to lead in AI-powered computing, its role in cloud and enterprise AI, and the transformative technologies in development that could change how we experience AI. Join us to learn about NVIDIA’s vision for the future of computing and why it’s positioned to stay at the forefront of AI innovation.
Download Link:
https://s201.q4cdn.com/141608511/files/doc_presentations/2024/Feb/NVDA-Company-Overview-2024-02-21.pdf
AI is advancing rapidly, but which innovations are here to stay, and which are just hype? In this episode, we explore Gartner’s 2024 Hype Cycle for Artificial Intelligence, highlighting technologies poised for real impact, from AI engineering to knowledge graphs and beyond. We’ll discuss how these innovations are expected to transform industries, the importance of responsible AI, and emerging fields like quantum AI and embodied AI. Whether you're an AI enthusiast or industry expert, this episode will help you separate lasting trends from short-lived fads in the world of artificial intelligence.
Download Link: https://www.gartner.com/en/documents/5505695
Language models are advancing faster than ever, but what’s driving this rapid improvement? This episode dives into the findings of a recent study that quantifies the impact of algorithmic advancements on language models from 2012 to 2023. We’ll explore how innovations in pre-training algorithms are helping models achieve the same performance with drastically less compute, doubling efficiency every 8 months on average. Join us as we uncover the balance between scaling up compute resources and refining algorithms and what this means for the future of AI in areas like NLP, machine translation, and beyond.
Download Link:
https://arxiv.org/pdf/2403.05812v1.pdf
Generative AI is not just a technological marvel; it’s poised to reshape entire industries and economies. In this episode, we delve into the Harvard Business School's insights on the economic impact of generative AI. We’ll explore five key principles that explain how AI is driving productivity, creating new market opportunities, and potentially displacing certain types of labor. What industries are most vulnerable to disruption, and which will flourish in this new AI-driven economy? Join us as we break down the economic implications of this technological revolution and its long-term effects on businesses worldwide.
Download Link:
https://www.hbs.edu/ris/Publication%20Files/24-013_d9b45b68-9e74-42d6-a1c6-c72fb70c7282.pdf
