Naveen Rao: Hardware Alpha Lies in Model Co-Design
Naveen Rao explains why Moore's law is dead, why smaller data types drove recent AI gains, and how hardware-model co-design wins.
Inference Will Be $10TRN Market: What No One Sees | Software Investors are F***ed | Naveen Rao
With Harry Stebbings, Naveen Rao · Sunday, October 25, 2026
Naveen Rao, Founder and CEO of Unconventional AI and former co-founder of MosaicML and Nervana Systems, discusses why power constraints and the end of physical chip scaling make AI hardware co-design the most critical bottleneck and opportunity in technology. He outlines why the inference market will reach $10 trillion, explains why traditional pure-software SaaS investing is severely threatened, and argues that robotics represents an opportunity 100x larger than coding agents.
Key takeaways
- Physical transistor scaling has stalled: Dennard scaling no longer yields automatic energy efficiency gains with each chip shrink. Read more →
- Building one gigawatt of new power capacity costs approximately $50 billion, which exceeds the $20 billion to $30 billion price tag of an advanced semiconductor fab. Read more →
- Pre-training hits a hard wall because humanity cannot gather enough clean data to cover every specialized job in the real world. Read more →
- Naveen Rao projects the AI inference market will reach $10 trillion within a decade as dropping token costs trigger Jevons Paradox across the global economy. Read more →
- Naveen Rao warns that venture capitalists backing pure software SaaS face vanishing margins as value flows directly to underlying model providers. Read more →
5 articles from this episode
Naveen Rao: AI Will Exhaust the US Power Grid Within Years
Naveen Rao explains why building a single gigawatt costs $50B and how the AI energy bottleneck will trigger two-tiered electricity pricing.
Naveen Rao Says Transformers Cannot Reason Efficiently
Naveen Rao explains why pre-training hits data walls, why transformers mimic reasoning poorly, and how reinforcement learning changes software.
Naveen Rao on Why Robotics Will Dwarf AI Coding 100 to 1
Naveen Rao explains why the AI inference market will reach $10 trillion and why robotics will be 100 times larger than coding agents.
Naveen Rao Says Pure Software SaaS Margins Will Collapse
Naveen Rao explains why pure software SaaS investing is in trouble as margins shift to model providers, hardware, and tech-enabled services.
More 20VC with Harry Stebbings episodes
- Who Wins in the Next Decade of VC | Margin and Price Matter Less in a World of AI | Sameer DholakiaOct 25 · 6 articles
- The New VC Game | CoreWeave Sell-Off Creates Panic | Revenue Multiples Out of ControlOct 25 · 6 articles
- The Future of Inference Market & Model Routing: Commodity or Increasing in Value? | LangChain CEOOct 18 · 3 articles
- Valar Atomics Sues Day One Ventures | Meta's Back to the AI Frontier | NVIDIA's $30B Reflection DealOct 18 · 5 articles