Issue No. 35Week ending Sunday, August 30, 2026398 episodes ยท 1589 articles
The Throughline โ†“
The Podcast Summary.

40 hours of podcasts, in 5 minutes.

AILatent Space

๐Ÿ”ฌ Why Transformers Hit a Wall the Moment Physics Shows Up โ€” Anima Anandkumar, Caltech

With Anima Anandkumar, Brandon, R.J. Honiki ยท Sunday, August 30, 2026

Caltech professor and former NVIDIA AI research leader Anima Anandkumar discusses why traditional deep learning and transformers fail when applied to complex physical systems due to extreme resolution requirements and scarce data. She explains how neural operators and Fourier architectures solve these bottlenecks by modeling continuous function spaces, enabling FourCastNet to deliver accurate global weather and climate forecasts thousands of times faster on a single GPU. Anandkumar also discusses formal verification with TorchLean, multiphysics foundation models for nuclear fusion and chip design, and why scientific AI requires distinct regulatory treatment from language models.