Why Frontier LLMs Fail at Human Simulation: Park on Irrationality
Joon Sung Park explains why rational LLMs fail at human simulation, dropping to 20% accuracy compared to Simile AI's 85% fidelity digital twins.
40 hours of podcasts, in 5 minutes.
Joon Sung Park, co-founder and CEO of Simile AI and lead author of the landmark Generative Agents ('Smallville') paper, details his journey from artist to Stanford PhD researcher building foundation models of human behavior. He explains how Simile creates digital twins using deep interviews, observational transaction data, and randomized controlled trials to simulate human decision-making and social physics at 85% fidelity. The conversation covers the difference between predicting and shaping the future, why frontier LLMs fail at behavioral nuance, and the long-term vision of simulating all 8 billion people to address complex societal coordination challenges like climate change.
Joon Sung Park explains why rational LLMs fail at human simulation, dropping to 20% accuracy compared to Simile AI's 85% fidelity digital twins.
Joon Sung Park on why frontier LLMs fail at social physics, how Simile hits 85% fidelity, and why Smallville ran on markdown files.
Joon Sung Park explains how Simile AI builds digital twins from real human data to test UI mockups and predict behavior.
Joon Sung Park reveals how Simile AI builds 85% fidelity digital twins to solve planetary coordination problems with simulation scaling laws.
Joon Sung Park explains how generative agent simulations turn Asimov's psychohistory into tools for testing economic and product rollouts.