Evals: how often the top podcasts talk about it.
Evals came up in 5 of 106 episodes (5%) in the four weeks to Oct 4, about the same share as in the earlier weeks (5%).
Share of episodes, four weeks at a time
The 5 episodes behind the newest bar
- Roles aren't converging—they're expanding | Tamar Yehoshua (Atlassian CPO)Lenny's Podcast · week ending Oct 4 · said it 3 times
- Where AI products go next: voice, agents, and self-driving software | Tara Sesha and Nan…Lenny's Podcast · week ending Oct 4 · said it 3 times
- The Future of Claude Code: Mods, Mutable Software, & Multiplayer Agents — Thariq Shihipar…Latent Space · week ending Oct 4 · said it 4 times
- The $10 Trillion Token Economy — Alex Atallah, OpenRouter & Anjney Midha, AMPLatent Space · week ending Sep 27 · said it twice
- Opus 5.5 is great (but GPT-6 Sol is better)How I AI · week ending Sep 27 · said it twice
Earliest mentions in our archive
The first episode from each show that said it, oldest first. The matched words are marked.
“…is useful but not everyone loves doing is building evals. You don't need to build hundreds of evals for them to be…”
How Anthropic’s product team moves faster than anyone else | Cat Wu (Head of Product, Cla…
“…transcripts what about evals how in the world do you like this is such a complex product…”
Inside Abridge: The AI Listening to 100 Million Doctor Visits — Abridge's Janie Lee & Cha…
“…they did was they created a test bench and a set of evals to be a financial analyst essentially and tested all of…”
Anthropic's Digital God, Pope vs AI, Job Loss Narrative Flips, Open Source Crackdown Comi…
“…that we can do is create really hard evals. And if you create the right tests and success criteria for a model, then…”
How this startup uses AI agents to eliminate bugs and optimize infrastructure
“…that issue? The fact that some of the evals that you would want to run are both beyond the scope of budget or time…”
Why Traditional Benchmarks Fail Modern AI Models with OpenAI Research Scientist Noam Brown
“…and our customers will log in to see their data and run evals. So, annotation platform called studio marketplace, call…”
Mercor Head of Product on Revenue Concentration from Frontier Labs
Most recent mentions
The newest episodes that count toward the chart, no more than two from one show.
“Sometimes the PMs do eval, sometimes the engineers do evals. Well, in this instance, the evals for something like…”
Roles aren't converging—they're expanding | Tamar Yehoshua (Atlassian CPO)
“…the model not do what it needed to do. If I can write evals that is like I'm there like learning how to write good…”
Where AI products go next: voice, agents, and self-driving software | Tara Sesha and Nan…
“…as well. He has evals. Yeah. Yeah. So what I did in the blog…”
The Future of Claude Code: Mods, Mutable Software, & Multiplayer Agents — Thariq Shihipar…
“…see. I then uh do blind evals of these. So I run these against different models. So I've…”
“The AIs will be able to do some online training based on real-world stuff. They'll be able to have evals. They'll be able to sample that. You can scale up the cadence at which you do this. The second thing is that in practice,…”
Ryan Greenblatt – What happens once AI can automate AI research?
Which shows say it
| Show | Last four weeks | All weeks counted |
|---|---|---|
| Latent Space | 2 | 11 |
| Lenny's Podcast | 2 | 5 |
| How I AI | 1 | 2 |
| 20VC with Harry Stebbings | 0 | 1 |
| All-In Podcast | 0 | 1 |
| Dwarkesh Podcast | 0 | 1 |
| No Priors | 0 | 1 |
More trends
Episodes in the newest four weeks:
How we count. An episode counts when its transcript says “evals” at least twice; plurals count too. We count a shortened re-upload of an episode we already have only once, and we skip the sponsor reads and show promos we can spot. A model marks them in every transcript and our code checks each mark against the words; we also skip the lines around phrases like “brought to you by” and any passage a show reads word for word in three or more episodes. The share is the counted episodes divided by all episodes from the tech, business and science shows we cover in the same four weeks, so a busy month of releases does not raise it by itself. The mix of shows does change from month to month, and one daily show can move a number. Weeks run Monday to Sunday, and the week in progress is left out until it ends. The chart starts with the week of April 20, 2026, when our archive became steady. A few older episodes can still appear under the earliest mentions, and some weeks have gaps. Transcripts are automatic captions, so we also match the spellings they use. The counts cover only the shows we summarize. Download the counts (JSON) or CSV.