Issue No. 46Week ending Sunday, November 15, 2026844 episodes · 3,675 write-ups
The Podcast Summary.

The best ideas from 30+ top podcasts, every week.

Trend Steady

What the top podcasts are saying about Evals.

Evals came up in 10 of 158 episodes (6%) in the four weeks to Nov 15, about the same share as in the earlier weeks (6%).

10 of 158episodes, four weeks to Nov 15

Share of episodes, four weeks at a time

3%May 31 of 366%May 313 of 5210%Jun 287 of 717%Jul 264 of 584%Aug 232 of 530%Sep 200 of 708%Oct 1811 of 1386%Nov 1510 of 158
Share of episodes from the tech, business and science shows we cover that said “evals” at least twice, in blocks of four weeks. Each label is the block's last Sunday. The newest block is the orange bar on the right.
The 10 episodes behind the newest bar

What the shows said about Evals

Key takeaways from our write-ups that name it, newest first, no more than two from one show. Each links to the full write-up.

Earliest mentions in our archive

The first episode from each show that said it, oldest first. The matched words are marked.

“…is useful but not everyone loves doing is building evals. You don't need to build hundreds of evals for them to be…”

Lenny's Podcast · week ending Apr 19 · Watch at 55:09 ↗

How Anthropic’s product team moves faster than anyone else | Cat Wu (Head of Product, Cla…

“…transcripts what about evals how in the world do you like this is such a complex product…”

Latent Space · week ending May 17 · Watch at 31:58 ↗

Inside Abridge: The AI Listening to 100 Million Doctor Visits — Abridge's Janie Lee & Cha…

“…they did was they created a test bench and a set of evals to be a financial analyst essentially and tested all of…”

All-In Podcast · week ending May 31 · Watch at 41:39 ↗

Anthropic's Digital God, Pope vs AI, Job Loss Narrative Flips, Open Source Crackdown Comi…

“…that we can do is create really hard evals. And if you create the right tests and success criteria for a model, then…”

How I AI · week ending Jun 21 · Watch at 0:48 ↗

How this startup uses AI agents to eliminate bugs and optimize infrastructure

“…that issue? The fact that some of the evals that you would want to run are both beyond the scope of budget or time…”

No Priors · week ending Jun 28 · Watch at 4:34 ↗

Why Traditional Benchmarks Fail Modern AI Models with OpenAI Research Scientist Noam Brown

“…and our customers will log in to see their data and run evals. So, annotation platform called studio marketplace, call…”

20VC with Harry Stebbings · week ending Jul 26 · Watch at 28:58 ↗

Mercor Head of Product on Revenue Concentration from Frontier Labs

Most recent mentions

The newest episodes that count toward the chart, no more than two from one show.

“…it was a complete surprise and so then we were like wait like all of our evals have been over here. We actually need to…”

Lenny's Podcast · week ending Nov 15 · Watch at 32:44 ↗

Meta’s Muse: How we launched the most successful consumer product this year | Mona Sarant…

“…about some of the real nitty-gritty of evals and data sets that you have. Um I just want to introduce Garrett Nishan…”

Latent Space · week ending Nov 15 · Watch at 0:48 ↗

What Frontier Labs Buy: A Data Deep Dive with Handshake AI — Garrett Lord & Team

“…can catch problems, escalate to a person, constrain answers when something you know, and then recover when something gets through anyways. And then evals are repeatable tests. Evals are really important and they're not talked about as much as they should be, because they are determined whether…”

Practical AI · week ending Nov 1 · Listen at 6:38 ↗

Abundant Intelligence at the Midwest AI Summit

“…weights. It can be in context. It can be in your evals, right? You may have a benchmark. In fact, one of the things…”

20VC with Harry Stebbings · week ending Nov 1 · Watch at 10:50 ↗

Satya Nadella: Whether to Trust Frontier Models | Why Companies Need to Own Their Own Int…

“…example. Like how can I make sure Resend is easy for Python as well as for JavaScript developers, as well as for Ruby developers. So then we have evals for for different platforms. And then we try to see where do agents get stuck? Oh, is it Do they get stuck here, or there? How we can make sure…”

The Changelog · week ending Oct 25 · Listen at 1:25:42 ↗

Building what's next (Interview)

Which shows say it

ShowLast four weeksAll weeks counted
Latent Space518
Lenny's Podcast27
20VC with Harry Stebbings15
Practical AI11
The Changelog11
How I AI02
All-In Podcast01
Cheeky Pint01
Dwarkesh Podcast01
No Priors01

More trends

Episodes in the newest four weeks:

How we count. An episode counts when its transcript says “evals” at least twice; plurals count too. We count a shortened re-upload of an episode we already have only once, and we skip the sponsor reads and show promos we can spot. A model marks them in every transcript and our code checks each mark against the words; we also skip the lines around phrases like “brought to you by” and any passage a show reads word for word in three or more episodes. The share is the counted episodes divided by all episodes from the tech, business and science shows we cover in the same four weeks, so a busy month of releases does not raise it by itself. The mix of shows does change from month to month, and one daily show can move a number. Weeks run Monday to Sunday, and the week in progress is left out until it ends. The chart starts with the week of April 6, 2026, when our archive became steady. A few older episodes can still appear under the earliest mentions, and some weeks have gaps. Transcripts are automatic captions, so we also match the spellings they use. The counts cover only the shows we summarize. Download the counts (JSON) or CSV.

The Sunday Email

Get next Sunday's issue in your inbox.

The week's best AI, tech, business, science, and culture podcasts in one short read. Free, every Sunday.

You get both newsletters, The Throughline and The Carry. No spam. Unsubscribe with one click.