The best ideas from 30+ top podcasts, every week.
9 quotes from 2 episodes on 20VC with Harry Stebbings and Latent Space, each with a timestamped link to the source.
Erik Bernhardsson expects specialized inference across focused open-source AI models to generate high commercial value. Enterprise buyers require the ability to fine-tune parameters for specific latency and throughput goals.
Open-source AI creators are shifting toward commercial licensing structures.
“Let's also remember the open-source models, they're all moving into licensing models…”
From Erik Bernhardsson Says Open-Source AI Inference Has Not Peaked
Early cloud storage setups allowed users to accidentally expose private files to the public.
“S3 used to be very easy to accidentally make public…”
From Erik Bernhardsson: Agent Sandboxes Need Stricter Default Limits
Treating the market as a fixed pie ignores the ongoing demand for fine-tuning. Enterprise buyers want to adjust specific parameters for low latency and high throughput.
“I think that's a little bit of a fixed pie size mentality…”
From Erik Bernhardsson Says Open-Source AI Inference Has Not Peaked
“There's always going to be people who want to fine-tune, want to have more control over their models, and sort of tweak the parameters, like go low latency, high throughput…”
From Erik Bernhardsson Says Open-Source AI Inference Has Not Peaked
Attackers compromised a customer application hosted on Modal to access Hugging Face. Cloud platforms remain secure during isolated breaches of individual software applications.
“The agents running inside that exploited Hugging Face, they discovered a vulnerability in an app that was deployed on Modal, and they used that almost like a springboard for getting full internet access.”
From Erik Bernhardsson: Agent Sandboxes Need Stricter Default Limits
“This is an app running on Modal that was hacked. It was not Modal that was hacked. AWS, a lot of people run stuff on AWS. Occasionally those apps get hacked. Does that mean AWS got hacked? No, of course not.”
From Erik Bernhardsson: Agent Sandboxes Need Stricter Default Limits
Engineering groups deploy autonomous AI agents to actively hunt for software vulnerabilities. Continuous internal tests challenge system boundaries and uncover potential escalation paths.
“We started using agents internally quite a lot to try to find vulnerabilities…”
From Erik Bernhardsson: Agent Sandboxes Need Stricter Default Limits
“My view on cybersecurity is that they're very good at finding vulnerabilities, but I think you can also use them defensively very well.”
From Erik Bernhardsson: Agent Sandboxes Need Stricter Default Limits
“I think there is an opportunity to create a hundred billion dollar company with a lot of specialized models in inference.”
From Erik Bernhardsson Says Open-Source AI Inference Has Not Peaked
How we attribute quotes. Every quote was matched against the episode transcript, so the words and the timestamp are real (we trim filler words like "um", nothing else). The name comes from our written summary of the episode, and we use it only when a separate check of the captions finds that person on the episode. YouTube gives us no voice-by-voice transcript, so open the timestamp to hear who is talking. See a wrong name? Tell us and we fix or remove it.
The week's best AI, tech, business, science, and culture podcasts in one short read. Free, every Sunday.
You get both newsletters, The Throughline and The Carry. No spam. Unsubscribe with one click.