Devin’s 80% Moment: Background Agents, 7x PRs, & End of Hand-Held Coding — Walden Yan & Cole Murray
This episode delves into the rapid evolution of AI coding agents, highlighted by Devin's increasing autonomy and efficiency. Guests Walden Yan and Cole Murray discuss the architectural decisions for these 'background agents,' challenges in setting up developer environments, and the shift from simple 'computer use' to complex 'testing' for AI. They also explore the ongoing debate between single and multi-agent systems, the importance of memory management, and diverse real-world use cases.
- The common view of AI agent testing "overindexes" on simple 'computer use' – things like clicking a button or filling a field, which are relatively straightforward for AIs to mimic. Read →
- AI agents are already driving significant ROI: Companies are seeing savings of $1,000 to $5,000 per engineer by deploying agents for specific tasks, some even higher. Read →
- Building an AI agent requires a core architectural decision: running the agent's 'brain' either 'in-box' (within the sandbox) or 'out-of-box' (in a separate control plane). Read →
- AI agents trip on the same problem human developers do: reliably getting their code running. Cole Murray, from Cognition, calls this the “repo setup” problem, a challenge his company has faced since day one. Read →