Why Agentic AI Broke Harvey's Gross Margins
Harvey saw its gross margin collapse from positive 50% to negative 50% in June 2026 after agent token usage jumped 20-fold on frontier foundation models.
10+ hours of podcasts, in 5 minutes.
Where the money is made or lost inside a business. 11 write-ups from 8 shows so far, the newest from September 2026.
Heavy token consumption routinely breaks traditional software gross margins, pushing AI startups to train in-house models and route prompts to restore profitability. Outside of software, operators focus on tracking true customer acquisition costs to prevent automated marketing spend from eroding capital efficiency.
Reasoning agents create direct expenses from user actions. Harvey watched gross margins drop to negative 50% after token volumes jumped 20-fold. Aaron Katz asserts AI companies with fast top-line growth evade traditional software margin expectations entirely.
Companies repair unit economics by owning their infrastructure. Canva cut inference costs 90% by training in-house models, and Harvey restored positive margins using model routing. The 20VC podcast counters that routing tokens burns engineering hours better spent on distribution.
Marketing platforms double-count sales, typically reporting customer acquisition costs 20% below reality. Many middle-market executives spend $500,000 monthly without tracking returns. Meanwhile, IM8 automated its Meta targeting to scale spend to $33 million while dropping acquisition costs to $239.
At an estimated $400 million ARR run rate ($33 million monthly revenue), a negative 50% gross margin created a burn of roughly $16 million per month purely on inference costs.
From Why Agentic AI Broke Harvey's Gross Margins, TBPN · Sep 27
Canva slashed operational inference costs by 90% by acquiring Leonardo and training proprietary image generation models in-house.
From Canva Cut AI Inference Costs 90% by Ditching API Wrappers, Cheeky Pint · Aug 30
Scaling spend from $17 million to $33 million in one quarter lowered IM8's customer acquisition cost from $305 to $301, and down to $239 the following month.
From How IM8 Scaled Meta Ads to $33M a Quarter While Lowering CAC, My First Million · Sep 13
Harvey saw its gross margin collapse from positive 50% to negative 50% in June 2026 after agent token usage jumped 20-fold on frontier foundation models.
Legal tech startup Harvey watched gross margins drop from positive 50% to negative 50% in June after customer token usage jumped 20-fold.
IM8 runs between 2,000 and 3,000 Meta ads live at any given moment while testing 500 to 800 new creator assets every single week.
Hyperscale campuses require 100 megawatts or more of capacity, with build costs running from $10 million to $15 million per megawatt in the United States.
Ad platform dashboards mislead founders by double-counting sales. Meta reported customer acquisition cost (CAC) is typically 20% lower than true acquisition cost.
Startups running on frontier models have zero pricing power against foundation model suppliers who also build competing user-facing products.
Middle-market portco leadership teams often cannot connect commercial spend to revenue: McCabe points to target CEOs spending $500,000 monthly on marketing who cannot show what that budget generated.
Aaron Katz scaled ClickHouse to over $350 million in ARR by relying on the high switching costs native to core database infrastructure.
SaaS products historically scaled on near-zero marginal costs, but AI generation turns zero-dollar actions into direct expenses measured in cents per prompt.
Dr. Sara Gottfried outlines six silent vitality killers for women: poor sleep, excessive alcohol, high perceived stress, eating the wrong foods, toxic relationships/isolation, and inappropriate exercise.
Autonomous ships radically simplify design: By removing human elements (beds, galleys, latrines), Saronic eliminates a significant percentage of components, cost, and labor traditionally tied to human support systems on board. Th…
10+ hours of podcasts, distilled into one 5-minute read. Free, every Sunday morning.
One email a week. Unsubscribe with one click.