Chamath's Token Math: Costs Doubling Every 45 Days, Productivity Up 5%

In this All-In Podcast clip, Chamath Palihapitiya recounts a conversation with his CTO about AI token spend. The numbers he shares: token costs at his company are doubling every 45 days while downstream productivity is up maybe 5%. Costs compounding, upside flat.

His CTO's explanation is the interesting part. It now takes far more tokens to reach each next increment of improvement because the gains have "effectively already asymptoted." Chamath argues this reckoning is coming for every company within three or four years, and that the smart move for AI companies is to cash out before the market catches on. The uploader frames the clip around Anthropic's upcoming IPO.

The Conversation With His CTO

Chamath structures the clip as a back-and-forth with his CTO. He asks how they are doing on token spend and gets the answer that costs are doubling every 45 days. He then asks about downstream productivity and gets "maybe 5% max." He restates the problem plainly: "my costs are doubling every 45 days, my upside is essentially flat." The CTO confirms.

The clip is a talking-head segment from the podcast, with the TikTok caption pinned at the top restating the core stat. On-screen captions track the dialogue word by word.

Why the Spend Stopped Paying Off

When Chamath asks why, the CTO's answer is diminishing returns: "you need to use a lot more tokens to get to this next iteration of improvement because we've effectively already asymptoted." Each marginal gain now costs more than the last. Asked what to do about it, the CTO has no fix: "honestly, we have to figure this out." The company is stepping back to rethink its approach.

The Reckoning and the Exit Window

Chamath doubts many companies have gone through this reckoning yet, but predicts everyone will within the next three or four years. That timing drives his closing advice, aimed at AI companies sitting on high valuations: "if you can get out now, you should get out now before all of that starts to seep into the water table." Getting out early, in his view, is what lets a company exit at a huge price and raise a huge amount of money. The uploader's caption ties this directly to Anthropic's upcoming IPO, though Chamath does not name Anthropic in the clip itself.

Key Takeaways

• Chamath says his company's AI token costs are doubling every 45 days while measured productivity gains sit around 5%.
• His CTO attributes the gap to diminishing returns: each new increment of improvement requires far more tokens because gains have asymptoted.
• The company has no answer yet and is stepping back to rethink its AI spend.
• Chamath predicts every company will hit this same reckoning within three or four years.
• His conclusion for AI companies: exit now, before the cost-versus-productivity problem becomes common knowledge and compresses valuations.

Resources

• All-In Podcast -- the source of the clip, credited by the uploader as @the all-in podcast