4 November 2026

Open model providers report near-exponential growth in tokens served

First reported

Interconnects ran this on .

  • Newsletter Interconnects tracked public disclosures from Baseten, Fireworks and Together AI, companies that run open AI models for customers.
  • Token volume means the chunks of text an AI model reads and writes, and these providers' totals are growing close to exponentially.
  • The growth steepened after GLM 5.2, a model from the Chinese lab Zhipu, sparked a jump in open AI agents, programs that complete multi-step tasks on their own.

How it was covered

InterconnectsNathan Lambert

Token volume disclosures from open model inference startups, growth trends, GLM 5.2, and Fireworks' conference figures