Global AI Compute and Token Economics: The Inference Era

The center of gravity in AI compute has shifted from training to inference. Deloitte's TMT Predictions 2026 estimates inference at roughly two-thirds of global AI compute in 2026, versus about one-third in 2023 and half in 2025. Goldman Sachs' May report "Decoding the Agentic Economy" draws a steeper curve: monthly token consumption reaching 120 quadrillion by 2030, a 24x increase, with consumer agents contributing 12x growth by 2030 and enterprise agents 55x by 2040. The driver is the always-on nature of agents: on OpenRouter, agentic token flow surpassed direct human usage around early February 2026, and a single agent request consumes roughly 15x the tokens of a human chat. Parallel to surging volume is collapsing unit price — per-token inference costs are falling 60-70% per year at the silicon level, and the price war in the last week of July (Opus 5 at $5/$25, GPT-5.6 Luna cut 80%, DeepSeek V4-Flash at $0.14/$0.28) compressed price cuts from an annual event into a weekly one. This volume-price scissors is the through-line of our value-chain analysis.

Kimi K3 (a 2.8-trillion-parameter MoE with a 1M-token context), released July 16, honored its open-source pledge on July 26 — dropping weights a day ahead of the promised July 27 — becoming the largest open-weight model in history, with day-0 hosting from Together AI and Modal. Share data also set records: Chinese models took 58% of OpenRouter token share in July (briefly touching 63% in the first week), holding all top-five spots by usage — Xiaomi's MiMo-V2.5 first, followed by DeepSeek, MiniMax, Qwen and Kimi — versus under 10% share in early 2025. Price is the core driver: open Chinese models run 60-90% cheaper than leading closed US APIs, and in agentic workloads where usage is amplified 15x, the unit-price gap is amplified by the same factor. Capital followed: Bloomberg reported July 29 that Moonshot closed a $3.5B round at a $35B post-money valuation — far above its initial $1-2B target — and plans a pre-IPO round in August at up to $50B ahead of a Hong Kong listing. Open weights have turned from a technical gesture into a valuation engine.

The bottleneck in compute is shifting from chips to power, and July's developments made this thread more concrete. xAI's $1B+ acquisition of mobile-generation firm APR Energy (1GW+ of gas turbines) to power the Memphis Colossus supercomputer has won final clearance; but environmental and compliance risks are rising in parallel: the NAACP and environmental groups filed a Clean Air Act lawsuit over up to 35 allegedly unpermitted gas turbines (allegations pending in court, not accepted by xAI), and TechCrunch reported July 31 that SpaceX will not remove all related turbines for another year. The other face of the power constraint is capex: Alphabet's July 22 report showed Q2 capex of $44.9B, full-year guidance raised to $195-205B, and quarterly free cash flow turning negative at -$5.9B — the stock fell about 5% the next day; Meta raised full-year capex guidance to $130-145B on July 29 with its stock also under pressure; Microsoft's AI business within Azure hit a $37B annualized run rate, up 123% YoY. The four hyperscalers plan roughly $725B of combined 2026 capex, up ~77% from ~$410B in 2025 — 'power is compute' is turning from slogan into a hard line item on income and cash-flow statements.