Inference Economics — June 6, 2026

The read

Token price is the new kWh. Jevons says falling cost drives more loops, deeper reasoning, and heavier agents — not smaller bills. Track pricing, routing, and caching moves that change what builders can afford to run.

What moved

• DigitalOcean Inference Gateway ships prefix-aware routing with 75%+ cache hit rates — DigitalOcean Blog DigitalOcean’s Inference Gateway (June 2, 2026) routes requests to vLLM pods most likely to hold matching KV-cache prefix blocks, using sha256_cbor_64bit block hashes and combined prefix-cache plus GPU-utilization scorers. On shared-prefix workloads, cache hit rates rise from roughly 25% under round-robin to 75%+, cutting effective compute cost by up to 4x on identical hardware; prefix caching with cached-token pricing is rolling out to Serverless Inference in coming weeks. Builder angle: Multi-replica inference fleets can cut redundant prefill spend by routing to cache-warm pods instead of adding GPUs—especially for agent loops with fixed system prompts.

• GitHub Copilot switches all plans to usage-based AI Credits billing — GitHub Changelog As of June 1, 2026, all Copilot plans bill by GitHub AI Credits consumed (each credit equals $0.01 of value) instead of premium request units. Included monthly allowances are 1,500 credits on Pro ($10), 7,000 on Pro+ ($39), and 20,000 on Max ($100); overages require an additional spending budget. Copilot code review now also consumes GitHub Actions minutes alongside AI Credits. Builder angle: Copilot cost is now token-metered like API inference—agentic and review-heavy workflows need credit budgets and plan-tier math before defaulting to premium models.

• DeepSeek makes V4 Pro 75% API price cut permanent at $0.87 per million output tokens — The Next Web DeepSeek locked in a promotional 75% discount on V4 Pro API pricing after a May 31 expiry date, setting permanent rates from $0.003625 to $0.87 per million tokens (down from $0.0145 to $3.48). The model supports a 1M-token context window at the lower price, undercutting GPT-5, Claude Opus 4.7, and Gemini Flash tiers on per-token output cost. Builder angle: Long-context and high-volume workloads have a materially cheaper frontier-tier option—builders should model routing simple tasks to DeepSeek while weighing compliance and latency tradeoffs.

Also tracking

• Cloudflare AI Gateway adds dollar-based spend limits — source — Cost budgets scoped by model, provider, or metadata can block requests once cumulative token spend is exceeded—useful for capping runaway agent loops without per-request rate limits.
• GitHub Copilot adds 1M-token context and configurable reasoning levels — source — Larger context and higher reasoning explicitly consume more AI Credits per interaction under the new billing model.