Skip to content
AI Primer
TOPIC50 stories

Cost Optimization

Reducing inference spend and improving unit economics.

RELEASE9th November
Morph launches $200 Ultra plan with unlimited Kimi and DeepSeek

Morph Ultra offers unlimited Kimi and DeepSeek for $200 a month, initially capped at 1,000 subscribers. Its operator says rate limits apply only to uncached prefill tokens.

NEWS9th November
Fable 5.2 ranks first on GDPx at 16.4%

Fable 5.2 leads GDPx at 16.4%, with gains concentrated in chip design and software engineering. SemiAnalysis reports average task costs rose 31% over Fable 5.1.

RELEASE6th November
OpenRouter Auto Code claims Opus-level coding at 74% lower cost

OpenRouter launched Auto Code, reporting Opus-level coding performance at 74% lower cost. Its routers explain decisions and adapt to model restrictions; beta reportedly cut invalid tool calls fourfold.

NEWS6th November
OpenRouter reports agents consumed 76% of October tokens

OpenRouter reports that agents consumed roughly 600T of its 790T October tokens. Agent cache hit rates exceeded 90%, while effective token prices fell 57–70% from January.

NEWS1w ago
Vals tests: four models retain at least 80% of scores at half cost or less

Vals tested seven models and found four retained at least 80% of their scores at half the cost or less. All seven scored worse overall at their lowest reasoning setting.

RELEASE1w ago
Runner-up runs GitHub Actions on self-hosted machines

Runner-up packages a self-hosted setup used for thousands of daily CI jobs, with disposable VMs for isolation. Its author estimates equivalent cloud runners would cost $5,000–$9,000 per month.

NEWS1w ago
T3 Code usage comparisons draw criticism over unmatched tasks

Theo says T3 Code's comparisons aggregate real-world usage rather than matched tasks. Critics cite prompts, effort settings, custom tools and cache handling as factors that could affect the results.

RELEASE1w ago
Dagger launches GitHub checks that run without GitHub Actions

Dagger for GitHub runs the same checks locally and after push, with results in terminals and pull requests. Dagger Cloud caches checks and bills actual usage rather than allocated machine time.

RELEASE1w ago
Droid 1.0 makes programmatic tool calling the default

Droid 1.0 batches tool calls into programs. Factory reports up to 20% better efficiency on Terminal-Bench 4 and a Linear migration task dropping from 3.1M to 61K input tokens.

RELEASE2w ago
Copilot Fusion scores 60 vs. Claude Code's 62 at half the task cost

Copilot Fusion coordinates Claude and GPT models for coding work. In a GitHub-funded Artificial Analysis test, Fusion Max cost $5.59 per task versus $11.42 for Claude Code.

RELEASE2w ago
Arena reports GPT-6.1 Terra Max median task costs of $0.40

Arena reports a $0.40 median task cost for GPT-6.1 Terra Max, 28% below its predecessor. Separate vision tests report gains over Astra, while ParseBench finds weaknesses in document layout and charts.

NEWS2w ago
Google says Gemini API spend caps take 10 minutes to take effect

Google's Logan Kilpatrick says Gemini API spend caps now have a ten-minute enforcement delay, down from more than a day. He distinguishes caps from email budget alerts and says immediate enforcement is not yet available.

NEWS2w ago
Vals reports Kimi K3.1 Pro runs Terminal-Bench 4 about 4× faster than K3

Vals reports Kimi K3.1 Pro completes Terminal-Bench 4 runs roughly four times faster than K3 at a third of the cost, but regresses on legal and tax tasks. Agent Arena places it eleventh with a $1.03 median task cost.

RELEASE2w ago
Modal releases open-source Spindle with reported 20–80% lower training costs

Modal released Spindle, which runs unchanged Tinker scripts in a Modal workspace with GPU-time billing. Modal reports 20–80% lower per-token costs when training runs share GPUs.

RELEASE2w ago
Cua Spaces adds AWS and Hetzner deployment in customer accounts

Cua Spaces added early-access deployment in customers’ AWS and Hetzner accounts. Cua reports lower sandbox costs than E2B and provides a compatibility command for existing E2B programs.

NEWS2w ago
Vals reports Mercury 3 costs $1.25 per coding task, versus $0.38 for its predecessor

Vals reports that Mercury 3 scores 60.9% on Vibe Code Bench and costs $1.25 per app, versus $0.38 for its predecessor. It also reports weak terminal results and crashes when output budgets are reached.

RELEASE3w ago
Cohere releases Rerank 5 with Context Focus passage selection

Cohere released Rerank 5 in Pro and Fast tiers, with Context Focus for selecting relevant passages. It claims up to 41% fewer downstream tokens and nearly three times Pro's throughput with Fast.

WORKFLOW3w ago
Agent log audits link unnecessary revisions to token waste, with usage falling to 12.3M

Teortaxes reports that log audits found agents repeatedly tweaking work after completion. Tests with revised Agents.md instructions reduced usage from 49M to 15.5M tokens, with a later run using 12.3M.

NEWS3w ago
Theo reports a 27% Gemini cache miss rate in an agent workload test

Theo reports a 27% Gemini cache miss rate that raised costs roughly 50% above expectations and links a reproduction. The visible exchange with Phil Schmid does not establish which endpoint was tested.

WORKFLOW4w ago
Report: Asana cuts browser-agent cost from $1.97 to $0.47 per run with prompt caching

Asana reportedly reduced its GPT-6.1 Sol browser-agent cost from $1.97 to $0.47 per run with an 89% cache hit rate. The report describes append-only prompt history and a Codex cache-measurement command.

WORKFLOW4w ago
Claude Code user finds longer subagent caching saved no money

Daniel Mac shared a script to compare Claude Code subagent cache lifetimes, then reverted to five minutes after finding no savings for his workload. He also corrected the hour-long setting from 60 to 1h.

NEWS1mo ago
SemiAnalysis reports 4–5× more API-equivalent value from Anthropic subscriptions

SemiAnalysis treats subscription plans as model-specific credits and reports 4–5× more API-equivalent value for Anthropic plans than OpenAI’s. Task-cost-adjusted comparisons still favor Claude by 1.3–2.9×.

NEWS1mo ago
GPT-6.1 Sol scores 86.3% on MathArena BrokenArXiv

GPT-6.1 Sol scored 86.3% on MathArena BrokenArXiv, 78.6% on Braintrust problem solving, and third in Code Arena WebDev. A user also reports that it outperformed its mini-SWE result in Codex.

NEWS1mo ago
ARC Prize reports lower matched-effort scores for GPT-6 Sol than GPT-5.6 Sol

ARC Prize reports lower ARC-AGI-1 and ARC-AGI-2 scores for GPT-6 Sol than GPT-5.6 Sol at matched effort. Lower prices and fewer reasoning tokens cut per-task costs by over 70%.

NEWS1mo ago
Independent tests put Sonnet 5.5 at $7.60 per max-effort task

Sonnet 5.5 ranks second on Artificial Analysis' Intelligence Index but uses about 193,000 output tokens per task at max effort. A comparison of AA Index results puts its cost at $7.60 per task.

WORKFLOW1mo ago
Astra coordinating Opus 5.5 wins one coding test on quality

Kevin Kern's single-task comparison favored Astra coordinating Opus 5.5 for quality. Solo runs were close, cost less and finished about three times faster; a rerun corrected for polling costs.

NEWS1mo ago
Independent DeepSWE test reports Jev Router nearly 5x slower than GPT-6 Astra low

An independent DeepSWE test found Jev Router roughly matched GPT-6 Astra low on results but cost slightly more and took nearly five times as long. Practitioners also argue that request-level routing misses repository context and cache costs.

WORKFLOW1mo ago
4M-parameter BERT Tiny reportedly beats Opus and Kimi after training on 10,000 examples

Experiments reported by Maxime Rivest found task-specific small classifiers outperforming frontier models on specialized decisions. One result says a 4-million-parameter BERT Tiny model beat Opus and Kimi after training on 10,000 examples.

RELEASE1mo ago
OpenRouter launches Jev Router for cache-aware model routing

OpenRouter launched Jev Router, which selects a model and reasoning effort per turn while weighing the cost of losing cached context. OpenRouter reports 237 of 423 tasks solved; invalid Jev outputs or timeouts fail without fallback.

RELEASE1mo ago
OpenAI releases GPT-6 Sol and GPT-6 Luna at roughly half GPT-5.6 API prices

OpenAI released GPT-6 Sol and GPT-6 Luna at API prices roughly half those of their GPT-5.6 predecessors. The models add controllable prompt-cache breakpoints and are rolling out in Codex and ChatGPT Work.

WORKFLOW1mo ago
Teknium reports Jev compaction can increase token costs

Teknium’s public evaluation says a Jev compaction strategy removes tool calls and eventually stops yielding savings. Repeated compaction can invalidate caches and increase total token costs, according to the critique.

WORKFLOW1mo ago
Jev cuts Stagehand's median Act latency from 1.97s to 0.46s, Stagehand says

Stagehand says adding Jev to its browser primitives cut median Act latency from 1.97 seconds to 0.46 seconds. Jev handles page-level choices and falls back to an LLM when uncertain.

NEWS1mo ago
Coding-agent harness benchmarks report about 2x completion-time spread on GPT-6 Astra

Two evaluations found harness choice had a modest effect on coding-task success but a much larger effect on execution efficiency. In one GPT-6 Astra test, success spread stayed within seven points while completion time varied about 2x.

NEWS1mo ago
MiMo reportedly streams V2.6 Pro and Flash RL training metrics

MiMo is reportedly livestreaming RL training for its V2.6 Pro and Flash models, publishing batch data, harness composition, reward curves, and infrastructure metrics. Reported cost figures list the trillion-parameter Pro run at about $493,000.

WORKFLOW1mo ago
Polylane says one agent improved quality while cutting latency and cost

Polylane says it replaced role-specific sub-agents with one main agent and improved quality while reducing latency and cost. The report is a practitioner case study, not a general benchmark.

RELEASE2mo ago
Cognition launched Devin Fusion to cut coding-agent costs

Fusion keeps a lead model in control while routing execution to a cheaper model in Devin CLI. Cognition reported 39% lower benchmark cost, and Artificial Analysis measured 43% lower cost with 31% faster runs at near-frontier scores.

RELEASE2mo ago
Cognition releases SWE-2 with lower FrontierCode costs

Cognition says its SWE-2 coding model scored 50.0% on FrontierCode 1.1 Main, matching Fable 5.1 at 64% lower cost. The Kimi K3 post-trained model adds selectable effort levels in Devin Desktop and CLI.

NEWS2mo ago
Artificial Analysis reports GPT-6 Astra matches Fable 5 coding at under half the cost

Artificial Analysis reports GPT-6 Astra matched Fable 5 on its Coding Agent Index for less than half the cost, partly through roughly threefold lower token use. Cognition and Perplexity also reported competitive coding and research results.

RELEASE2mo ago
Cohere releases Parse 5 with 79.2 ParseBench score

Cohere released Parse 5, a document parser that returns machine-readable text, tables, forms, images, and bounding boxes. Cohere reports a 79.2 ParseBench score and prices it at $1.50 per 1,000 pages.

NEWS2mo ago
Glean says runtime routing cuts enterprise-agent token costs by 81%

Glean says its runtime routes enterprise-agent work across more than 40 models using company context. It reports $0.58 per query and 78% user preference over Claude Cowork in a 180-person benchmark.

NEWS2mo ago
Together reports GLM-5.3 solves 87.6% of DeepSWE work for about $16

Together reports GLM-5.3 solved 87.6% of DeepSWE after four attempts for about $16, versus Fable 5 at 69.7% for $21.63. It estimates equal $100 budgets yield roughly 17 solved tasks for GLM-5.3 and three for Fable 5.

NEWS2mo ago
Study finds CLI-first agents cost 5–28x less than MCP agents

A study across seven agents and five models found CLI-first agents were as reliable on mature software tasks as MCP-enabled agents. The CLI setups cost 5–28 times less in the reported experiments.

NEWS2mo ago
OpenAI cuts GPT-5.6 Sol API rates to $4 input and $20 output

OpenAI cut GPT-5.6 Sol API input and output rates from $5 and $30 to $4 and $20 per million tokens for three months. Subscription usage remains unchanged.

NEWS2mo ago
ARC Prize verifies Gemini 3.7 Flash at 84.6% on ARC-AGI-2

ARC Prize verified Gemini 3.7 Flash at 84.6% on ARC-AGI-2, at a reported $0.25 per task. Artificial Analysis’ AnalystAgent benchmark placed it at 60%, ahead of Claude Opus 5 and GPT-5.5.

NEWS2mo ago
OpenCode Go revises limits after DeepSeek price increase

OpenCode says it revised Go limits after DeepSeek raised prices. Its operator is testing hosting configurations intended to bring DeepSeek service closer to its prior price point.

NEWS3mo ago
Composio and Ante benchmark coding agent harnesses with 47%–67% success range

Composio and Ante tests reported that the same models behaved very differently by harness. DeepSeek V4 Flash ranged from 47% to 67% task success and $0.019 to $0.104 per task across harnesses.

RELEASE3mo ago
OpenRouter updates Auto Router with 30 task types and 7-day spend-based routing

OpenRouter upgraded Auto Router to classify prompts into about 30 task types, then route by anonymized 7-day spend share and cost tier. OpenRouter says the max tier beat the old router across five benchmark domains.

NEWS3mo ago
Microsoft Copilot traces report 87% of LLM calls came from agents

A Microsoft Copilot trace analysis said 87% of LLM calls came from the agent, not direct user turns. Related posts warned token use and web requests can scale far faster than human prompt counts.

NEWS3mo ago
OpenCode users reportedly average $1.14/day on DeepSeek V4 Flash

OpenCode’s thdxr said Go users spent $1.14 per day on DeepSeek V4 Flash last week. Wafer added a fast OpenRouter route, while Nous extended a 90% discount for the 0731 model.

NEWS3mo ago
DeepSeek V4 Flash benchmarks claim lower DeepSWE cost than GPT-5.6 Luna

Together says two V4 Flash attempts solved more DeepSWE tasks than one GPT-5.6 Luna attempt for roughly one-third the cost. Practitioners report Flash-0731 results vary sharply by harness and pass count.

AI PrimerAI Primer

Your daily guide to AI tools, workflows, and creative inspiration.

© 2026 AI Primer. All rights reserved.