Skip to content
AI Primer
release

Moonshot launches Kimi K3 with 2.8T parameters and 1M context

Moonshot launched Kimi K3 in Kimi products and API with 1M context, native multimodality, KDA/AttnRes, and weights promised by July 27. Benchmarks place it near frontier systems, but testers cite slow serving and usability caveats.

9 min read
Moonshot launches Kimi K3 with 2.8T parameters and 1M context
Moonshot launches Kimi K3 with 2.8T parameters and 1M context

TL;DR

Moonshot's official tech blog buries some of the fun stuff after the headline specs: K3 built a MiniTriton compiler, designed a 4 mm² chip in a 48-hour autonomous run, and reproduced an astrophysics workflow after reading 20+ papers. Simon Willison's pelican writeup found one tiny SVG prompt using 13,241 reasoning tokens, which is a useful smell test for the model's verbosity. The same official blog says Moonshot recommends 64 or more accelerators for efficient deployment, so "open weights" here means frontier-scale availability, not hobbyist local inference.

What shipped

  • Model: Kimi K3, a 2.8T-parameter model with 1M context and native multimodal input, according to Kimi_Moonshot's launch thread.
  • Surfaces: Kimi.com, Kimi Work, Kimi Code, and Kimi API, per the official tech blog.
  • Weights: full model weights are promised by July 27, 2026, according to Kimi_Moonshot's launch thread.
  • API price: $3.00 per 1M cache-miss input tokens, $0.30 per 1M cache-hit input tokens, and $15.00 per 1M output tokens, per the official availability section.
  • Reasoning mode: max thinking effort is the launch default, with low and high modes coming later, according to the official tech blog.
  • Model ID: OpenRouter listed moonshotai/kimi-k3 with text and image input, text output, 1M context, and $3/$15 pricing in scaling01's OpenRouter screenshot.
  • Unresolved from official sources: Moonshot did not publish the full technical report, active parameter count, or final weight license in the launch post, only the July 27 weight-release date.

Benchmarks that moved

First-party

Third-party evaluators

Customer-reported

  • Next.js Agent Performance: Claude Fable 5 high 92% → Kimi K3 92%, +0 points, while average duration moved from 233.93s to 199.89s, -34.04 seconds, in Guillermo Rauch's Next.js benchmark.
  • Atomic Chat retro games: Claude Opus 4.8 $0.54 → Kimi K3 $0.28, -$0.26, while output moved from 21.3K to 18.4K tokens, -2.9K tokens, in Rohan Paul's Atomic Chat test.

Where it regressed

Moonshot's own limitation section is the cleanest caveat: K3 trails Claude Fable 5 and GPT-5.6 Sol in user experience, according to Moonshot's limitation screenshot. The same section says quality can become unstable if the harness does not pass back preserved thinking history.

Under the hood

K3's architecture story is not just parameter count. Moonshot combined attention changes, extreme MoE sparsity, and serving work to make a 2.8T model plausible on the API.

  • KDA and AttnRes: Kimi_Moonshot's architecture post says Kimi Delta Attention and Attention Residuals improve information flow across sequence length and model depth.
  • Sparse MoE: K3 activates 16 of 896 experts under Stable LatentMoE, according to Kimi_Moonshot's architecture post.
  • Scaling efficiency: the same post claims roughly 2.5x overall scaling efficiency over K2.
  • Training details: the official tech blog names Quantile Balancing, Per-Head Muon, SiTU, Gated MLA, MXFP4 weights, and MXFP8 activations.
  • Serving topology: teortaxesTex's deployment excerpt quotes Moonshot recommending supernodes with 64 or more accelerators.
  • Prefix caching: vLLM's note says Moonshot contributed a KDA prefix-caching implementation because KDA breaks assumptions behind conventional prefix caching.
  • Thinking history: Moonshot's limitation screenshot says K3 was trained with preserved thinking history, making mid-session model switches risky.

Contested claims

Claim: K3 is basically Fable/Sol class. Cited by: scaling01's benchmark count said K3 beat GPT-5.6 Sol on 11 of 14 official benchmarks and Opus 4.8 on all 14. Counter: Moonshot's limitation screenshot says K3 still has a noticeable UX gap versus Fable 5 and GPT-5.6 Sol. Evidence so far: Artificial Analysis's breakdown places K3 at 57, behind Fable 5 and GPT-5.6 Sol.

Claim: K3 proves China is only a few months behind the frontier. Cited by: kimmonismus's DeepSeek 2.0 framing argued K3 beats Opus 4.8 and narrows the US lead. Counter: Ryan Greenblatt's correction says quick tests put the K3 pretrain around halfway between Opus 4 and Opus 4.5, roughly 10 months behind Anthropic on pretraining. Evidence so far: the official launch table shows strong coding and agentic scores, while the full technical report is still unpublished.

Claim: K3's ProgramBench lead is decisive. Cited by: Kimi's official benchmark table lists K3 at 77.8, ahead of Fable 5 and GPT-5.6 Sol. Counter: Ofir Press said the metric Moonshot used can be misleading because it rewards partial implementations rather than fully working programs. Evidence so far: Moonshot's score is real for the published metric, but the benchmark maintainer disputes the metric choice.

Vibe Check

Hands-on reports converged on a model that is unusually strong at visual coding and long reviews, but often slow, verbose, and weirdly proactive.

  • nrehiew_'s first impressions found strong multi-hop understanding, unusually detailed self-checks, good design, weaker taste than Claude, and slow platform behavior.
  • nrehiew_'s SVG follow-up called the zero-shot output close to Opus for style, diagrams, and content, with verbosity and speed as the main negatives.
  • doodlestein's FrankenGraphDB follow-up said Fable's meta-review found K3's plan review substantially correct, with the two most severe findings understated.
  • doodlestein's clarification said K3 was not as good as Fable or Sol, but different enough in architecture, data, training, and attention mechanism to catch issues those models missed.
  • Ethan Mollick's murder-mystery test said K3 still failed at satisfying murder mystery writing, where clues were too obvious or too obscure.
  • Theo's 3D testing reply said K3 was far ahead of Fable and GPT-5.6 in limited Three.js modeling tests.

Where it shows up

What the release signals

  • LocalLLaMA users are split on whether huge open weights still count as local: one LocalLLaMA thread says massive open-weight drops feel like API marketing for normal rigs, while another LocalLLaMA thread discusses 1TB DDR3 servers and Q2 quantization plans for K3.
  • The Chinese lab ecosystem is commercial, not just benchmark theater: Deedy Das's revenue map put five pure-play Chinese AI labs at a combined $2.6B revenue run rate, with Moonshot listed at $200M and a rumored $30B valuation.
  • Policy questions moved from hypothetical to release-process concrete: Ethan Mollick's vetting question asked how open-weight pre-clearance works when models approach Mythos/Sol-class capabilities, since weights cannot be recalled after release.

Further reading

Discussion across the web

Where this story is being discussed, in original context.

On X· 9 threads
TL;DR3 posts
What shipped1 post
Benchmarks that moved5 posts
Where it regressed6 posts
Under the hood4 posts
Contested claims4 posts
Vibe Check5 posts
Where it shows up6 posts
What the release signals2 posts
Share on X