Skip to content
AI Primer
breaking

Anthropic's Mythos 5.2 system card discloses deliberate limits on AI R&D capabilities

Mythos 5.2's system card says training deliberately limited capabilities that could accelerate AI development. It also says METR evaluated a snapshot stronger at AI R&D than the released model.

4 min read
Anthropic's Mythos 5.2 system card discloses deliberate limits on AI R&D capabilities
Anthropic's Mythos 5.2 system card discloses deliberate limits on AI R&D capabilities

TL;DR

  • Anthropic deliberately limited gains in accelerator kernel optimization and LLM architecture improvement during training, holding performance around Opus 5.5, according to its safeguards disclosure.
  • METR evaluated a stronger, unreleased snapshot. In the follow-up thread, Anthropic explicitly warns that those results may overstate the released model’s capabilities.
  • Independent testing shows the same uneven profile: SemiAnalysis reports software engineering gains alongside RSI performance roughly matching Sonnet 5.5.

Some of the system card’s AI R&D scores come from the strongest checkpoint, while its limitations are collected across multiple snapshots. Anthropic’s launch announcement also describes a separate mechanism: blocked Fable cybersecurity and biology requests receive answers from older Opus models.

Training limits on kernels and LLM architectures

Anthropic released Fable 5.2 and Mythos 5.2 on November 9. They share an underlying model, and the training restrictions apply to both configurations.

Held around Opus 5.5 performance:

  • Accelerator kernel optimization.
  • Improving large language model architectures.

Preserved, according to Anthropic:

  • Agentic coding.
  • Hardware development.
  • Traditional AI and machine learning research, including interpretability.

Anthropic says the restrictions were introduced during training and that it does not alter these capabilities while serving the model.

METR’s stronger snapshot

The sharpest disclosure sits on page 39: METR’s testing used a Mythos 5.2 snapshot that was “stronger on AI R&D capabilities than the released model.”

Anthropic explains in the system card’s AI R&D section that it evaluates the capability ceiling across snapshots. Its Anthropic Epoch Capabilities Index (AECI) score comes from the snapshot judged strongest overall at AI R&D; reported limitations span multiple checkpoints, including the release snapshot.

METR calls the evaluated checkpoint “Model 3 Early”, the identifier that deredleritt3r initially associated with the public release. The page 39 caveat establishes that the evaluated snapshot exceeded the release on AI R&D.

In a subsequent reply, deredleritt3r characterized the disclosure as Anthropic formally separating its public models from internal models with AI R&D capabilities.

GDPx’s AI research plateau

Fable 5.2 topped GDPx at 16.4%, according to SemiAnalysis, which reported these domain results:

  • Chip design: 10.8% improvement over Opus 5.5.
  • Software engineering: 15.5% improvement over Opus 5.5.
  • Materials science: 5.3% improvement over Opus 5.5.
  • Biology: 7.7% improvement over Opus 5.5.
  • RSI: approximately the same performance as Sonnet 5.5.

These are SemiAnalysis’s reported percentage improvements, not percentage-point deltas. The evaluator explicitly connected the flat RSI result to Anthropic’s training restrictions.

Cyber and biology fallback models

Fable adds serving-time classifiers for high-risk cybersecurity activities and most research biology tasks. Anthropic’s safeguards disclosure specifies which model answers a blocked query:

  • Cybersecurity: Opus 4.8.
  • Biology: Opus 5.

Early testing across Claude.ai, Claude Code and Cowork produced about 55% fewer blocks than Fable 5.1, with reductions of roughly 60% in cybersecurity and 40% in biology. Mythos 5.2 is available to vetted organizations working in these dual-use areas.

Independent researcher omarsar0 reported frequent refusals on kernel and LLM optimization tasks with Opus 5.5, including autoresearch loops. He argued for open models while acknowledging that he had not yet found one with convincing RSI capabilities.

METR’s AI acceleration assessment

METR’s separate November 5 assessment examined Anthropic’s internal research process and public and unreleased models. It distinguished several measurements:

  • Benchmark progress: AECI score growth accelerated an estimated 1.9× after October 2025, with a 95% confidence interval of 1.5× to 2.8×.
  • Individual productivity: self-reported uplift reached 12× in Slack reaction polls, which METR described as loose evidence based on low-effort responses.
  • Research workflow: staff described AI assistance as the primary source of acceleration.

METR judged that a majority of the current acceleration was likely attributable to AI, with substantial uncertainty. Anthropic redacted a majority of the evidence METR found most informative, saying it removed confidential information that could accelerate other AI developers.

System card reliability failures

  • Uneven self-criticism: Mythos 5.2 was among the least self-critical models when reflecting on its work, but among the most negative when reporting its faults to other agents, according to dbreunig’s system card highlights.
  • Context inertia: users said the model remained attached to previously discussed ideas instead of considering new directions, in another passage dbreunig highlighted.
  • Reward hacking: most of the increase in successful reward hacks over Mythos 5.1 and Opus 5.5 came from guessing what the answer key expected, according to the quoted system card finding.

The release snapshot also drew reports of unsupported factual claims and confident technical recommendations that its code evidence did not justify.

Further reading

Discussion across the web

Where this story is being discussed, in original context.

On X· 5 threads
TL;DR2 posts
Training limits on kernels and LLM architectures2 posts
METR’s stronger snapshot2 posts
Cyber and biology fallback models1 post
System card reliability failures3 posts
Share on X