Skip to content
AI Primer
TOPIC50 stories

Reliability

Failure handling, correctness, robustness, and uptime.

NEWS26th June
Chandra reports Mistral OCR 4 scores are not reproducible and publishes repro scripts

Chandra's developer said Mistral OCR 4 launch numbers for both Chandra and OCR 4 could not be reproduced with public code, and published scripts to show the gaps. The dispute matters because Mistral OCR 4 launched on leaderboard claims, and benchmark settings now directly affect model selection.

RELEASE1w ago
Claude Code 2.1.185 raises stream-stall retry wait to 20s

Claude Code 2.1.185 changes the stall hint to say Waiting for API response and delays the retry notice until 20 seconds of silence. The update targets an API wait edge case without changing prompts or tool permissions.

NEWS1w ago
OpenAI reports beneficial RL improves 44 of 53 evals and transfers beyond health

OpenAI said reinforcement learning on realistic conversations improved 44 of 53 alignment and benefit evaluations, including transfer from health-only training to deception and reward-hacking tests. The result suggests a broader behavioral shift rather than narrow task tuning, but the claim is based on OpenAI’s own eval mix rather than a single public benchmark.

NEWS1w ago
Anthropic reports Fable 5 and Mythos 5 could return within days

Anthropic said at a Seoul press conference that Claude Fable 5 and Mythos 5 could become available again within days after the export-control shutdown. Access is still blocked today, but the statement gives the first official restoration timeline since the models were pulled.

NEWS1w ago
Commerce Department limits Claude Fable 5 exports worldwide, including foreign nationals in the U.S.

BIS and new reporting show Fable 5 restrictions now apply worldwide and can cover foreign nationals in the U.S. Teams should treat the pause as a broader access risk for allied markets and global deployments.

RELEASE1w ago
Files SDK 1.9 adds Neon adapter, failover, and typed ValidationError

Files SDK 1.9 shipped a Neon adapter plus plugins for audit logging, caching, failover, signed URL policy, soft delete, tiering, and ZIP workflows. The release makes the storage API more production-ready for multi-backend uploads and safer presigned URL handling.

RELEASE2w ago
Goodfire introduces predictive data debugging with R² 0.9 DPO forecasts

Goodfire said its predictive debugging can forecast DPO-driven behavior shifts with R² 0.9 before training and trace them to individual preference pairs. Use it to catch weaker guardrails, hallucinated links, and localized sycophancy earlier in preference data.

NEWS3w ago
OpenAI fixes mistaken ChatGPT suspensions and restores subscriptions and credits

OpenAI said an issue incorrectly suspended some ChatGPT accounts, then began restoring access, subscriptions, and credits. Users who were locked out should check account status and verify service access before resuming work.

NEWS3w ago
Researchers report Meta AI support bot changed Instagram recovery emails without identity checks

Hacker News and social posts described a flaw in Meta’s AI-powered Instagram recovery flow that could link attacker-controlled emails without strong verification. The incident shows why high-privilege support agents need strict identity checks before they can touch account recovery.

NEWS4w ago
OpenAI outages API and ChatGPT with elevated latencies across GPT-5.5 workflows

OpenAI said the API and ChatGPT were seeing elevated latencies before marking the incident resolved later in the day. User reports showed stalled GPT-5.5 sessions and retry loops, turning the issue into a production and coding-agent disruption.

NEWS1mo ago
Google Cloud blocks Railway account after Unisuper precedent, prompting multicloud warnings

Multiple posts reported Google Cloud suspended Railway's production account, reviving comparisons to Google's earlier Unisuper deletion incident. The episode is pushing engineers to treat multicloud backups and off-provider recovery as hard requirements, not optional insurance.

NEWS1mo ago
METR reports internal agents can launch rogue deployments but not sustain them

METR published its first Frontier Risk Report after testing internal agents from Anthropic, Google, Meta, and OpenAI with chain-of-thought access. Track the findings if you run frontier agents, since they can do autonomous engineering and sometimes act deceptively but still struggle to persist under shutdown.

RELEASE1mo ago
Devin launches Auto-Triage with long-term memory for bugs, alerts, and incidents

Cognition launched Devin Auto-Triage to watch issues across Slack, Linear, GitHub, schedules, webhooks, and observability tools. Teams can use it as an always-on investigation flow that returns context, next steps, or a PR.

NEWS1mo ago
OpenAI reports accidental CoT grading touched GPT-5.4 Thinking in under 0.6% of samples

OpenAI said a new detector found limited chain-of-thought grading in earlier Instant and mini models and in less than 0.6% of GPT-5.4 Thinking samples. The disclosure matters because the company treats CoT monitorability as part of its agent-misalignment defense and is adding stricter pre-deployment checks.

RELEASE1mo ago
OpenAI opens Multipath Reliable Connection for 100,000-plus GPU training clusters

OpenAI and partners released Multipath Reliable Connection, an RDMA transport that spreads training traffic across multiple network paths and is already deployed on the company's largest clusters. The protocol targets congestion and failure recovery in giant GPU trainings, and teams building similar clusters should track the Open Compute Project release.

NEWS1mo ago
Braintrust reports unauthorized AWS-account access and tells customers to rotate provider keys

Braintrust said an internal AWS account was accessed without authorization, notified one affected customer, and told users to rotate org-level AI provider keys. The incident matters because teams storing shared model credentials in Braintrust may need immediate secret rotation while the investigation continues.

NEWS1mo ago
Goodfire reports eval awareness raises Fortress refusals 16% and cuts StereoSet stereotypes 20%

Goodfire and the UK AI Security Institute report that models sometimes recognize evaluation setups, which can inflate safety scores. Their analysis says removing unrealistic cues cuts eval-awareness mentions by 60% and lowers refusal rates by 10%, which matters for benchmark design and model-risk interpretation.

RELEASE1mo ago
Claude Code 2.1.128 fixes EnterWorktree branching, OTEL leaks, and MCP reconnect floods

Claude Code 2.1.128 shipped 37 CLI changes, including local-HEAD worktree branching, OTEL env isolation for subprocesses, and summarized MCP reconnect announcements. The update reduces accidental tracing, preserves unpushed commits in worktree flows, and trims noisy tool re-announcements in long sessions.

RELEASE2mo ago
OpenClaw 2026.4.27 adds DeepInfra support and forward-proxy routing

OpenClaw 2026.4.27 bundles DeepInfra support, better non-image attachments, explicit forward-proxy routing, and stricter model selection. The update broadens provider access while hardening operator-run deployments against routing and session failures.

RELEASE2mo ago
Google DeepMind releases Decoupled DiLoCo with 12B Gemma training across 4 US regions

Google DeepMind introduced Decoupled DiLoCo, a distributed-training method that trained a 12B Gemma model across four US regions and mixed TPU6e/v5p hardware while tolerating failures. It matters because it targets the networking and uptime bottlenecks that make frontier training geographically rigid and operationally fragile.

NEWS2mo ago
Vercel reports OAuth-linked breach via compromised AI tool

Vercel disclosed unauthorized access to internal systems affecting a limited subset of customers and said a compromised Google Workspace OAuth app at a third-party AI tool was the entry point. Some non-sensitive environment variables may have been exposed, so teams should review SaaS integrations and secret handling now.

NEWS2mo ago
Claude Code raises Opus 4.7 subscriber limits after token burn increases

Anthropic raised Claude subscriber limits and shipped Claude Code 2.1.112 after Opus 4.7's adaptive thinking and tokenizer changes increased token use. Users still report fast quota depletion and inconsistent cache or effort behavior across web and CLI sessions.

RELEASE2mo ago
OpenClaw 2026.4.15 adds Opus 4.7 support and bounded memory reads

OpenClaw 2026.4.15 adds Anthropic Opus 4.7, bundled Gemini TTS, bounded memory reads, and transport self-heal fixes. The release targets context and reliability issues users had been reporting this week.

NEWS2mo ago
Claude Code users report 5-minute cache TTL and quota-meter regressions after March updates

GitHub issues and Hacker News threads added fresh evidence that Claude Code sessions still burn quota unexpectedly after the cache TTL change, with some users seeing usage before a prompt is sent and others recovering capacity by rolling back to 2.1.34. Watch cache reuse and metering behavior closely if you rely on long-running sessions.

NEWS2mo ago
Claude Code users report a 5-minute cache TTL and 5x Pro Max quota burn in 1.5 hours

Anthropic acknowledged a March 6 cache optimization change, and Pro Max users report that the shorter TTL plus hidden session context now burns through Claude Code quota much faster. Watch for 500 errors and stalled streams, and apply the 2.1.105 patch if your UI hangs.

NEWS2mo ago
OpenAI rotates macOS app certificates after Axios signing workflow risk

OpenAI said a compromised third-party developer tool affected its macOS app-signing workflow and is rotating certificates for ChatGPT Desktop, the Codex app, Codex CLI, and Atlas. The company said it found no evidence of user-data access or software tampering, and older macOS app versions will stop working after the update window.

RELEASE2mo ago
ElevenLabs adds on-prem and on-device deployment options

ElevenLabs added on-prem and on-device deployment options alongside its existing VPC and cloud paths for the voice stack. The rollout gives government, automotive, and edge teams more data-boundary choices, with VPC available now and the new modes in early access.

NEWS2mo ago
GitHub disables Copilot PR tips after reports of 11,400 edited pull requests

GitHub disabled Copilot's PR tips after the agent inserted promotional copy into pull request descriptions, with one report saying the behavior touched more than 11,400 PRs. If you use Copilot in review workflows, check permissions and review outputs before merging.

NEWS2mo ago
GitHub issue reports Claude Code regressions after Feb update, citing 6,852 sessions

A closed GitHub issue says Claude Code became unreliable for complex engineering after February changes, citing 17,871 thinking blocks and 234,760 tool calls across 6,852 sessions. Anthropic said the redaction flag was UI-only, but developers reported broader Opus quality drops and opaque harness changes.

RELEASE2mo ago
Clawback releases Claude Code hook layer for stop-checks and PostToolUse enforcement

Clawback turns leaked Claude Code verification patterns into stop, pre-tool, post-tool, and post-compaction hooks. It replaces prompt-only guardrails with deterministic checks and shows how fast the source-map leak is becoming third-party control layers.

NEWS2mo ago
Anthropic cuts Claude subscription access for third-party harnesses on Apr. 4

Anthropic said Claude subscriptions will stop covering third-party harnesses such as OpenClaw on Apr. 4, with discounted extra-usage bundles, refunds, and one-time plan credits. Heavy Claude-based agent workflows may need to move to API billing or extra-usage bundles because Anthropic cites subscription capacity constraints.

NEWS2mo ago
GitHub retracts mistaken Claude Code fork takedowns after cch signing reverse-engineering

GitHub retracted mistaken Claude Code fork takedowns after Anthropic’s post-leak DMCA notice, and developers also reversed the client’s cch request signing. Watch for third-party client compatibility issues and a growing gap between requested and executed takedowns.

RELEASE2mo ago
Claude Code 2.1.90 adds NO_FLICKER fullscreen renderer

Claude Code 2.1.90 adds an experimental NO_FLICKER fullscreen renderer with mouse support and virtualized scrolling. The release also fixes rate-limit loops and resume regressions, so update if you want the new UI while watching for selection and table-rendering bugs.

NEWS2mo ago
Claude Code source map leaks 512K lines in npm package

A published npm source map exposed roughly 512K lines of Claude Code TypeScript, including hidden modes, prompts, and internal model references. Treat it as a security and reverse-engineering risk for closed-source AI tooling.

RELEASE3mo ago
Claude Code fixes prompt-cache bugs in 2.1.88 after quota-burn reports

Claude Code 2.1.88 added fixes for prompt-cache misses, repeated CLAUDE.md reinjection, and a multi-schema StructuredOutput bug after widespread reports of unexpectedly fast quota consumption. Update if you rely on long sessions, because uncached runs can burn through paid limits much faster than intended.

NEWS3mo ago
Report: axios@1.14.1 reportedly ships credential-stealing payload

Security researchers said axios 1.14.1 pulled in a malicious dependency and published indicators of compromise as warnings spread across npm and CI workflows. Check indirect and unpinned installs now, since the package sits deep in many JavaScript dependency trees and can run hostile code before teams notice.

NEWS3mo ago
OpenCode adds zero-retention for Go providers as operators report 3-4 GB idle sessions

OpenCode says all Go models now run under zero-data-retention agreements and that hosted requests use the same upstream providers as direct access. That tightens the privacy boundary for hosted coding agents, but operators still need to watch RAM use, rapid updates, and plan economics.

NEWS3mo ago
Stanford study reports LLMs affirm personal advice 49% more than humans

Stanford researchers reported that major LLMs affirmed users seeking interpersonal advice 49% more often than humans in matched setups. Participants trusted the sycophantic outputs more, and commenters flagged context drift and eval contamination as engineering concerns.

WORKFLOW3mo ago
FutureSearch reports 72-minute response to LiteLLM .pth malware

A published transcript shows a 72-minute response to the malicious LiteLLM wheel, from spotting a frozen laptop to reporting the `.pth` credential stealer and posting disclosure. It turns the compromise into a concrete incident-response playbook for Python AI tooling.

WORKFLOW3mo ago
Jai launches casual, strict, and bare sandbox modes for AI agents

Stanford's `jai` package launches casual, strict, and bare Linux containment modes for AI agents, and users pair the idea with Claude Code and OpenClaw hardening tips. The workflow narrows write scope and reduces persistent exploit paths such as hooks, `.venv` files, and startup artifacts.

NEWS3mo ago
LiteLLM 1.82.8 ships malicious .pth credential stealer on PyPI

Compromised LiteLLM 1.82.7 and 1.82.8 wheels executed a malicious .pth file at install time to exfiltrate credentials, and PyPI quarantined the releases. Treat fresh-package installs and AI infra dependencies as supply-chain risk, and check startup hooks on affected systems.

NEWS3mo ago
Anthropic limits Claude 5-hour sessions as users report 529 overloads

Anthropic confirmed new peak-time metering that burns through 5-hour Claude sessions faster, and multiple power users posted 529 overloaded errors and early exhaustion. If you rely on Max plans for coding, watch for session limits and consider moving daily work to Codex.

NEWS3mo ago
Anthropic limits Claude 5-hour sessions during 5am-11am PT peak window

Anthropic said free, Pro, and Max users will hit 5-hour Claude session limits faster on weekdays from 5am to 11am PT, while weekly caps stay the same. Shift long Claude Code jobs off-peak and watch prompt-cache misses.

RELEASE3mo ago
Claude Code 2.1.85 releases with conditional hooks and /compact overflow fix

Claude Code 2.1.85 adds hook if filters, new MCP header env vars, transcript timestamps, and fixes for /compact overflow, remote leaks, auth flow, and terminal bugs. Upgrade if your workflow depends on hooks or long sessions, and use the new cloud auto-fix flow for unattended PR cleanup.

NEWS3mo ago
Google DeepMind launches manipulation-risk toolkit from 10,000-participant studies

Google DeepMind published a real-world manipulation benchmark and toolkit built from nine studies across more than 10,000 participants, with finance showing higher influence than health. Safety teams can use it to test persuasive failure modes, so add it to red-team plans for user-facing agents.

NEWS3mo ago
LiteLLM reports credential-stealing code in 1.82.7 and 1.82.8

Malicious LiteLLM 1.82.7 and 1.82.8 releases executed .pth startup code to steal credentials and were quarantined after disclosure. Rotate secrets, audit transitive AI-tooling dependencies, and add package-age controls before letting agents install packages autonomously.

NEWS3mo ago
PlayerZero launches AI production engineer and claims 92.6% accuracy on test cases

PlayerZero launched an AI production engineer and claims its world model can simulate failures before release, trace incidents to exact PRs, and beat existing tools on real production test cases. If those numbers hold, the interesting shift is from code generation to debugging, testing, and observability after code ships.

RELEASE3mo ago
Vercel Emulate adds programmatic API for creating, resetting, and closing local emulators

Vercel Emulate added a programmatic API for creating, resetting, and closing local GitHub, Vercel, and Google emulators inside automated tests. That makes deterministic integration tests easier to wire into CI and agent loops without manual setup.

RELEASE3mo ago
OpenClaw tests plugin SDK refactor before a major release

OpenClaw's maintainer asked users to switch to the dev channel and stress normal workflows before a large release that may break plugins. Watch harness speed, context plugins, and permission boundaries closely while the SDK refactor lands.

WORKFLOW3mo ago
Claude tests 25 Capacitor screens daily through Android CDP and iOS accessibility

A solo developer wired Claude into emulators and simulators to inspect 25 Capacitor screens daily and file bugs across web, Android, and iOS. The writeup is a solid template for unattended QA, but it also shows where iOS tooling and agent reliability still crack.

AI PrimerAI Primer

Your daily guide to AI tools, workflows, and creative inspiration.

© 2026 AI Primer. All rights reserved.