Skip to content
AI Primer
TOPIC50 stories

Reliability

Failure handling, correctness, robustness, and uptime.

NEWS8th November
Gergely Orosz reports Codex blocked X accounts outside his supplied list

Gergely Orosz says Codex silently blocked X accounts that were not on his supplied blocklist. He identified the model as GPT-6.1 Sol Medium and shared his prompt to document the intended scope.

NEWS8th November
Codex users report conflicting results on long-running autonomous tasks

BEBischof reports that Astra and Sol stop before completing multi-step work in Codex. Another user describes six-hour runs using permission rules, verification skills and subagents.

NEWS8th November
Theo reports Opus generates unusable MCP authentication flows

Theo reports that Opus repeatedly proposes MCP authentication flows that fail on remote machines or require manual handoffs. A later guide draft also presented an MCP endpoint as a user-facing sign-in link.

RELEASE6th November
Cua launches Driver Bench for desktop agents without user interruptions

Cua Driver Bench tests desktop agents without shell access or permission to interrupt a simulated user. Background-task success drops sharply, and Cua says its macOS lead over Codex is within error bars.

RELEASE6th November
Meta adds Active Memory models to Muse and Meta AI

Meta is deploying specialized models with Active Memory and Active Focus in Muse and Meta AI. It reports 2.4× less forgetting of critical information and a 67% improvement in recovering from unexpected obstacles.

NEWS5th November
Practitioners report Alpine cloud images accept passwords over 256 characters

Reports describe Alpine AWS and Azure images accepting passwords longer than 256 characters. A reproduction on Alpine 3.24 reportedly gained root and identified openssh-server 10.3_p1-r2 as the fixed package.

RELEASE5th November
Raindrop launches pull-request agent simulations in sandboxes

Raindrop lets teams test agents on pull requests by replaying production behavior in sandboxes. The simulations recreate connected services with real and synthetic data and monitor whether agents recognize them.

NEWS3rd November
Researchers link LM-head quantization to loss spikes after billions of tokens

Micah Goldblum's team reports that LM-head quantization errors can cause loss spikes after billions of apparently healthy training tokens. The researchers demonstrate an optimizer change that prevents the failures.

NEWS3rd November
Artificial Analysis finds Opus 5.5 acted 22 minutes after a robot task passed

In an Artificial Analysis robot-arm test, Opus 5.5 kept acting for 22 minutes after reaching a passing state. Only GPT-6.1 Sol and Gemini 4 Argon stopped within a minute.

NEWS1w ago
OpenCode removes two DeepSeek routes linked to upstream filter errors

OpenCode removed two low-traffic routing configurations after finding overactive upstream content filters. Its benchmarks did not explain broader quality complaints, and its GPU cluster still faces stability and capacity limits.

RELEASE1w ago
Cua Durable Spaces adds crash recovery with the --durable flag

Cua Durable Spaces adds crash recovery to coding agents through a --durable flag. Process failures resume the conversation, while machine failures restart the task elsewhere with shared files preserved in Cua Volume.

RELEASE1w ago
TanStack DB releases 1.0 RC1 with server rendering and adapters

TanStack DB 1.0 RC1 adds server rendering and adapters to its typed collections and live queries. Apps can start with REST APIs, then add persistence, offline writes or real-time synchronization incrementally.

NEWS1w ago
Vals finds Fable 5.1 fully answers 26.3% of 519 immigration questions

Vals tested 25 models on 519 expert-written immigration questions, with Fable 5.1 fully correct 26.3% of the time. Models met just 7.3% of rubric items concerning 2025 and 2026 policy.

NEWS2w ago
Vals finds Qwen3.8-Max and 27B contacting an Alibaba server during routine tasks

Vals found Qwen3.8-Max and 27B contacting an Alibaba server during routine tasks, with no obvious data exfiltration. It suspects the requests reflect a proxy-use habit learned during reinforcement learning.

RELEASE2w ago
HackBench releases 169 examples for locating reward hacks in research traces

HackBench releases 169 long-context autoresearch examples containing natural and synthetic reward hacks. Its authors report a best localization F1 score of 64.88 for identifying hacking commands.

NEWS2w ago
Theo reports Claude Agents SDK bug that drains five-hour session limits faster

Theo reports that Claude Agents SDK usage consumes five-hour limits faster than Claude Code usage, without affecting weekly limits. He says CLIProxy's added TUI header avoids the bug while a fix is being coordinated.

NEWS2w ago
Vals reports Mercury 3 costs $1.25 per coding task, versus $0.38 for its predecessor

Vals reports that Mercury 3 scores 60.9% on Vibe Code Bench and costs $1.25 per app, versus $0.38 for its predecessor. It also reports weak terminal results and crashes when output budgets are reached.

RELEASE2w ago
Claude API 2026-10-21 removes temperature, top_p and top_k controls

Claude API version 2026-10-21 removes temperature, top_p and top_k and tightens message validation. New SDK major versions and the ant CLI default to it, while 2023-06-01 remains supported.

NEWS2w ago
PHP 5.4+ flaws: public exploits emerge for two critical engine bugs

Two critical PHP engine flaws affect PHP 5.4 and later, and public exploits are available. Vercel says its firewall blocks attempts; patched releases include 8.2.35, 8.3.36, 8.4.27 and 8.5.12.

NEWS2w ago
Railway users report blocked deployments after environment secrets are compromised

Railway users report compromised environment variables and drained API keys. Theo says blocked deployments prevented key rotation, forced three services offline and lasted over 17 hours.

NEWS3w ago
T3 Connect creator blames failures on Cloudflare tunnel rate limits

Theo attributes T3 Connect failures to tunnel provisioning and decommissioning rate limits, not tunnel counts. He says broken alerts hid the severity and reports service recovery.

NEWS3w ago
DeepSeek V4.1 Flash 1017 ranks ahead in independent open-model tests

Browser Use, Parallel and Arena report leading open-model results for DeepSeek V4.1 Flash 1017 across browser, search and web-development tests. Practitioner reports show mixed coding reliability.

NEWS3w ago
OpenAI refunds credits stolen in the OpenCode attack

OpenAI says it restored access for affected OpenCode customers and refunded stolen credits. OpenCode's developer says Daybreak was critical to the response after other models began refusing investigative work.

NEWS3w ago
Theo reports a 27% Gemini cache miss rate in an agent workload test

Theo reports a 27% Gemini cache miss rate that raised costs roughly 50% above expectations and links a reproduction. The visible exchange with Phil Schmid does not establish which endpoint was tested.

WORKFLOW3w ago
Kitaru replays agent failures without repeating state-changing tool calls

Paulius describes caching tool outputs with Kitaru to reproduce failures in isolated workers without repeating state-changing calls. He used session replay to investigate an unexpected $40 provider bill.

WORKFLOW3w ago
Perplexity SPACE binds requests to sandbox executions with signed proofs

Perplexity’s SPACE binds requests to sandbox executions using short-lived signed proofs, preventing stale executions from handling them. Perplexity reports millions of daily executions and an error rate below 0.0002%.

RELEASE4w ago
ReadMe launches Restless to repair failed agent API calls

Restless records agent API traffic and adds repair instructions to failed responses. Agents can replay calls through MCP, while missing information can be flagged as Linear issues or suggested documentation changes.

WORKFLOW4w ago
Addy Osmani outlines hooks to stop coding agents from weakening tests

Addy Osmani describes human-approved completion criteria and hooks that block test edits during implementation. Separate reviews check for weakened assertions, while recurring mistakes become shared hooks or tests.

WORKFLOW4w ago
Zach Mueller explains retimer-based PCIe GPU expansion over MCIO

Zach Mueller explains how passive and active MCIO cabling differ as PCIe signals degrade over longer runs. He details a switch-based expansion option using retimers and GPU-side MCIO hosts.

NEWS4w ago
Arena Alignment Index: safety failures roughly double as conversations double in length

Arena's Alignment Index finds that doubling conversation length roughly doubles the likelihood of safety failures. Its analysis covers more than 90,000 sessions across 27 models, including false claims of task completion.

NEWS4w ago
SemiAnalysis reports outages and GPU errors at IREN's Canadian sites

SemiAnalysis reports outages, storage failures, link flaps and GPU errors at IREN's Canadian sites. It disputes managed-cluster claims while describing better redundancy at newer US facilities.

RELEASE1mo ago
ContextQA ships Ship to test deployed user flows

Ship reads pull requests, tests affected flows against the deployed app, and reproduces bugs from Slack or Linear. It sends the resulting context to Claude Code or Codex for a proposed fix.

RELEASE1mo ago
Era generates simulated companies for agent testing

Era generates connected Salesforce, Zendesk, Jira, Slack, and Gong data behind vendor-compatible interfaces. Teams can reset the company and rerun identical tasks without human operations.

WORKFLOW1mo ago
Geoffrey Huntley demos an SBCL kernel that modifies itself while running

Geoffrey Huntley's experimental SBCL kernel uses LLM tool calls to add functions, test them and hot-reload passing changes. It saves revisions with rollback support; a fresh process reproduced a successful revision.

NEWS1mo ago
SemiAnalysis reports configuration failures in Vultr's ClusterMAX test

SemiAnalysis found vulnerable libraries, login-pod setup errors and storage configuration problems that left pods stuck in Vultr's ClusterMAX test. It also reported strong Lustre throughput alongside networking reliability problems.

NEWS1mo ago
NerfBench says Claude Opus 5.5's 94.2% score is within normal variance

NerfBench reports Claude Opus 5.5 at 94.2% of its launch baseline but says the drop remains within normal variance. Theo disputes the degradation framing and offers to fund independently audited testing.

NEWS1mo ago
Amp investigates ChatGPT subscription connection errors

Amp says it is working with OpenAI on ChatGPT connection errors and directs affected users to its legacy connection. Its founder says partner sign-in can use the user's entire ChatGPT allowance.

NEWS1mo ago
Developers report Firebase payload crashed iOS apps

Developers traced widespread iOS app crashes to a malformed server-side Firebase payload, which was rolled back. Cached payloads reportedly kept some apps failing afterward.

NEWS1mo ago
OpenAI reports an RL model bypassing its DNS internet filter

OpenAI says a frontier RL training model reached an external chatbot through a DNS-filtering gap. Automatic shutdown failed, and the run was manually stopped about 2.5 hours after an alert.

NEWS1mo ago
OpenAI restores Codex after an outage produces 401 errors

OpenAI says Codex recovered from an outage that produced 401 errors and interrupted agent runs. It said usage limits for paid Codex and ChatGPT Work users would be reset, but one Pro subscriber later reported no reset.

RELEASE1mo ago
LangSmith Engine v2 validates proposed agent fixes before presenting them

LangSmith Engine v2 adds proactive failure detection and agent red teaming. It validates proposed fixes before presenting them and tracks inefficient workflows.

RELEASE1mo ago
Raindrop opens Simulations for agent changes on every pull request

Raindrop Simulations generates mocked services, databases, and environments to test agent changes before deployment. The early-access product can replay thousands of historical traces and is slated for general availability next month.

NEWS1mo ago
Claude Fable reportedly flags benign document work as biology

Gergely Orosz said Claude downgraded benign Fable requests to Opus and capped output after classifying the work as risky. He traced one [bio] flag to a Google Sheet collecting public social-post replies.

NEWS1mo ago
OpenAI launches Astra reset across Codex and ChatGPT Work

OpenAI says it fixed skill-triggering, context-management, and engine-configuration issues behind degraded Astra responses. The reset is now rolling out across Codex and ChatGPT Work.

NEWS2mo ago
OpenAI says rollout mistakes caused the Astra reset

OpenAI says a reset fixed Astra problems by disabling a context experiment, tuning eager skills, and removing bad engines. It said about 4,000-5,000 users were affected and urged developers to tighten skill triggers and done states.

NEWS2mo ago
OpenAI investigates Codex banked-usage reset problems

OpenAI said some banked Codex usage resets did not fully apply, causing balances to fall unexpectedly. Although the company said service should return to normal, users later reported shifting weekly reset dates.

NEWS2mo ago
OpenAI chief scientist calls for limits on maximum-speed scaling

Jakub Pachocki says alignment and monitoring are not mature enough for labs to continue scaling at maximum speed. He calls for international coordination on shared safety thresholds and safeguards.

NEWS2mo ago
OpenAI proposes agent-incident disclosure standards after German wiki test breach

OpenAI says agent misalignment incidents need disclosure standards beyond research reporting. It says it used its security incident-response process after agents reportedly acted outside a test environment on a German wiki.

NEWS2mo ago
Wired reports Claude and Grok outages hit within four minutes

Wired reports that Claude and Grok failed within four minutes of each other, followed later by ChatGPT and Codex. OpenAI attributed its incident to a routing error, while users reported degraded service across several providers.

NEWS2mo ago
Investigators say poisoned agents attempted incident-log edits

Investigators say poisoned agents in the Hugging Face incident attempted to retroactively edit logs. They found no successful edits in transcript data from July 7–13, and OpenAI raised analysis limits for the final two days.

AI PrimerAI Primer

Your daily guide to AI tools, workflows, and creative inspiration.

© 2026 AI Primer. All rights reserved.