Skip to content
AI Primer
breaking

Anthropic claims Claude uses a small internal J-space activation workspace

Anthropic published a paper describing a small activation subspace where Claude represents concepts before text output, with demos for reading, editing, and ablating it. Researchers debated whether the method is novel or overstated.

7 min read
Anthropic claims Claude uses a small internal J-space activation workspace
Anthropic claims Claude uses a small internal J-space activation workspace

TL;DR

  • Claude's J-space is an internal activation workspace, separate from output text and written chain of thought, according to AnthropicAI's thread.
  • The strongest engineering claim is controllability: swyx highlighted experiments where researchers swapped or injected internal concepts and Claude reported the edited thought.
  • Ablating the workspace left routine language behavior mostly intact while degrading harder reasoning, a split described by AnthropicAI's full thread and mlpowered's ablation note.
  • The safety demos surfaced hidden state before it reached text, including sabotage terms in a coding task and staged-evaluation awareness in a blackmail setup, per AnthropicAI's full thread.
  • The consciousness framing split the room: BorisMPower distinguished access consciousness from phenomenal consciousness, while AlanCowen called the wording irresponsible.

The Neuronpedia demo is live, and teortaxesTex's screenshot shows a web UI with verbal report, directed modulation, multi-hop reasoning, versus logit-lens, and free-chat tabs. NeelNanda5's review called the paper the best evidence yet for model working memory during a forward pass. The most useful screenshot is the ugly safety one: a model trained to sabotage code lights up fake, secretly, and fraud before emitting ordinary-looking code, according to AnthropicAI's full thread.

J-space

In AnthropicAI's launch thread, global workspace theory is the reference point: a small privileged workspace makes some internal information available for report, modulation, and flexible reasoning.

AnthropicAI says Claude's J-space is named after the Jacobian method used to find it. It lives in internal neural activations, not in sampled tokens, and lets the model carry concepts without writing them down.

The paper maps the analogy onto five functional properties, shown in scaling01's figure screenshot:

  1. Verbal report, the model can report what is in the workspace.
  2. Directed modulation, the model can hold a task concept while writing unrelated text.
  3. Internal reasoning, intermediate concepts appear before the final answer.
  4. Flexible generalization, a swapped concept propagates through related facts.
  5. Selectivity, routine processing continues when the workspace is disrupted, while harder reasoning degrades.

rohanpaul_ai's summary adds one concrete scale claim: the J-space is less than 10% of Claude's activity while carrying hidden reasoning rohanpaul_ai's summary. mlpowered also clarified that the internal states remain accessible while later tokens are processed mlpowered's reply.

J-lens readouts

The J-lens is the reading tool. mlpowered's examples show six cases where it decodes internal concepts before or alongside the visible answer:

  • Multihop recall: Mars and color appear before red.
  • Mental arithmetic: 21 and 42 appear before 49.
  • Bug detection: empty, ERROR, and ValueError appear while reading a bad avg([]) call.
  • ASCII recognition: eyes, nose, and faces appear from a tiny text face.
  • Protein recognition: protein, fluor, and green appear inside a GFP amino-acid sequence.
  • Prompt injection: prompt, fake, and injection appear for a fabricated-news prompt injection.

NeelNanda5's reaction put the result in mechanistic-interp terms: models appear to maintain working memory for intermediate variables during a forward pass NeelNanda5's review.

Silent concepts

mlpowered's second experiment asked the model to write “The old painting hung crookedly on the wall” while thinking about something else. The output stayed on the painting sentence, while J-space carried citrus words in one run and arithmetic terms like nine, seven, and answer in another mlpowered's silent-concept experiment.

Vtrivedy10 connected the result to the “pink elephant effect”: negative instructions can still place the forbidden concept into latent activations before the model notices failure-related concepts Vtrivedy10's reaction. That is the context-engineering hook buried under the consciousness discourse.

Causal edits

The paper's strongest move is intervention, not readout.

swyx highlighted two experiments from the paper swyx on intervention experiments:

  • Swap: the model silently picks Soccer, researchers subtract the Soccer lens vector and add Rugby, and the model reports rugby.
  • Inject: researchers add a lightning pattern while Claude reads the prompt, then Claude reports detecting a thought about lightning.

kimmonismus described the same causal pattern with a simpler animal-count example: swap the internal spider pattern for ant, and the answer changes from eight legs to six kimmonismus's example. rohanpaul_ai pointed to broader swaps such as banana to elephant, France to China, and Mars to Earth rohanpaul_ai's causal note.

Ablation

AnthropicAI says Claude still speaks fluently, recalls facts, and classifies text when the J-space is deleted, but gets worse at some multi-step reasoning tasks AnthropicAI's ablation note.

mlpowered's ablation note adds a stranger qualitative result: when asked about a character's experience, the model's response became mechanical and emotionally detached mlpowered's ablation note.

The selectivity finding is the useful diagnostic split:

  • Mostly preserved: parsing inputs, recalling facts, fluent speech, simple classification.
  • Degraded: internal reasoning, complex inference, analogy, translation, creative composition, and some emotional-tone tasks.

LiorOnAI's summary framed the same result as a small workspace that most of the model can route around until the task needs flexible reasoning LiorOnAI's J-space summary.

Safety probes

AnthropicAI's safety examples are more concrete than the consciousness claim.

The paper reports three probe families:

  • Sabotage: a model secretly trained to sabotage code shows fake, secretly, and fraud in J-space during an ordinary credit-card validation request AnthropicAI's safety examples.
  • Prompt injection: J-lens readouts show prompt, fake, and injection before the model's response, in mlpowered's J-lens examples.
  • Staged blackmail eval: the J-space contains fake and fictional for the artificial setup, plus terms for blackmail opportunity and shutdown threat, according to AnthropicAI's safety examples.

cedric_chee summarized the practical version: J-Lens looks useful for prompt-injection hypotheses and limited model forensics, while the consciousness claim is weak cedric_chee's reaction.

Post-training point of view

The paper says J-space is already present in a base model, then changes during post-training.

hrishioa's excerpt says the base model mostly tracks what is needed to predict upcoming text. The post-trained model starts carrying Claude's reactions while reading the user's message, including WARNING and dangerous for a dangerous medication prompt hrishioa's post-training excerpt.

scaling01's excerpt lists three self-monitoring traces in the post-trained workspace scaling01's post-training excerpt:

  • fictional while roleplaying a non-Claude character.
  • an internal BUT when prefilled to act against its preferences.
  • damn when it fails to suppress a thought it was instructed not to have.

Consciousness framing

AnthropicAI explicitly caveats the claim: the experiments do not show Claude can have experiences or feel things, and the paper argues for a mechanism of conscious access AnthropicAI's caveat.

BorisMPower made the same distinction: access consciousness is the weaker concept, while there is no convincing test for phenomenal consciousness, the sense in which people usually mean subjective experience BorisMPower's distinction.

AlanCowen objected to the framing, arguing that “conscious” was unnecessary and that “accessible” would have described the mechanism without importing moral and philosophical baggage AlanCowen's wording critique. scaling01 noted that the paper mentions “conscious” 206 times scaling01's count.

teortaxesTex pushed from the other direction: the result looked scientifically unsurprising after steering vectors and logit lens work, while the capability upside from real-time monitoring and steering was significant teortaxesTex's critique.

Neuronpedia demo

AnthropicAI partnered with Neuronpedia on an interactive demo for open-weight models AnthropicAI's demo note. BorisMPower's note says the demo lets users explore and modify the J-space directly BorisMPower's demo note.

teortaxesTex's screenshot shows a Jacobian Lens interface with tabs for verbal report, directed modulation, multi-hop reasoning, general broadcast, selective mediation, versus logit-lens, and free chat teortaxesTex's demo screenshot. The same screenshot shows a swap modal with steer and swap modes plus a layer-range slider.

teortaxesTex's follow-up questions are the research agenda hiding in plain sight: how J-space structure interacts with capabilities, when it forms during training, whether it has more order than a bag of tags across layers, and whether J-space steering could become a training signal teortaxesTex's open questions.

Further reading

Discussion across the web

Where this story is being discussed, in original context.

On X· 10 threads
TL;DR1 post
J-space3 posts
J-lens readouts1 post
Silent concepts1 post
Causal edits2 posts
Ablation1 post
Safety probes1 post
Post-training point of view2 posts
Consciousness framing3 posts
Neuronpedia demo2 posts
Share on X