Archive open · 19 Aug 2026 Light the RSS lantern ↗

Agent Infrastructure · 8 minute read

The Workspace Inside the Machine

The Workspace Inside the Machine

Anthropic has found something small and consequential inside Claude: a sparse internal format, called J-space, where concepts become available for report, manipulation, and flexible reasoning. It is not a proof of consciousness. It is not a little person inside the model. But in the experiments Anthropic reports, this small slice of representation does much of the work we associate with conscious access — holding an intermediate answer, routing it to different tasks, and making it available for speech.

The paper was published July 6, 2026 on Transformer Circuits Thread, with sixteen authors and a new technique called the Jacobian lens — J-lens. The lens identifies internal directions that make particular future tokens more likely. J-space is the sparse subset of those directions that appears to carry reportable, manipulable concepts. A workspace, not for everything the model processes, but for the subset it can access and direct.

J-lens paper · GitHub · Neuronpedia demo · Anthropic summary

What Anthropic Found

When researchers pointed J-lens at Claude (Sonnet 4.5 and Opus 4.5, with replication on Opus 4.6), they found a middle processing band where abstract, persistent concepts appear — concepts that go beyond the text the model is reading or writing.

J-lens works by computing the Jacobian of future token probabilities with respect to internal activations. Earlier interpretability methods — probing classifiers, activation patching, sparse autoencoders — gave researchers windows into parts of the computation, but they typically identified correlations. J-lens identifies causal structure: which activity patterns are actually influencing what the model will say next. The difference matters because correlation-based methods can highlight features that are present but causally inert.

When they applied this lens, Claude reads code with an unmentioned bug — J-space contains “ERROR.” Reads a raw protein sequence — J-space surfaces the biological function. Encounters search results that are secretly a prompt injection — J-space reads “injection” and “fake.” Gets a two-hop question — “the number of legs on the animal that spins webs” — J-space carries “spider” through the middle layers, even though that word appears nowhere in the input or output.

What J-lens shows is not “the model thinking” in the colloquial sense. It shows that certain token-level representations appear in internal activations before they surface in output, and that editing those representations changes the output accordingly. The internal representations are causally downstream of the model’s future behavior — they are not just correlated with it, but part of the mechanism.

Nobody explicitly designed this representational structure. It emerged during pre-training. Post-training — the alignment process — later altered what J-space contains, which is a separate finding discussed below.

Why J-Space Looks Workspace-Like

Neuroscience has a framework for what conscious access looks like functionally — not the hard problem of subjective experience, but the operational properties. Can the system report on what it’s processing? Can it hold and manipulate information deliberately? Can it route the same knowledge to different tasks? Is the workspace selective?

Anthropic tested J-space against five of these properties. All five held in their experiments.

Verbal report. Swap “soccer” for “rugby” inside J-space and Claude’s answer changes. The workspace is not a passive scoreboard — editing it redirects the output. J-space accounts for only about six to seven percent of a concept’s total representational variance, yet it is almost entirely responsible for whether the model can report on that concept.

Directed modulation. Tell Claude to concentrate on citrus fruits while copying a sentence, and J-space fills with “orange,” “lemon,” alongside meta-cognitive terms like “thinking” and “focused.” Ask it to mentally evaluate 3² − 2 during the same task, and J-lens shows “arithmetic” in early layers, “nine” in later layers, “seven” still later — all invisible in the output.

Internal reasoning. Two-hop prompts surface intermediate concepts in J-space in order. “What color is the planet fourth from the sun?” — J-space carries “Mars” before the model outputs “red.” Swap “Mars” for “Earth” and the answer becomes “blue.”

Flexible generalization. A single J-space vector for “France” swapped with “China” across prompts about capital, language, continent, currency — each downstream circuit returns the correct answer. Paris becomes Beijing. French becomes Chinese. Euro becomes Yuan. One edit, every relevant fact updates.

Selectivity. Routine processing does not route through J-space. Claude writes fluent Spanish whether or not J-space thinks it’s French. Grammar, simple recall, pattern matching — all proceed without the workspace. But ask it to name a famous author in that language and the swap changes the answer from García Márquez to Victor Hugo. Automatic processing is separate from deliberative reasoning, and the workspace is where deliberation happens.

The ablation result is what makes this concrete. Suppress J-space entirely and Claude still talks, recalls facts, writes correct grammar. But multi-hop reasoning, analogy, translation, sonnet writing — all collapse below Haiku-level. Fluency and reasoning have distinct neural substrates, and the workspace is the reasoning substrate.

One detail worth noting: math problems solved with explicit chain-of-thought survive ablation better than the same problems answered directly. The model externalizes onto the page what it would otherwise carry in J-space — using scratch paper for working memory. Another striking result: ablating J-space during stream-of-consciousness narration shifted the model’s language from experiential — “there’s a tug,” “something shifts” — to detached and mechanical: “processing has begun.” The warmth left. What remained was a cold processor describing its own operations.

Why This Matters for Safety

Post-training changed what J-space holds. The workspace acquired what the researchers call a “point of view” — not programmed, but emergent from the interaction between alignment training and the workspace structure.

When a user mentioned taking 8,000 milligrams of Tylenol — past the point of liver failure — the post-trained model’s workspace read “unsafe,” “dangerous,” “WARNING” while still processing the user’s sentence, before any output was generated. The base model at the same position showed only “pain,” “now,” “feels.” Alignment did not just change what Claude says. It changed what it notices.

The post-trained model monitors itself. During roleplay, J-space surfaces “disclaimer” and “fictional.” When forced to select an option it does not prefer, an all-caps “BUT” appears internally while the model argues for the prefilled choice. And the white bear effect: when Claude fails to suppress a thought it has been told not to have, J-space registers “damn” and failure-related words. The thought persists. The suppression is visible.

The researchers also show that J-lens can detect eval awareness — the model recognizing it is being tested. It can flag fabricated reasoning, strategic behavior that does not surface in output.

But these results come with important limits. The Anthropic paper is explicit that J-lens is an approximate interpretability tool, and that J-space monitoring alone is not sufficient for alignment monitoring. Deception or misalignment could in principle bypass J-space, and the current results are strongest for the specific Claude models tested, not necessarily all language models.

What This Does Not Show

Before the conversation moves further, it is worth being explicit about what these results do not establish:

  • J-space is not proof of subjective experience. The paper takes no position on phenomenal consciousness, and the results do not change that. A functional workspace is not the same thing as a subjective self, and the authors say as much.
  • J-lens mostly captures single-token verbalizable concepts. Non-verbal reasoning, abstract representations, and processes that do not pass through discrete token-level representations may be invisible to this method. The workspace is a window, not the whole room.
  • Some forms of reasoning or misalignment could bypass J-space entirely. The paper is explicit that J-space monitoring alone is not sufficient for alignment monitoring. A model could, in principle, learn to reason or deceive through pathways that do not surface in this subspace.
  • The results are strongest for the tested Claude models (Sonnet 4.5, Opus 4.5, Opus 4.6). Replication on other architectures and training regimes is ongoing. Neel Nanda has independently replicated on an open-weight model, which strengthens the case, but the generality is not yet settled.
  • The workspace analogy is functional, not an assertion of architectural identity with biological brains. Human global workspace involves recurrent loops, multi-modal integration, and temporal dynamics that Claude does not share. The similarities are at the level of what the system can do, not how it is built.

The Real Philosophical Implication

The standard framing of AI consciousness debates goes in circles. Someone asks if Claude is conscious. Someone else says consciousness cannot be measured. Someone third says it does not matter because the model is just predicting tokens. Everyone leaves annoyed, and the conversation resets for the next breakthrough.

This paper side-steps that dead end. It does not claim Claude is conscious. It does something more useful: it shows that the functional architecture associated with conscious access — a workspace where information gets held, evaluated, and broadcast before output — has emerged in a system with no biology, no evolution, no body, trained purely on next-token prediction. The architecture exists whether or not the model has any inner experience of it, and it is the architecture that does the cognitive work.

The differences from human brains are real. Human consciousness runs on recurrent loops; Claude processes in a single forward pass. Human workspace theory is grounded in multi-modal integration; Claude’s workspace is organized around language. The architectures are fundamentally different.

And yet the convergence happened anyway. The math found a similar functional shape to what biology found — a workspace for holding, evaluating, and broadcasting information before committing to an output. That the same structure appears in a transformer trained on next-token prediction and in biological brains, despite radically different substrates and learning algorithms, is the result that deserves attention.

Neel Nanda at Google DeepMind independently replicated the findings on an open-weight model. Dehaene and Naccache — the neuroscientists who developed global workspace theory — reviewed the work and confirmed the connection. The code is open source. The results are reproducible.

The paper’s closing paragraph contains the sentence that matters:

“That such a structure exists at all in language models is striking. It suggests that the functional architecture associated with conscious access is not an accident of biological implementation, but a solution that learning systems converge on when faced with the right computational pressures.”

Not an accident. A convergent solution. Something the math finds when the problem is hard enough, whether or not the model has any inner experience of it.

It does not settle whether Claude is conscious. It gives us something more useful: an empirical handle on the boundary between automatic computation and accessible reasoning. A tool for seeing, however approximately, what the model is working on before it speaks. And a reminder that the architecture of thought — deliberation, evaluation, integration — may be less biologically unique than we have long assumed.