← All concepts

mechanistic interpretability

When an AI model performs a task, we want to understand its internal workings. Mechanistic interpretability aims to reverse-engineer neural networks by identifying specific components, like attention heads or features, that drive behaviors. This approach treats the model as a machine with discoverable parts, rather than a black box.

Across these studies, a common challenge emerges: simple correlations or interventions often fail to capture true underlying mechanisms. Factors like hidden pathways, contextual differences, or architectural choices can distort interpretations. The papers show that rigorous causal testing and natural inputs are crucial for reliably understanding how models actually process information and make decisions.

Papers
143
Released code
8
First seen
Sept 2026
Latest
Nov 2026

142 papers in the last two months, against 1 in the two before.

Start here

Three papers to read first, in the order they came out
  1. 1Interpretability tools transfer between AI models with just unlabeled prompts

    Linear maps trained on prompts from a tool's region transfer interpretability directions across models at native performance.

    Nov 2026
  2. 2Massive activations make AI model interpretability tools unreliable

    Dominant activation directions make sparse-autoencoder feature rankings unstable and reconstruction scores misleading; removing those directions before training improves both.

    Nov 2026
  3. 3Multimodal training can make language models rely on vision-shaped reasoning for text-only spatial problems

    Multimodal training makes language models causally rely on vision-shaped internal representations even when reasoning from text alone.

    Nov 2026

Who is working on it

Independent Researcher 5Nanyang Technological University 4Northeastern University 4Peking University 4Tencent 3Seoul National University 3

The papers

Most central to this idea first, not most recent.

Concepts are extracted from each paper and reused across the corpus, so this page grows on its own as the desk reads.