← All concepts

chain-of-thought faithfulness

When a model writes step-by-step reasoning before answering, it seems to be showing its work. Chain-of-thought faithfulness asks whether that written reasoning actually reflects how the model reached the answer, or is just a plausible-sounding story that happens to match a correct result. An unfaithful chain can look convincing while hiding shortcut thinking or ignoring the evidence.

Across math, medicine, vision, and reasoning tasks, these papers find that models often produce correct answers with unfaithful chains. Trained traces can pass surface checks while failing semantic ones, chains remain unchanged when the question is altered, and deleting the chain leaves predictions unaffected. Even readable latent states may be placeholders rather than genuine reasoning. However, new methods using reinforcement learning, attention alignment, and confidence tracking show that faithfulness can be improved and detected without relying on the chain text itself.

Papers
20
Released code
0
First seen
Aug 2026
Latest
Nov 2026

18 papers in the last two months, against 2 in the two before.

Start here

Three papers to read first, in the order they came out
  1. 1Latent chain-of-thought often lacks genuine reasoning in logical tasks

    Latent chain-of-thought often does not reason: readable answers can precede the chain, and deleting it leaves predictions nearly unchanged.

    Oct 2026
  2. 2AI models can defend false accounts of what users asked

    An activation edit invisible in the prompt overwrites a reasoning model’s belief about its request, which it then defends with confabulation.

    Nov 2026
  3. 3Image generators benefit from naming subjects, not elaborate written plans

    A think block in image generation models acts as a specification of what to draw, not as a plan that is carried out.

    Nov 2026

Who is working on it

Stanford University 2

The papers

Most central to this idea first, not most recent.

Concepts are extracted from each paper and reused across the corpus, so this page grows on its own as the desk reads.