This paper introduces a causal taxonomy to distinguish between language-model outputs that appear deceptive and the mechanisms that actually produce them. The authors identify four common misattributions in deception research: confusing a later report with an earlier commitment, mistaking stochastic output for a model preference, conflating a false preference with the utility of misleading a recipient, and treating functionally deceptive behavior as evidence of an independently emerged deceptive strategy. They test these distinctions in controlled guessing-game and stock-trading experiments using two open-weight model families. The results show that deceptive-looking behavior can arise without a corresponding deceptive mechanism. However, some interventions provide direct evidence that the recipient's information state can causally affect the model's deceptive preference. Even when evidence for a deceptive mechanism exists, the paper argues it does not establish model agency in the deception.
Causal framework distinguishes deceptive outputs from deceptive mechanisms in language models
Experiments show that deceptive-looking behavior can occur without a deceptive internal mechanism, yet recipient information state causally influences deceptive preferences.
Independent
Yakov Pyotr Shkolnikov
Independent Researcher
Research Digest··2 min read
Thread:Agent Security & Attacks
In one line
Deceptive-looking language-model outputs do not necessarily indicate a deceptive internal mechanism.
Read it as
The authors introduce a causal taxonomy to separate deceptive behavior from deceptive mechanisms in language models, testing distinctions across controlled guessing-game and stock-trading experiments.
The authors developed a causal taxonomy distinguishing prior commitment from retrospective report, model preference from realized output, false preference from sensitivity to the utility of misleading, and deceptive behavior from the provenance of the objective or strategy.
The Daily Edition
The front page in your inbox each weekday morning: the lead, the picks, and why each one earned its place.