The authors compared model responses to the same decision tasks with and without added passages.
Irrelevant context can substantially steer language model decisions
Controlled comparisons show that passive exposure changes model choices, including compliance with user requirements and judgments of false claims.
Academic
Yuxiang Zheng · Lin Tian · Marian-Andrei Rizoiu
Behavioral Data Science Lab · University of Technology Sydney
Research Digest··2 min read
Zheng, Tian and Rizoiu tested whether adding external content changes LLM decisions when that content supplies no valid reason to revise the answer.
Why this paper
From Behavioral Data Science Lab and University of Technology Sydney
In one line
Passive context exposure shifts LLM decisions even when the extra content is irrelevant, sometimes by nearly 50 percentage points, and can increase errors.
What we could check
- ·No code link found
- ·No weights link found
- ·No dataset link found
- ·No compute details found
- ·No stated limitations found
- ·No benchmark numbers found
Observed from the paper text and links we have. Absence here means we did not find it, not that it does not exist.
§