Using controlled generation, the authors manipulated n-gram exposure of action-related phrases while holding interaction state and action relevance fixed.
Visual skill representations reduce exposure-driven action bias in language model agents
The same procedural content, shown as text versus as an image, leads to measurable differences in action preference and downstream agent success.
Chinese Tech
Qing Yang · Yuqi Xiong · Pengcheng Huang · Zhipeng Xu · Zhenghao Liu · Zulong Chen · +2 more
Northeastern University · Alibaba Group
Research Digest··2 min read
The authors identify Procedural Exposure Bias (PEB): increasing the exposure frequency of an action pattern in a skill shifts a language model's action preference even when state and relevance are unchanged.
§