The authors first demonstrated the 'information-use gap' by auditing five existing latent communication methods: for each, they replaced the sender's message with one from an unrelated question and measured the change in receiver accuracy.
Draft-KV ensures the receiver actually uses the sender's latent message
By sending key-value states from the sharer's draft, a lightweight interface boosts a 0.5B receiver to 78% on MMLU-Redux, and message-replacement tests confirm the gain comes from genuine information use.
Chinese Tech
Linquan Wu · Shichang Meng · Tianxiang Jiang · Haoyu Yang · Peng Zhong · Fengming Zhu · +4 more
City University of Hong Kong · University of Science and Technology of China · University of Electronic Science and Technology of China · AIPD, Tencent · Theory Lab, Huawei
Research Digest··3 min read
The authors identify a fundamental flaw in prior latent communication methods: replacing the sent message with one from an unrelated question barely changes accuracy, meaning the receiver relies on the interface, not the message content.
Why this paper
From AIPD, Tencent and 5 others
In one line
Draft-KV lets a frozen small language model use question-specific latent states from a larger model, producing gains that disappear when messages are reassigned.
What we could check
- ·No code link found
- ·No weights link found
- ·No dataset link found
- ·No compute details found
- ·No stated limitations found
- ✓Reports numbers on named benchmarks
Observed from the paper text and links we have. Absence here means we did not find it, not that it does not exist.
§