Research · Agents
Draft-KV ensures the receiver actually uses the sender's latent message
Draft-KV: Learning Useful Latent Communication Between Language Models
By sending key-value states from the sharer's draft, a lightweight interface boosts a 0.5B receiver to 78% on MMLU-Redux, and message-replacement tests confirm the gain comes from genuine information use.
MMLU-Redux: 36.4% accuracy (as reported)
City University of Hong Kong, University of Science and Technology of China, University of Electronic Science and Technology of China