Context Language Models treat an LM’s live context as a writable file. The model can append, remove, reorganize, or otherwise edit that file, deciding for itself what information should remain available. Multiple context files can support multi-agent workloads.
Built zero-shot from existing models, CLMs improved accuracy or scores while using fewer FLOPs on BrowseComp-Plus and EdgeBench, and produced greater improvement at equal compute in a multi-repository agent-swarm task. Context-management behavior could also be optimized through natural-language or online reinforcement learning.
Because arbitrary edits disrupt conventional prefix caching, the work also introduces Suffix Cache Reuse. This reduced server-side compute by 35% relative to standard SGLang at matched performance.