Video-question systems may repeatedly reread stored information from every frame while composing an answer, making long videos costly to process. A (VLM) combines video or images with text; its key-value (KV) cache is stored video information the model can consult while generating an answer.
LookAway has the model write notes marked with when relevant events happen, then hides the video cache so the model must answer from its notes. The team also trains a version to stop consulting the video sooner, rewarding correct answers and fewer cache reads.
On the tested model, notes nearly preserve full-video accuracy at 0.12–0.13 times the estimated answer-generation cost. After training, the model reads only 27–35% as many cached video positions while matching accuracy on held-out tests.
