A video assistant watching a live feed needs to follow instructions that combine several conditions. For example, if you ask to be told when a pot boils after someone turns on the stove and leaves the kitchen, the assistant must wait until all three events have happened in the right order. Existing systems often trigger the alert too soon because they spot the boiling pot but ignore the earlier requirements.
The authors built a called CoTriggerBench to test this kind of multi-step instruction. They then created an AI agent named TEMPI that first breaks the instruction into a list of necessary events and their timing rules, then monitors the video for each event. As events occur, a memory module records what has been satisfied so decisions about when to notify are based on the full history.
On the benchmark, TEMPI got 44.4% of instructions completely right, both issuing alerts at the correct moment and staying silent when required. This was 15.6 percentage points better than the best existing system. The result shows that correctly recognizing single events is not enough; the system must also track how those events fit together over time.
