VACE alternates reinforcement learning updates to an agent’s model weights with revisions to its instructions, skills, tool interfaces, and execution rules. Trajectories collected during RL are reused to propose each harness revision, which is evaluated against the incumbent while holding the updated model fixed.
With Qwen3.5-9B, VACE reached 45.26% test accuracy on OfficeQA and 75.19% mean partial credit on AutomationBench. These results exceeded weight-only RL by 6.43 and 9.09 percentage points, and ungated alternation by 4.59 and 6.95 points. Validation rejected 17 of 44 proposed harness changes, showing that trajectory-informed revisions frequently hurt the checkpoint they are intended to support.
The result matters because model weights and agent scaffolding do not improve independently. A harness change affects future training trajectories, while a weight update can make an existing workflow obsolete or counterproductive.