ActionLens is a diagnostic of 6,701 multiple-choice video questions that tests five aspects of spatial-temporal binding. The benchmark covers transition detection, actor disambiguation, concurrent action binding, interaction reasoning, and gaze detection.
Evaluating 20 , the best scores 68.8%, far below the 91.0% human accuracy on the reviewed subset. Models perform near random on gaze detection (human accuracy 89.6%) and as low as 34% on actor disambiguation, revealing specific failure modes. Using visual bounding boxes to specify actors outperforms relational descriptions or numeric coordinates by 1.15–6.50 points.
These targeted diagnostics expose capabilities missing from current video benchmarks, which often score above 80% without requiring precise actor-action binding.