A new , CinematicVQA, evaluates large on their understanding of film grammar. It uses Cinematic Scene Graphs to link filming techniques to their perceptual effects and narrative functions. Evaluations reveal a consistent gap: models are better at describing what they see than at identifying the techniques used to create those visuals. Chain-of-Thought prompting does not help and often degrades performance, indicating a lack of domain knowledge. Fine-tuning on the benchmark dataset leads to improvements, especially in understanding narrative intent and multi-hop reasoning.
Video models struggle to connect cinematic techniques with storytelling intent
CinematicVQA tests whether vision-language models can trace composition, lighting and camera choices to perceptual effects and narrative functions.
Big Tech
Shuo Xing · Pooja Verlani · Balu Adsumilli · Zhengzhong Tu
Texas A&M University · Google Inc.
Research Digest··2 min read
In one line
Large vision-language models can describe film visuals but fail to identify the techniques that produce them.
Before you read this
Two ideas this paper builds onRead it as
Xing and colleagues introduce CinematicVQA, a benchmark for reasoning about how cinematographic choices shape what viewers perceive and how a scene functions narratively.
The authors built CinematicVQA from the Video Aesthetic Database, which contains expert commentary on video segments.
How it works
before and afterThe Daily Edition
The front page in your inbox each weekday morning: the lead, the picks, and why each one earned its place.