Visually Grounded Reasoning
Methods that ground language model reasoning steps in corresponding image regions to improve visual reasoning performance.
24 papers
Where this stands
The written synthesis of this thread is for subscribers. Subscribe.
Results across this thread
2 reported results from the papers in this thread.
The table is for subscribers. Subscribe to see every reported number side by side.
How this thread developed
Oct 2026 · National University of Singapore, A*STAR Institute of Advanced Intelligence and Computing, Singapore
Probability rewards keep visual grounding reasoning aligned with predicted objects
Applies reinforcement learning with probability-based rewards to keep visual intention grounding chains aligned with the predicted object, mitigating thinking drift.
Oct 2026 · NVIDIA Research, The Hebrew University of Jerusalem
Self-grounded attention improves visual reasoning across diverse benchmarks
grounds reasoning steps in image regions via self-saliency to improve visual reasoning across benchmarks
Oct 2026
Parallel diffusion decoding rivals autoregressive visual grounding at 4B scale
Shows diffusion-based decoding can rival autoregressive grounding, broadening grounding model architectures.
Oct 2026
Grounding foundation model surpasses larger vision-language models on precise perception and robotics
Introduces a compact grounding model that outputs quantized coordinates, advancing precise visual grounding for downstream reasoning.
2 further papers
Oct 2026 · Peking University, The University of Melbourne
Training video models across counterfactual views improves evidence-grounded answers
Uses counterfactual video clips to improve evidence-grounded QA reasoning in video models.
1 further paper
Oct 2026 · University of Southern California, University of California San Diego
Multimodal models can learn when impossible image edits require refusal
Tests whether multimodal models can recognize impossible editing requests by grounding refusal in visual constraints, extending visually grounded reasoning to a refusal decision task.
1 further paper
Oct 2026 · University of California, Berkeley, Quotr AI
Theory and experiments show when splitting large images into views helps VLMs find small objects
provides theory for when multi-view splitting improves small object detection in VLMs.
released code
3 further papers
Oct 2026 · Northwestern University, Carnegie Mellon University
Shared visual transition training improves multimodal LLMs across diverse tasks
Proposes a visual transition reasoning training source and benchmark that improves multimodal LLM performance on diverse tasks.
2 further papers
Oct 2026 · Ant Group, Tsinghua University
Benchmark and agent for verifying images against real-world facts
Introduces a benchmark and agent for verifying images against factual real-world knowledge, grounding reasoning in image regions.
5 further papers
Oct 2026 · York University, Macquarie University
Learned attention adaptation improves language-guided video object segmentation
Introduces an adapter for language-guided video object segmentation, grounding language in video regions without full model fine-tuning.
10 of 24 papers shown