Current can see multiple images but often simply process them separately, not realizing objects exist across views. Standard tests accidentally hide this failure by allowing correct answers from single-view guesses.
Researchers built OneScene-Bench using real-world scenes. By precisely controlling object overlap and introducing hidden scene edits, the forces models to link objects across views and detect physical contradictions to succeed.
Top models failed dramatically. Accuracy on counting unique objects collapsed when integration was forced. Many models were no better than a coin flip at detecting scene edits. This means reliable autonomous systems and robots cannot currently rely on VLMs for multi-view understanding without explicit safeguards.
