Explicit goal grounding helps navigation agents stop at objects

A two-model system that separately identifies visible goals and estimates their distance achieved state-of-the-art success across six simulated navigation benchmarks.

Big Tech
Xinhao Liu · Yunsheng Tian · Yuheng Qiu · Pieter Abbeel · Xi Chen · Guanya Shi · +1 more

Amazon FAR · New York University · UC Berkeley · Carnegie Mellon University

Research Digest··3 min read
Liu and colleagues diagnose a specific weakness in vision-language navigation policies: agents frequently find the requested object but fail to recognize when they should stop.

The authors studied object-goal navigation, in which an agent must locate an instance of a named category in an unfamiliar indoor environment.

§

Research Digest

Written by Alwyn Sage, research editor. Plate by Ollie Flash, picture desk.

first published 19 Oct, 5:30 pm
Meet the newsroomHow we workSubscribe