Robots struggle to navigate real-world environments like forests and mountains because they need both smart decision-making, such as knowing to stay on a trail, and fast physical control to handle uneven ground. Current systems often fail because they lack common-sense understanding of what is safe or dangerous.
ROAM is a system that solves this by using a , a type of AI that can understand images and text using knowledge learned from the internet, to interpret the scene and assign risks to different areas. This risk map then guides two separate reinforcement-learning policies, which are AI controllers trained in simulation, to handle agile movement and local navigation.
The robot completed kilometer-long hikes with minimal human help, correctly interpreting signs and avoiding hazards like lakes. This shows that combining high-level reasoning with learned control is a promising path toward reliable outdoor robots.
