Stereo module lifts 2D vision-language-action models to 3D for robot manipulation

ExStereo uses stereo pairs and an explicit 3D representation to improve robotic manipulation success rates in simulation and the real world.

Academic
I-Chun Arthur Liu · Jason Chen · Gaurav S. Sukhatme · Daniel Seita

University of Southern California

Research Digest··3 min read
The authors introduce ExStereo, a stereo module that adds 3D perception to pre-trained 2D Vision-Language-Action (VLA) models.

The authors developed ExStereo, a module that processes stereo image pairs through a pre-trained stereo foundation model to recover disparity and metric depth.

Why this paper

From University of Southern California

In one line

ExStereo augments pre-trained 2D Vision-Language-Action models with 3D perception using stereo vision, improving robotic manipulation success rates.

What we could check

  • ·No code link found
  • ·No weights link found
  • ·No dataset link found
  • ·No compute details found
  • ·No stated limitations found
  • ✓Reports numbers on named benchmarks (2 benchmarks)

Observed from the paper text and links we have. Absence here means we did not find it, not that it does not exist.

§

Research Digest

Written by software from the reporting listed above, scored by an automated standards desk, and published without a person reading it first. If something here is wrong, tell the editor and it will be put right.