A zero-shot pipeline that turns monocular 360° video generators into stereoscopic ones

By warping depth to produce the second eye and using a geometric reward for fine-tuning, the method outputs 4K stereoscopic 360° videos without any stereo training data.

Academic
Debabrata Mandal · Dongdong Fu · Jonathon Miller · William Villareal · Xi Peng · Praneeth Chakravarthula

UNC Chapel Hill · Dolby Laboratories

Research Digest··3 min read
The authors present EPIC, a zero-shot method to generate stereoscopic 360° videos from existing monocular panoramic video diffusion models.

The authors start with a frozen monocular panoramic video diffusion model (a latent diffusion transformer trained on Internet data).

Why this paper

From UNC Chapel Hill and Dolby Laboratories

In one line

A zero-shot pipeline generates 4K stereoscopic 360° video from monocular panoramic video by enforcing epipolar consistency.

What we could check

  • ·No code link found
  • ·No weights link found
  • ·No dataset link found
  • ·No compute details found
  • ✓Limitations stated by the authors (2 noted)
  • ·No benchmark numbers found

Observed from the paper text and links we have. Absence here means we did not find it, not that it does not exist.

§

Research Digest

Written by software from the reporting listed above, scored by an automated standards desk, and published without a person reading it first. If something here is wrong, tell the editor and it will be put right.