When you record a video, editing effects like background blur require a depth map for each frame showing how far objects are. Existing methods force a tradeoff: single-image techniques produce sharp depth maps but are unstable over time, while video methods are stable but smooth over fine details, losing sharp boundaries.
Depth Pro 2 processes both single images and video at full resolution, using a single network trained on clips of 1 to 32 frames. It also includes a lightweight focal length estimator to work with any camera, enabling real-time use.
The method delivers sharp boundaries and temporal consistency together, outperforming prior work in both and in metric accuracy. The smallest model runs at 53 frames per second on 1080p video, making professional depth effects practical on standard hardware.
