EgoHand achieves state-of-the-art monocular 3D hand reconstruction from egocentric video

Chen et al. demonstrate a model that generalizes to unseen benchmarks in zero-shot evaluation, runs at real-time speed, and is preferred by users over existing methods in a blinded study.

Independent
Chao-Yeh Chen · Tiffany Chen · Lin Duan · Tianyi Hu · Yu-Hsiang Huang · Umar Iqbal · +9 more
Research Digest··2 min read
Chen et al.

The authors adopt SOMA-Hand with an MHR shape backend as a parametric hand representation and process 2D hand crops with a transformer encoder.

§