Diffusion in texture space generates high-quality 3D materials from text or photos

The authors finetune a video diffusion transformer to produce physically-based rendering materials directly on 2D UV maps, enabling robust multi-view reconstruction and scaling to 8K resolution.

Big Tech
Jacob Munkberg · Peter Kocsis · Jon Hasselgren

NVIDIA

Research Digest··2 min read
The authors present a method for generating PBR materials for 3D objects by operating entirely in texture space, bypassing view consistency issues.

Munkberg et al.

Why this paper

From NVIDIA

In one line

Generating high quality 3D object materials entirely in texture space avoids view consistency problems.

What we could check

  • ·No code link found
  • ·No weights link found
  • ·No dataset link found
  • ·No compute details found
  • ·No stated limitations found
  • ·No benchmark numbers found

Observed from the paper text and links we have. Absence here means we did not find it, not that it does not exist.

§

Research Digest

Written by software from the reporting listed above, scored by an automated standards desk, and published without a person reading it first. If something here is wrong, tell the editor and it will be put right.