The authors present Alchemy3D, a framework for controllable 3D asset editing. They construct Alchemy3D-1M, a large-scale dataset of 1.38 million editing pairs spanning seven types (addition, removal, replacement, animation, local appearance, global appearance, and segmentation). They train generative flow models that fuse source and edited target tokens through self-attention, with text or image instructions via cross-attention. They also introduce GEdit3D-Bench, a multi-dimensional built from assets independent of the training data. On existing and new benchmarks, Alchemy3D outperforms prior methods on most metrics of editing fidelity, source preservation, and visual quality. A distilled version runs about 4x faster while retaining comparable quality. This work addresses the scarcity of training data and evaluation protocols for 3D editing, advancing the state of the art.
Large-scale dataset and token-fusion architecture improve 3D asset editing
Alchemy3D provides 1.38 million editing pairs across seven types and a benchmark, outperforming prior methods on fidelity and source preservation.
Top University
Badi Li · Tianxin Huang · Yu Zhou · Wei-Shi Zheng · Yi Ma · Shenghua Gao
The University of Hong Kong · Shenzhen Loop Area Institute · Shanghai Innovation Institute · Sun Yat-Sen University
Research Digest··2 min read
In one line
Alchemy3D achieves better 3D asset editing fidelity, source preservation, and visual quality than prior methods.
Before you read this
Three ideas this paper builds onflow matchingA generative training method that learns an ordinary differential equation mapping noise to data by matching velocity fields along probability paths.175 papers →benchmarkA standard set of tasks or data used to evaluate and compare the performance of AI systems.371 papers →diffusion modelA type of generative model that learns to reverse a gradual noising process to create data.199 papers →
Read it as
The authors present Alchemy3D, a unified framework for 3D asset editing that includes a million-scale dataset, a token-fusion model architecture, and a new benchmark.
Li et al. curated Alchemy3D-1M, a dataset of 1.25 million 3D assets and 1.38 million editing pairs covering seven editing types: addition, removal, replacement, animation, local appearance, global appearance, and segmentation.
How it works
stage by stageThe Daily Edition
The front page in your inbox each weekday morning: the lead, the picks, and why each one earned its place.