CrossEdit is a unified model for editing images, audio, and video from free-form instructions. It learns complex instruction following from procedurally generated audio-editing pairs, then transfers that capability across modalities using self-supervised audiovisual masked reconstruction and curated cross-modal tasks.
The model edits audiovisual movie scenes without direct training on that task. It outperformed cascaded, sampling-based, agentic, and state-of-the-art end-to-end alternatives while maintaining or improving results on lip-synced speech, image, video, and audio editing tasks. CrossEditBench and the AV-FES metric were introduced to evaluate whether edits follow instructions while preserving consistency.