The authors propose PixelUMM, an encoder-free unified multimodal model that operates directly on raw pixel inputs.
Encoder-free model unifies image and video understanding and generation in pixel space
PixelUMM uses raw pixels as input via linear projections, eliminating separate visual encoders for different tasks.
Independent
Cong Wei · Xuanchi Ren · Bryan Chu · Weiming Ren · Huan Ling · Jiahui Huang · +5 more
Research Digest··3 min read
The authors present PixelUMM, an encoder-free model that handles both image and video understanding and generation directly in pixel space.
Why this paper
Independent
In one line
PixelUMM unifies image and video understanding and generation in pixel space, delivering comparable performance without pretrained visual encoders or VAE tokenizers.
What we could check
- ·No code link found
- ·No weights link found
- ·No dataset link found
- ·No compute details found
- ✓Limitations stated by the authors (2 noted)
- ·No benchmark numbers found
Observed from the paper text and links we have. Absence here means we did not find it, not that it does not exist.
§