AI models that watch videos usually focus on just the pictures, often missing important sounds like a dog barking or glass breaking. Figuring out what's happening in a video requires combining both what you see and what you hear, but most open-source models struggle with this. This paper presents WeMM-Video, a family of models that process text, images, audio, and video together to understand videos more completely. They can answer quickly or reason step-by-step to avoid mistakes.
The models were trained on about 1.2 trillion tokens of multimodal data and tested on over 120 benchmarks. The largest model, WeMM-Video-35B-A3B, outperformed all other open-source models by a substantial margin, surpassing proprietary models like Qwen3.5-Omni-Flash and Seed2.0-Mini-0428 and nearly matching Gemini-3.0-Flash. This matters because it makes powerful video understanding accessible to everyone, enabling better tools for analyzing videos in areas like content moderation, healthcare, and autonomous systems, all without relying on closed commercial APIs.
