OmniSeek turns an omni-modal language model into an agent that repeatedly decides whether to inspect audio or video and which time window to retrieve. Each selected raw segment is added to the context for the next reasoning step, rather than encoding the entire sequence only once.
Training starts with OmniTraj-170K, a synthetic corpus of multi-hop trajectories containing interleaved audio and visual evidence, followed by two-stage . An Audio-Visual Necessity objective rewards successful reasoning that actually depends on both modalities. The reported experiments show consistent improvements across audio-visual benchmarks, but the supplied text provides no scores or comparison sizes.