AI assistants today can understand text, images, and audio, but real-world tasks often require searching through many different files, like recordings, slides, and documents, to gather and combine information. Current don't test this kind of multi-step work.
Researchers created a benchmark called Omni-Workspace with 380 tasks that require AI agents to explore workspaces, search the web, and produce a final answer. They tested 18 different AI models.
The best model scored only 65.93. Analysis showed two main problems: agents lose track of what they are doing (task-state drift) and their context gets overloaded with raw data (multimodal context inflation). This shows current AI assistants are not yet ready for complex, real-world multi-step tasks.
