During the event, Jacob Andreou, Microsoft's EVP of Copilot, demonstrated the new capabilities through a video. The demo showed Microsoft's Autopilot tool being asked to help with filing taxes. Andreou told the AI agent that he received an email from his accountant and requested Autopilot to retrieve the necessary information for her. The upgrade represents a significant expansion of Copilot's role in Windows, moving from a chat-based assistant to an agent that can interact with personal files and system functions. Microsoft has not yet announced a specific release date for the feature.
Microsoft upgrades Copilot with local file access and OS control under 'Hybrid Intelligence'
Demo shows Autopilot agent handling tax filing tasks using local and cloud AI models
By LineZotpaper
Published
Read Time1 min
Microsoft announced at its Windows and Surface event that its Copilot AI system will gain access to local files on users' PCs and the ability to perform actions across the operating system. The company is framing the upgrade as part of a broader concept called 'Hybrid Intelligence,' where apps and tools blend local and cloud AI models to accomplish tasks efficiently.
§
Analysis
Why This Matters
- Users may gain a more capable personal assistant that can automate tasks like document retrieval and form filling directly from the operating system.
- The shift to local file access raises privacy concerns about how much control AI agents will have over personal data.
- This move positions Microsoft to compete with other AI assistants from Apple and Google by offering deeper system integration.
Background
Microsoft has been steadily integrating its Copilot AI into Windows since early 2024. The new 'Hybrid Intelligence' concept aims to balance speed and privacy by processing sensitive data locally while offloading complex tasks to the cloud. The demo focused on productivity scenarios, such as tax preparation, which require access to local documents.
Key Perspectives
Microsoft: The company sees Hybrid Intelligence as a way to make AI assistants more useful and responsive. By keeping some processing on the device, it addresses latency and privacy concerns. Privacy advocates: They are likely to question the extent of file access granted to an AI agent, especially if it can manipulate data without explicit user permission. Competitors: Apple and Google are pursuing similar on-device AI strategies, but Microsoft's deep Windows integration could give it a unique advantage in the PC market.
What to Watch
- The rollout timeline and whether the feature will be available to all Windows users or limited to specific hardware.
- Any privacy or security features Microsoft implements to control how Copilot accesses files.
- How effectively the hybrid model performs in real-world scenarios compared to cloud-only assistants.