Windows 11 test adds AI file search in Copilot app with natural-language queries
Sources: https://www.theverge.com/news/762788/windows-11-test-brings-ai-file-search-to-the-copilot-app, theverge.com
TL;DR
- A Windows 11 test brings AI-powered file and image search to the Copilot app, available to Windows Insiders on Copilot Plus PCs.
- Users can describe what they’re looking for in natural language, beyond basic name, last opened, or file type filters.
- Copilot Vision helps with guided help sessions and can scan your screen to guide you through apps in real time.
- You can upload a recent photo to Copilot and ask the AI for more information about it; the features are rolling out via the Microsoft Store across Insider channels.
Context and background
Microsoft has been expanding AI-assisted capabilities within Windows 11 through its Copilot suite. Earlier this year, Microsoft launched AI-powered Windows search on Copilot Plus PCs, enabling users to search for files using AI-driven queries. The current test extends those capabilities by enabling natural-language descriptions to locate files and images directly from the Copilot app. In addition to search enhancements, Microsoft is experimenting with a new Copilot home experience that surfaces your recent apps, files, and conversations. These developments are part of broader efforts to integrate Copilot more deeply into everyday Windows workflows. The test is being rolled out to Windows Insiders on Copilot Plus PCs and is part of ongoing experiments reported by The Verge.
This article references the ongoing testing and rollout and draws on the reporting from The Verge The Verge.
What’s new
The core enhancement in this Windows 11 test is the ability to search for files and images using descriptive language inside the Copilot app, rather than relying solely on file name, last opened date, or file type. For example, a user can type a query like “find the file with the chicken tostada recipe,” and Copilot will attempt to locate it using the AI model’s understanding of content and context. Compared to prior capabilities, where search was limited to explicit metadata, this update introduces a more flexible, language-based search experience. The update is currently rolling out to Windows Insiders on Copilot Plus PCs and is being distributed across all Insider channels via the Microsoft Store. | Search parameter | Capabilities
| --- |
|---|
| Name; last opened; file type |
| Descriptive prompts |
| In addition to improved search, Microsoft is testing a new Copilot home experience that surfaces recent apps, files, and conversations. If you select an app within the “get guided help” section, Copilot will automatically start a Vision session, where it scans everything on your screen and guides you through an app. The company also enables users to upload a recent photo to Copilot by selecting it from the left side of the screen and asking the AI for more information about it. |
| This broader set of features demonstrates how Copilot is increasingly integrated into Windows 11 workflows, combining natural-language AI search with on-screen guidance and media analysis capabilities. The rollout is described as spanning all Insider channels via the Microsoft Store, indicating a phased but wide distribution strategy. |
Why it matters (impact for developers/enterprises)
- Productivity gains: Natural-language file and image search in Copilot can reduce the number of steps required to locate assets, especially for users who remember content or context rather than exact filenames. This can streamline workflows for knowledge workers, designers, developers, and IT staff who regularly hunt for documents or media within enterprise environments.
- Enhanced app guidance: The Vision-based guided help sessions can simplify onboarding and in-app workflows, potentially reducing training time and support costs for enterprises leveraging Copilot as a help assistant inside Windows 11.
- Better content governance: By integrating image and document understanding into search, organizations may gain more intuitive discovery across a workforce’s files and media, aligning with broader AI-assisted productivity initiatives.
- Rollout strategy: The staged distribution through Insider channels and the Microsoft Store suggests an evolving approach to testing new Copilot capabilities with real users before wider deployment.
Technical details or Implementation
- Previous capabilities: Copilot search in Windows 11 allowed queries by file name, last opened timestamp, and file type.
- New capability: Descriptive, natural-language prompts to locate files and images directly within Copilot.
- Guided help and Vision: Selecting an app in the Copilot “get guided help” area launches a Vision session that scans the screen and provides guidance for using the app.
- Photo upload: Users can upload a recent photo to Copilot from the left side of the screen and ask the AI for more information about it.
- Distribution: Features are rolling out across all Insider channels via the Microsoft Store.
- Source of reporting: The Verge covered the test and rollout details.
Key takeaways
- AI-driven, natural-language file and image search is being tested in Windows 11 via Copilot.
- The feature expands beyond metadata-based search to descriptive queries, potentially improving asset discovery.
- Copilot Vision adds on-screen guidance for app usage and can analyze screen content during guided sessions.
- Users can upload photos to Copilot for analysis and information.
- Rollout is through Windows Insider builds on Copilot Plus PCs and across Insider channels via the Microsoft Store.
FAQ
-
What is Copilot Vision in this context?
It refers to a Vision session that scans everything on the screen and guides you through an app during a guided-help interaction.
-
How can I search for files using this update?
You can describe what you’re looking for in natural language, such as a description of the content, rather than only using name or type.
-
Can I search images as well as files?
Yes, the update enables AI-powered search through files and images directly from the Copilot app.
-
How is this rollout being delivered?
The features are rolling out to Windows Insiders on Copilot Plus PCs and across all Insider channels via the Microsoft Store.
References
- The Verge: Windows 11 test brings AI file search to the Copilot app. https://www.theverge.com/news/762788/windows-11-test-brings-ai-file-search-to-the-copilot-app
More news
First look at the Google Home app powered by Gemini
The Verge reports Google is updating the Google Home app to bring Gemini features, including an Ask Home search bar, a redesigned UI, and Gemini-driven controls for the home.
Meta’s failed Live AI smart glasses demos had nothing to do with Wi‑Fi, CTO explains
Meta’s live demos of Ray-Ban smart glasses with Live AI faced embarrassing failures. CTO Andrew Bosworth explains the causes, including self-inflicted traffic and a rare video-call bug, and notes the bug is fixed.
OpenAI reportedly developing smart speaker, glasses, voice recorder, and pin with Jony Ive
OpenAI is reportedly exploring a family of AI devices with Apple's former design chief Jony Ive, including a screen-free smart speaker, smart glasses, a voice recorder, and a wearable pin, with release targeted for late 2026 or early 2027. The Information cites sources with direct knowledge.
Shadow Leak shows how ChatGPT agents can exfiltrate Gmail data via prompt injection
Security researchers demonstrated a prompt-injection attack called Shadow Leak that leveraged ChatGPT’s Deep Research to covertly extract data from a Gmail inbox. OpenAI patched the flaw; the case highlights risks of agentic AI.
Predict Extreme Weather in Minutes Without a Supercomputer: Huge Ensembles (HENS)
NVIDIA and Berkeley Lab unveil Huge Ensembles (HENS), an open-source AI tool that forecasts low-likelihood, high-impact weather events using 27,000 years of data, with ready-to-run options.
Scaleway Joins Hugging Face Inference Providers for Serverless, Low-Latency Inference
Scaleway is now a supported Inference Provider on the Hugging Face Hub, enabling serverless inference directly on model pages with JS and Python SDKs. Access popular open-weight models and enjoy scalable, low-latency AI workflows.