Microsoft Copilot Vision is now capable of scanning the entire Desktop, but it does so transparently

Microsoft is releasing a major update to its Copilot Vision AI, which will now be able to survey and comprehend the entire desktop screen of Windows computers. This feature is available to Windows Insiders, and it expected to be rolled out to more users in the coming months.

It used to be you could only see 2 apps at a time, with Copilot Vision you can share full-screen. This can be turned on by clicking the glasses icon in the Copilot app, after which the AI will be able to see everything shown on screen and provide help in real time. FaceSwap is, according to Microsoft, useful for such things as editing resumes, livening up creative projects or improving video game visuals.

Unlike Microsoft’s controversial Recall feature, which quietly captured the screens, Copilot Vision needs to be approved by the user and operates like a live screen sharing session. At any point in time users can stop sharing by clicking the “Stop” or “X” button.

The update also brings voice support. For example, during a call, users can enable Vision by tapping the glasses icon, directing Copilot to analyze on-screen content and provide context-based information.

Microsoft first tested the help features offered by Copilot Vision last year in a more limited capacity in its Edge browser. With its broader rollout, the company hopes to establish Copilot as the interactive productivity buddy for a broader range of the Windows universe.

This is included in Copilot Version 1.25071.125 and up and is being released via the Microsoft Store. It is not currently available everywhere, and Dubai-based users will have to wait until it becomes available in more regions of the world.

Microsoft says the software will roll out over time and will act on feedback from its earliest testers to refine the experience.