Copilot on Home windows 11 is testing OS-level integration that might permit you to share your favorite apps’ display screen with Copilot.
This characteristic is rolling out to Home windows Insiders in the USA, and it would sound like a creepy concept as a result of it mainly means Copilot can see what you might be doing in your display screen—should you select to share it with the AI app.
Nonetheless, Microsoft says the mixing has some good use circumstances.
For instance, you would possibly need to share your display screen with Copilot Imaginative and prescient as a result of it could aid you navigate the app should you’re battling it.
Supply: BleepingComputer
Whenever you share your display screen with AI, Copilot can then assist analyze, supply insights, reply your questions, and communicate to you in actual time.
For those who’re within the Settings app and unable to discover a particular possibility, Copilot Imaginative and prescient can present you the place to find that individual toggle in actual time.
It is unclear how Copilot Imaginative and prescient processes your display screen knowledge, however bear in mind it is cloud-based, and Microsoft isn’t counting on native AI fashions for this integration.
For those who’re a Home windows Insider, you possibly can do that characteristic by clicking the glasses icon within the Copilot app, deciding on the browser or app you need to share the display screen with, after which asking Copilot that will help you out.
You’ll be able to cease sharing your display screen by clicking the Cease button or ‘X’ within the Copilot app.
Copilot’s File Search
The second new characteristic is known as “File Search”, which lets you discover a specific file in your machine and ask questions on its contents.
You should use on a regular basis language to ask Copilot questions like “Can you discover my resume?” and Copilot will discover the resume.docx for you by scanning your PC’s storage.
In a weblog publish, Microsoft famous that Copilot on Home windows 11 can already learn .docx, .xlsx, .pptx, .txt, .pdf, and .json recordsdata.
Supply: BleepingComputer
In the mean time, Copilot Imaginative and prescient (display screen share) and File Search options are steadily rolling out within the Home windows Insider Program.
As I discussed on the outset, Microsoft hasn’t clarified how the information is being processed or encrypted, however we’ll possible study extra in regards to the privateness insurance policies when the characteristic exits the testing program.
Primarily based on an evaluation of 14M malicious actions, uncover the highest 10 MITRE ATT&CK strategies behind 93% of assaults and how you can defend towards them.
