Microsoft’s Copilot Vision assistant can now browse the web with you

Microsoft’s Copilot Vision feature is now available for users to test in a limited preview.

Built natively into Microsoft’s Edge browser, Copilot Vision analyzes and understands the contents of web pages you visit. You can then ask the AI assistant for information and guidance about what appears on screen.

“It is a new way to invite AI along with you as you navigate the web, tucked neatly into the bottom of your Edge browser whenever you want to ask for help,” the Copilot team said in a blog post Friday. “It’s almost like having a second set of eyes as you browse, just turn on Copilot Vision to instantly scan, analyze, and offer insights based on what it sees.”

The feature, which is opt-in, will function only on select websites to begin with.

Copilot Vision was announced as part of an overhaul to make the consumer Copilot more of a personal AI assistant. This also included the introduction of Copilot Voice, with four voice options aimed at enabling more natural interactions.

“Increasingly, generative AI assistants are becoming multi-modal (language, vision and voice) and have personalities that can be configured by the consumers,” Jason Wong, distinguished vice president analyst at Gartner, said about the Copilot redesign at the time. “We will see even more anthropomorphism of AI in the coming year.”

Copilot Vision is rolling out to a limited number of Copilot Pro customers in the US via Copilot Labs. Copilot Pro costs $20 per month.

:story: Computerworld