Microsoft announced several new Copilot AI features, including Gemini Live-like Copilot Voice and deeper integration into the Edge web browser. The company also introduced experimental features for Copilot AI, allowing the chatbot to understand what’s on your screen (contextual on-screen understanding) and providing better reasoning for more complex queries.
The new Copilot experience is rolling out to iOS and Android, as well as Windows and Copilot on the web. Additionally, Copilot is now available on Meta’s WhatsApp instant messaging platform. Users can access Copilot in WhatsApp through the Microsoft website: Microsoft Copilot on WhatsApp.
Microsoft Copilot: What’s new
Co-pilot’s voice: Microsoft is rolling out four voice options for the Copilot AI chatbot. The new voice feature allows users to engage in more natural conversations with Copilot AI, allowing them to brainstorm ideas, ask questions, or hold lengthy discussions. According to the preview presented by Microsoft, the feature resembles Google Gemini Live and the ChatGPT advanced voice mode.
The feature currently only works in English and is available in select regions, including the US, UK, Canada, and Australia.
Daily co-pilot: The new Copilot Daily feature will provide news and weather summaries, presented using the preferred Copilot voice. Microsoft said this feature will only provide data from authorized content providers and partner platforms, such as Reuters, Financial Times, Hearst Magazines, etc. Additionally, Copilot Daily will soon include options such as reminders.
The feature is initially rolling out in the US and UK, with plans to expand to more regions.
Discover: Copilot will introduce a new Discover section where personalized ideas will be presented in card form. Microsoft noted that these cards will serve as conversation starters with the AI chatbot. For example, the Discover section will have cards on skills you could learn, topics that might interest you, and much more.
Copilot in Microsoft Edge: Microsoft has further integrated Copilot AI into its Edge web browser. Users will be able to use the AI chatbot to summarize page content, translate text, or rewrite sentences, all within the browser. Users can also type “@copilot” in the address bar to access the AI chatbot in Edge.
Co-pilot vision: Currently available as an optional experimental feature in Copilot Labs, Copilot Vision can understand elements of the web page you are viewing, including images and text. Users can receive real-time responses to queries based on what is displayed on their device. Microsoft said that Vision currently only works with certain websites and will not work on paid or sensitive content.
This feature is available in the United States for certain Copilot Pro subscribers in Copilot Labs.
Think deeper: Similar to Copilot Vision, Think Deeper is an experimental feature available in Copilot Labs. This feature allows the AI chatbot to reason about more complex requests. Microsoft said that with the Think Deeper feature, the AI chatbot will take longer than usual to answer questions and will be able to make suggestions and offer comparisons between two options.
Think Deeper is available to Copilot Pro users in Australia, Canada, New Zealand, United Kingdom, and United States in Copilot Labs.
First publication: October 2, 2024 | 10:56 a.m. STI
