Ray-Ban Meta smart glasses from Meta become several new AI-based upgradesincluding the ability to have an ongoing conversation with Meta’s AI and translate between languages.
Ray-Ban Meta owners participating in the Meta Early Access program for the US and Canada can now download firmware v11, which adds “Live AI”. First revealed this fall, Live AI allows users to continuously converse with Meta’s AI assistant, Meta AI, to reference items they discussed earlier in the conversation. Without having to say the wake word “Hey, Meta,” users can interrupt Meta AI to ask follow-up questions or change the subject.
Live AI also works with real-time video. Users can ask questions about what they see in real time, such as what’s happening in their neighborhood.
Real-time AI video for Ray-Ban Meta was a big focus of Meta’s Connect developer conference earlier this fall. Positioned as a response to OpenAI challenges Advanced voice mode with vision and that of Google Astra Projectthe technology allows Meta’s AI to answer questions about what is visible through the glasses’ front camera.
With Monday’s update, Meta becomes one of the first tech giants to bring real-time AI video to market on smart glasses. Google recently announced plans to sell AR glasses with similar capabilities, but the company has not committed to a concrete timeline.
Meta claims that in the future, live AI will even give “helpful suggestions” before the user asks. What kind of suggestions? The company wouldn’t say.
Firmware v11 also introduces Live Translation, which allows Ray-Ban Meta wearers to translate speech in real time between English and Spanish, French or Italian. When a wearer speaks to someone who speaks one of these languages, they hear what the speaker says in English through the glasses’ open-ear speakers and get a transcription on their paired phone.
Ray-Ban Meta also supports Shazam starting with firmware v11. Wearers can say “Hey, Meta, Shazam this song” to have the glasses try to find the tune being played.
Meta warns that new features, particularly live AI and live translation, might not always get it right. “We continue to learn what works best and improve everyone’s experience,” the company wrote in a statement. blog post.
Ray-Ban Meta last received a major update in Novemberwhen Meta began rolling out some AI capabilities to eyewear users in France, Italy and Spain. Glasses continue to sell quite well; in October, EssilorLuxottica, owner of Ray-Ban said Download VR showing that Ray-Ban Meta was the best-selling eyewear brand in 60% of all Ray-Ban stores in Europe, the Middle East and Africa.
