Meta Brings AI Assistant, AI Vision to Some Quest Headsets

Meta Platforms is bringing its Meta AI assistant to Quest 3 headsets in the U.S. and Canada. As part of the company’s ongoing collaboration with Microsoft, Quest 3’s Horizon OS will also get access to real-time information courtesy of Bing search. The update will also bring Meta AI with Vision — already integrated with the Ray-Ban Meta smart glasses — to Horizon OS, initially just in passthrough mode. “These changes will begin rolling out in the U.S. and Canada in experimental mode next month — and we’ll continue to improve the experience over time,” Meta explains.

Quest 3 users “will be able to ask the AI any questions through voice prompts and can include the visual surroundings as part of the conversation,” reports ReadWrite, adding that this is the same artificial intelligence that Meta has already integrated its other services, including Instagram, Facebook and WhatsApp, as well as the Ray-Ban Meta glasses.

In a blog post, Meta offers examples like taking time out from gaming to get wardrobe advice from Quest 3, listening to music on the headset while studying and querying on aspects of Shakespeare, or watching YouTube travel videos on the mixed reality device and asking it for advice packing for a trip.

“Large language models are enabling powerful virtual assistants that become even more useful when embedded within wearable devices,” the blog post notes, adding that “recent innovation in generative AI has helped to accelerate key pieces of our vision for the next great wave of human-oriented computing.”

PhoneArena says Meta AI is coming to the Meta Quest 3 and Quest 2, not earlier versions. Meta AI with Vision will not be available on Meta Quest 2 (which is VR, without AR passthrough).

The company will be deprecating its existing voice commands in favor of AI assistance, it says, with details to come on that.

The move to bring AI to the Meta Quest platform comes as Apple reportedly prepares to introduce Apple Intelligence, including to its Vision Pro headset. The Apple Vision Pro AI upgrade is not expected to happen until 2025, according to CNET, following an anticipated fall AI integration with some iPhone models, prompting PhoneArena to write that “Meta Quest beats Vision Pro to the punch.”

No Comments Yet

You can be the first to comment!

Leave a comment

You must be logged in to post a comment.