Google is introducing its own twist to headsets and smart glasses with the announcement of Android XR, a new operating system built for augmented reality (XR) devices.

As announced, Google will take full advantage of Gemini AI and work with Samsung and Qualcomm to bring “useful experiences to headsets and glasses” through Android XR. The first device to showcase what it can do is Samsung's Project Moohan, which will be available in 2025.

With Android entering the XR space, Apple Vision Pro and visionOS will face stiff competition.

But what is Android XR and what can it do for a new generation of AI-powered headsets and glasses? Here is everything we know so far about all the questions about Android XR.

Android XR is Google's new operating system for augmented reality devices, including XR headsets and glasses. It extends the giant technology's Android operating system to smartphones, tablets, and TVs.

The operating system is intended to allow developers and device makers to create new XR experiences for headsets and glasses using familiar Android apps and tools. This includes Google's suite of apps such as Google Photos, Google Maps, Google TV, Chrome, and YouTube.

In other words, you can use these apps in a virtual landscape, similar to the mixed reality (MR) experiences offered by Meta Quest 3 and Quest 3S. And, of course, Apple Vision Pro.

As Google has stated, Android XR will allow developers to build apps and games for the device. Initial tools include ARCore, Android Studio, Jetpack Compose, Unity, and OpenXR.

Along with partnering with Samsung to develop the operating system, Google will get support from chipmaker Qualcomm to run these devices. Qualcomm partners such as Sony, Lynx, and XREAL can build their own devices using Android XR.

“Advances in AI are making interaction with computers more natural and conversational,” Google's vice president of XR announced in a blog post. This inflection point will allow new augmented reality (XR) devices like headsets and glasses to understand your intentions and the world around you, helping you get things done in a whole new way.”

It will be a while before we see Android XR in action in headsets, but we are already excited about Android XR in smart glasses.

If you're familiar with the features of the Apple Vision Pro or Meta Quest 3 headsets, imagine the “Google”-like spin Android XR will put on them.

Developers will create different XR experiences based on the Android XR, but we already have a peek at what it could do. For example, the headset can switch from a fully immersive virtual environment to a real world setting.

Like Apple and Meta headsets, they can “fill the space around you” with a variety of apps and content by layering them on top of what you see in the real world and virtual environment.

Google Gemini will also be a highlight. If asked, the AI assistant will be able to tell you what it sees and control your device. Ray-Ban's Meta smart glasses take a similar approach with AI capabilities, and Google is following suit.

And then there are apps. As mentioned above, Google will provide many apps to Android XR devices as is, but in a “reimagined” form. Thus, you can watch YouTube videos and shows on a virtual big screen with Google TV, view Google Photos photos and albums in 3D, and create multiple virtual screens when surfing the web with Google Chrome. In addition, Circle to Search has been added, allowing users to look up anything they see with a “simple gesture” (expected to be a circular motion with a finger).

Another perk is that mobile and tablet apps from the Google Play store will be available for the Android XR headset, and Google has announced that more XR-specific apps, games, and content will be available in the coming year.

As for glasses, Gemini will take the lead role, and Google wants to make AI “one tap away.” “ As expected, Android XR Glass will be able to translate what it sees and hears in real time (as seen in the video above), provide directions to destinations to go to, and display a summary of messages received on the phone.

Google expects Android XR to work “seamlessly” with other Android devices, and since it runs on the same operating system, one can imagine that it will. Like Ray-Ban's Meta glasses, Google hopes to make Android XR “stylish and comfortable glasses that you'll want to wear every day.”

While there is still much to learn about Android XR, we already know what Google's new OS will bring to XR headsets and glasses. We can expect to see more headsets and glasses targeting the Apple Vision Pro and Ray-Ban Meta smart glasses.

Google will soon be testing Android XR with a small group of users on prototype glasses, but no word yet on when smart glasses supporting Android XR will be available. In the meantime, we look forward to Samsung's XR headset, which will be the first device to run Android XR.

While we wait to see what else Android XR brings to the table, check out how Xreal smart glasses will leapfrog AR.