Skip to main content

xrOS: What to Expect From the Software Designed for Apple's AR/VR Headset

The Worldwide Developers Conference (WWDC), Apple's annual developer and software-oriented conference, is now just a few days away. As with previous years, Apple is expected to introduce major updates to all of its operating systems, but unique to WWDC 2023, Apple is also very likely to unveil xrOS, the software that will run its much-rumored AR/VR mixed-reality headset. Here's everything we're expecting from it.


xrOS: What's in a Name?


Apple has not publicly acknowledged the existence of its headset, but internal Apple sources have confirmed that the operating system will be called xrOS, and Apple has used hidden shell companies to trademark the name in various countries.

‌xrOS‌ is meant to stand for "extended reality," hinting at the augmented and virtual reality functions at the heart of the head-mounted device. The backend capitalization also conforms to the naming conventions Apple has adopted for all of the operating systems in its ecosystem.

According to reporting by Bloomberg's Mark Gurman, Apple sees the headset as a device for gaming, watching streaming video, video conferencing, health and fitness, and interfacing with other people. Therefore ‌xrOS‌ will be focused on providing the best possible environment for delivering that content.

Apple-registered wordmark for "‌xrOS‌" in New Zealand


xrOS User Interface


‌xrOS‌ is believed to have an iOS-like interface that will be familiar to iPhone and iPad users, but presented to them and interacted with in an entirely new way.

We are expecting a dedicated Home Screen containing apps and customizable widgets, all of which can be rearranged, and all viewed on dual high-resolution 4K micro OLED displays with up to 3,000 pixels per inch for a rich, realistic, and immersive viewing experience.

Both of the user's hands and eyes will be tracked by more than a dozen optical cameras, and the wearer is expected to be able to look at an on-screen item to select it, and use a hand gesture like a pinch to activate the item on the screen.

The now defunct-Google Glass: An early example of an AR interface

The ‌xrOS‌ software could even potentially project AR app interface elements onto actual objects in the real world for a mixed-reality overlay kind of effect.

Apple is also said to be working on an in-air typing feature that is expected to be a bit rudimentary at launch, with Apple to make notable improvements over time.

Apps


At the core of ‌xrOS‌ will be re-imagined versions of stock Apple apps like Safari, Photos, Messages, Maps, Apple TV+, Apple Music, Podcasts, Reminders, and Calendar, as well as a FaceTime app customized for the headset. The Maps app will also feature, and could incorporate some of Apple's Look Around and landmark functionality, allowing users to explore cities around the world.

Users will be able to work on several apps at the same time, while an ‌xrOS‌ App Store will host made-for-headset apps, as well as existing ‌App Store‌ content. Apple is also said to be adapting ‌iPad‌ apps for the headset's 3D interface.


In addition, Apple is set on transforming several existing services and apps into immersive viewing experiences. For example, users will be able to watch videos in virtual reality environments as if they were looking at a giant screen, or participate in guided meditations accompanied by immersive visuals, audio, and voiceovers.

Some of the apps and services said to offer radically different experiences in ‌xrOS‌ include Apple Fitness+, ‌Apple TV+‌ (with a focus on viewing sports content like MLB and MLS), and a 3D version of Apple's collaborative Freeform tool. As for ‌FaceTime‌, with all of the cameras that the headset is expected to have, one-on-one chats are said to feature realistic avatars which mimic the user's actual facial expressions and body movements.

Apple is also said to have created a Books app for reading in virtual reality, a Health app focusing on psychological wellness, and a Camera app that can take images from the headset's cameras.

Gaming and App Creation


To get people to purchase the mixed-reality headset, Apple will need to convince users that the software experiences are worth it. That will require not only compelling first-party experiences, but also innovative third-party apps from developers.

Iron Man VR on the Meta Quest headset

With gaming reportedly a focus, Apple is said to have been working with a select number of game developers to help them update their existing content for mixed reality, but Apple reportedly also has a robust set of tools available that will allow non-developers to create their own AR/VR experiences. According to one report, customers will be able to create and release AR apps for the headset using Siri as an assistant, even if they do not have the ability to code.

The report likens Apple's tool to Minecraft and Roblox, which allow anyone to easily create 3D tools and worlds. Apple is said to be utilizing technology that it acquired from Montreal-based startup Fabric Software in 2017, and customers would be able to distribute the AR apps they create on the ‌App Store‌ alongside developers.

It's worth noting that the report cites sources who last saw demonstrations of the tool in 2021, so the report is based on older information and it's possible that Apple's plans have changed at least slightly in the time that has passed since. Whether this latter report is still accurate is something we should learn soon.

When is xrOS Coming?



Apple's software tools for the headset are likely to be revealed at ‌WWDC 2023‌, giving developers time to create AR and VR apps and experiences for the headset before it launches. In that sense, we won't see the full version of ‌xrOS‌ until the headset is officially released to the public, and that isn't expected to happen until later in the year.

For everything else we know about the headset, including all the hardware details, be sure to check our dedicated AR/VR headset roundup.
Related Roundup: AR/VR Headset
Tag: xrOS

This article, "xrOS: What to Expect From the Software Designed for Apple's AR/VR Headset" first appeared on MacRumors.com

Discuss this article in our forums



Source: TechRadar

Popular posts from this blog

iOS 14 Favorites Widget: How to Make a Replacement With Shortcuts

In iOS 14 , Apple overhauled widgets and introduced an option for adding ‌widgets‌ to the Home Screen , but in the process, a well-loved Favorites widget that existed in iOS 13 was removed. The Favorites widget let users set certain contacts and contact methods as favorites that were easily accessible, so you could, for example, add a favorite option for messaging Eric or calling Dan, with those actions executed with a tap. Why the Favorites widget was removed is a mystery and it could be a simple oversight with Apple planning to reintroduce it later, but for now, those who relied on the widget can recreate its functionality with Shortcuts. It takes some effort, but it may be worth the time investment if you often relied on your Favorites. Creating a Favorites Shortcut Making a shortcut that replicates the behavior of the Favorites widget isn't too tough, but if you want multiple favorite options, you'll need to create a separate shortcut for each one in the Shortcuts

The hidden cost of food delivery

Noah Lichtenstein Contributor Share on Twitter Noah Lichtenstein is the founder and managing partner of Crossover , a diversified private technology fund backed by institutional investors, technology execs and professional athletes and entertainers. More posts by this contributor What Studying Students Teaches Us About Great Apps I’ll admit it: When it comes to food, I’m lazy. There are dozens of great dining options within a few blocks of my home, yet I still end up ordering food through delivery apps four or five times per week. With the growing coronavirus pandemic closing restaurants and consumers self-isolating, it is likely we will see a spike in food delivery much like the 20% jump China reported during the peak of its crisis. With the food delivery sector rocketing toward a projected $365 billion by the end of the decade, I’m clearly not the only one turning to delivery apps even before the pandemic hit. Thanks to technology (and VC funding) we can get a ri

Amazon Takes Up to $200 Off M1 iPad Air With New Record Low Prices

Apple's previous generation M1 iPad Air has dropped further in price this week on Amazon, now available at $399.00 for the 64GB Wi-Fi model, down from $599.00. These price drops follow just one week after Apple unveiled the new M2 iPad Air. Note: MacRumors is an affiliate partner with Amazon. When you click a link and make a purchase, we may receive a small payment, which helps us keep the site running. You can also get the 256GB Wi-Fi M1 iPad Air on sale for $599.00, down from $749.00. Both of these deals are new all-time low prices on the 2022 tablet, and right now only Amazon has the discounts. $200 OFF 64GB Wi-Fi M1 iPad Air for $399.00 $150 OFF 256GB Wi-Fi M1 iPad Air for $599.00 Additionally, both cellular models are on sale right now on Amazon. The 64GB cellular model has hit $599.00 , down from $749.00, while the 256GB cellular model is available for $749.00 , down from $899.00. Stock on the cellular models is far more sparse compared to the Wi-Fi tablet

Apple Adds Support for Live Activities to Shazam

Apple today added support for Live Activities in Shazam, its free music discovery and identification app. Shazam's Live Activities keep the user updated when searching for music in the background, which is particularly useful when multitasking or identifying songs in other apps . The last significant update to Shazam arrived in January, allowing users to identify songs from other apps while listening with headphones. Apple acquired Shazam in 2018, and has been gradually bringing the app into closer alignment with ‌ Apple Music ‌ ever since, offering trials to the streaming service through the app and the ability to sync Shazams directly to ‌‌Apple Music‌‌. Shazam can be downloaded from the App Store for free . It can be accessed through the Control Center on ‌‌ iPhone ‌‌ and ‌‌ iPad ‌‌, through ‌ Siri ‌ commands, or on the Mac, as well as via widgets. Version 17.11 of Shazam is now available. Apple opened up its Live Activities API to third-party ‌iPhone‌ apps with the r