Skip to main content

The Oculus Quest is about to get better AR and hand tracking experiences

The Presence Platform is Facebook's way of giving developers better tools to make better experiences.

What you need to know

  • Facebook is launching the Presence Platform for Oculus Quest, which includes three new development kits.
  • Insight SDK, Interaction SDK, and Voice SDK are designed to make these experiences easier for developers to successfully implement in their apps.
  • Users should see better hand tracking and AR experiences in the future, as well as the ability to use their voice for more natural input.

At Facebook Connect 2021, the company announced a brand new trio of software development kits designed to help developers create better AR and hand tracking experiences, as well as adding in the ability for players to use their voice for search and control. Facebook calls this trio the Presence Platform, and it's one of the many ways the company is working to create a better Oculus Quest 2 platform for all players.

Hand tracking has been around since before the Quest 2 launched in Fall 2020, but it's always been a bit hit or miss. Newer software like Unplugged has proven that hand tracking isn't a lost cause, and Facebook's new developer tools should help more developers create experiences that are more similar to Unplugged instead of the janky early hand tracking titles.

Quest 2 Hand Tracking Interaction Sdk

Hand tracking improvements can be found in the new Interaction SDK. A new Unity library will include predefined actions like grab, poke, target, and select, making these complex interactions a significantly easier process to implement into games.

Similarly, the new Voice SDK will help make it easier to offer voice as a third form of input in games. Oculus used several examples of how voice could be added into a game, including searching for your next song in Beat Saber, issuing commands to a squad, or casting a magic spell.

Last is the Insight SDK, which helps enable better Augmented Reality (AR) or Mixed Reality (MR) experiences. Insight SDK enhances the passthrough capabilities of the Quest — that's how you can see the world around you via the Quest's external cameras — and allows developers to more easily create more cohesive experiences with the world around the player.

Several new technologies are being introduced with Insight SDK. Spatial anchors let developers and players add virtual objects to a real-world location so they can stay in place when the player walks around. That's great for keeping virtual walls in place in games like Space Pirate Trainer, or for tracking the keys of a piano and making it easier to learn how to play, as you'll see in the image below.

Note that, despite the player's head moving, the virtual notes stay in line with the keys.

Quest 2 Passthrough Magickeys Ar Piano

Scene understanding, likewise, helps the Quest understand how to better blend the real and virtual worlds together by mapping your room in the virtual space.

Facebook says that it's following its Responsible Innovation Principles for these developments, ensuring players are comfortable and that any data collection is outlined specifically before a user jumps into an experience.

Soon, Oculus will also debut the Tracked Keyboard SDK so you can bring your mouse and keyboard into VR with fewer restrictions.

Better experiences

Oculus Quest 2

$299 at Amazon $380 at Walmart $299 at Best Buy $299 at Walmart

Get the full effect

The Oculus Quest 2 offers almost everything that you could ask for from a VR headset like an impressive display and refresh rate, easy setup, and portability.



Source: androidcentral
Labels:

Popular posts from this blog

Apple and Meta Reportedly Discussed AI Partnership for iOS 18

Apple has held discussions with Meta about integrating the Facebook owner's AI model into iOS 18 as part of its Apple Intelligence feature set, according to a report over the weekend. Meta launched Llama 2, its large language model, in July 2023, and in April, the company released the latest versions of its AI models, called Llama 3 . The Wall Street Journal reports that the two longtime rivals have held talks about offering Meta's model as an additional option to OpenAI's ChatGPT. The paywalled report notes that the discussions haven't been finalized and could fall through. As part of Apple Intelligence, Apple has announced a partnership with OpenAI that will allow Siri to access ChatGPT directly in iOS 18, iPadOS 18, and macOS Sequoia to provide better responses in relevant situations. Using ChatGPT will be optional, so users with concerns about the technology can abstain and still make use of Apple's own new AI features. Speaking at WWDC 2024, Apple's
Read more

Here Are the macOS Sequoia Features Intel Macs Won't Support

When Apple released macOS Monterey in 2021, some key features required a Mac with Apple silicon. The same scenario played out with macOS Ventura in 2022, and then again the following year with the release of macOS Sonoma. With macOS Sequoia set to arrive in the fall, which new features can Intel Mac owners expect to be unavailable to them this time around? Apple says that macOS Sequoia is compatible with the same Macs as macOS Sonoma, but Apple's fine print reveals that certain new features won't work on Intel machines. If you're still on an Intel Mac, here's what you won't have access to. Apple Intelligence Apple Intelligence , a deeply integrated, personalized AI feature set for Apple devices that uses cutting-edge generative artificial intelligence to enhance the user experience, won't be available on Intel Macs. Apple says the advanced features require its M1 chip or later, so if your Mac was released before November 2020, you're out of luck. T
Read more

iPhone 16 Pro Models to Adopt 'M14' Advanced Samsung OLED Panels for Improved Brightness and Lifespan

The upcoming iPhone 16 Pro and iPhone 16 Pro Max will be the first Apple smartphones to adopt Samsung's high performance "M14" OLED display panel, claims a new report coming out of South Korea. According to ETNews , Samsung's "M" series of OLED panels are made for flagship smartphones, while "14" refers to the number of high-performance materials used to produce them. "M14" is the first series of its kind, and the panel is said to have been developed to deliver superior brightness and longevity. Samsung has reportedly placed orders for the M14 materials and is preparing to mass produce the displays in the second half of the year for Apple's iPhone 16 Pro models. Google's Pixel 9 smartphone is the only other device that is expected to adopt the high-performance displays in 2024. A previous report out of China claimed that this year's ‌iPhone 16 Pro‌ models will feature up to 1,200 nits of typical SDR brightness – a 20%
Read more

Apple Boosts A18 Chip Orders in Anticipation of High iPhone 16 Demand

Apple is said to have upped its order of next-generation chips from TSMC to between 90 million and 100 million units, following heightened demand expectations for its iPhone 16 series. Last year's initial chip order volume for the iPhone 15 series launch is believed to have been in the region of 80-90 million units, suggesting Apple is anticipating higher demand for its 2024 devices, according to Taiwanese outlet CTEE . The arrival of Apple Intelligence in iOS 18 is expected to boost initial sales of the devices. One of the reasons is that Apple Intelligence requires at least an iPhone 15 Pro to run, which means owners of last year's iPhone 15 and iPhone 15 Plus will miss out on Apple's new AI features unless they upgrade to an iPhone 15 Pro or plump for one of the iPhone 16 models. Last year, the iPhone 15 and iPhone 15 Plus were equipped with the A16 Bionic chip – the same chip that was in the iPhone 14 Pro models – whereas the iPhone 15 Pro and iPhone 15 Pro Max f
Read more