Skip to main content

The Oculus Quest is about to get better AR and hand tracking experiences

The Presence Platform is Facebook's way of giving developers better tools to make better experiences.

What you need to know

  • Facebook is launching the Presence Platform for Oculus Quest, which includes three new development kits.
  • Insight SDK, Interaction SDK, and Voice SDK are designed to make these experiences easier for developers to successfully implement in their apps.
  • Users should see better hand tracking and AR experiences in the future, as well as the ability to use their voice for more natural input.

At Facebook Connect 2021, the company announced a brand new trio of software development kits designed to help developers create better AR and hand tracking experiences, as well as adding in the ability for players to use their voice for search and control. Facebook calls this trio the Presence Platform, and it's one of the many ways the company is working to create a better Oculus Quest 2 platform for all players.

Hand tracking has been around since before the Quest 2 launched in Fall 2020, but it's always been a bit hit or miss. Newer software like Unplugged has proven that hand tracking isn't a lost cause, and Facebook's new developer tools should help more developers create experiences that are more similar to Unplugged instead of the janky early hand tracking titles.

Quest 2 Hand Tracking Interaction Sdk

Hand tracking improvements can be found in the new Interaction SDK. A new Unity library will include predefined actions like grab, poke, target, and select, making these complex interactions a significantly easier process to implement into games.

Similarly, the new Voice SDK will help make it easier to offer voice as a third form of input in games. Oculus used several examples of how voice could be added into a game, including searching for your next song in Beat Saber, issuing commands to a squad, or casting a magic spell.

Last is the Insight SDK, which helps enable better Augmented Reality (AR) or Mixed Reality (MR) experiences. Insight SDK enhances the passthrough capabilities of the Quest — that's how you can see the world around you via the Quest's external cameras — and allows developers to more easily create more cohesive experiences with the world around the player.

Several new technologies are being introduced with Insight SDK. Spatial anchors let developers and players add virtual objects to a real-world location so they can stay in place when the player walks around. That's great for keeping virtual walls in place in games like Space Pirate Trainer, or for tracking the keys of a piano and making it easier to learn how to play, as you'll see in the image below.

Note that, despite the player's head moving, the virtual notes stay in line with the keys.

Quest 2 Passthrough Magickeys Ar Piano

Scene understanding, likewise, helps the Quest understand how to better blend the real and virtual worlds together by mapping your room in the virtual space.

Facebook says that it's following its Responsible Innovation Principles for these developments, ensuring players are comfortable and that any data collection is outlined specifically before a user jumps into an experience.

Soon, Oculus will also debut the Tracked Keyboard SDK so you can bring your mouse and keyboard into VR with fewer restrictions.

Better experiences

Oculus Quest 2

$299 at Amazon $380 at Walmart $299 at Best Buy $299 at Walmart

Get the full effect

The Oculus Quest 2 offers almost everything that you could ask for from a VR headset like an impressive display and refresh rate, easy setup, and portability.



Source: androidcentral

Popular posts from this blog

iOS 14 Favorites Widget: How to Make a Replacement With Shortcuts

In iOS 14 , Apple overhauled widgets and introduced an option for adding ‌widgets‌ to the Home Screen , but in the process, a well-loved Favorites widget that existed in iOS 13 was removed. The Favorites widget let users set certain contacts and contact methods as favorites that were easily accessible, so you could, for example, add a favorite option for messaging Eric or calling Dan, with those actions executed with a tap. Why the Favorites widget was removed is a mystery and it could be a simple oversight with Apple planning to reintroduce it later, but for now, those who relied on the widget can recreate its functionality with Shortcuts. It takes some effort, but it may be worth the time investment if you often relied on your Favorites. Creating a Favorites Shortcut Making a shortcut that replicates the behavior of the Favorites widget isn't too tough, but if you want multiple favorite options, you'll need to create a separate shortcut for each one in the Shortcuts

The hidden cost of food delivery

Noah Lichtenstein Contributor Share on Twitter Noah Lichtenstein is the founder and managing partner of Crossover , a diversified private technology fund backed by institutional investors, technology execs and professional athletes and entertainers. More posts by this contributor What Studying Students Teaches Us About Great Apps I’ll admit it: When it comes to food, I’m lazy. There are dozens of great dining options within a few blocks of my home, yet I still end up ordering food through delivery apps four or five times per week. With the growing coronavirus pandemic closing restaurants and consumers self-isolating, it is likely we will see a spike in food delivery much like the 20% jump China reported during the peak of its crisis. With the food delivery sector rocketing toward a projected $365 billion by the end of the decade, I’m clearly not the only one turning to delivery apps even before the pandemic hit. Thanks to technology (and VC funding) we can get a ri

Review: Anker's Latest 3-in-1 Power Bank is a Versatile On-the-Go Powerhouse

Popular accessory brand Anker has just launched a new 10K version of its 3-in-1 power bank that offers up to 30 watts of charging power, a convenient display to quickly view exact charge status, an integrated USB-C cable for both input and output, and built-in folding prongs to recharge directly from a power outlet. I've recently been testing one of these Anker power banks out, and it has become a must-have accessory for my gear bag. Competitively priced at $44.99, the 10,000 mAh capacity means I can charge up my iPhone 15 Pro Max more than one and a half times while on the go, which is plenty for a long day out or even a weekend trip where easy access to power might be iffy. And the 30-watt charging speed means it'll charge my devices up quickly, meaning spending less time with my phone awkwardly tethered to a power bank while I'm out and about. A quick charge during a lunch or dinner is more than enough to keep my iPhone topped off for the remainder of the day. Th

Apple Adds Support for Live Activities to Shazam

Apple today added support for Live Activities in Shazam, its free music discovery and identification app. Shazam's Live Activities keep the user updated when searching for music in the background, which is particularly useful when multitasking or identifying songs in other apps . The last significant update to Shazam arrived in January, allowing users to identify songs from other apps while listening with headphones. Apple acquired Shazam in 2018, and has been gradually bringing the app into closer alignment with ‌ Apple Music ‌ ever since, offering trials to the streaming service through the app and the ability to sync Shazams directly to ‌‌Apple Music‌‌. Shazam can be downloaded from the App Store for free . It can be accessed through the Control Center on ‌‌ iPhone ‌‌ and ‌‌ iPad ‌‌, through ‌ Siri ‌ commands, or on the Mac, as well as via widgets. Version 17.11 of Shazam is now available. Apple opened up its Live Activities API to third-party ‌iPhone‌ apps with the r