Skip to main content

The Oculus Quest is about to get better AR and hand tracking experiences

The Presence Platform is Facebook's way of giving developers better tools to make better experiences.

What you need to know

  • Facebook is launching the Presence Platform for Oculus Quest, which includes three new development kits.
  • Insight SDK, Interaction SDK, and Voice SDK are designed to make these experiences easier for developers to successfully implement in their apps.
  • Users should see better hand tracking and AR experiences in the future, as well as the ability to use their voice for more natural input.

At Facebook Connect 2021, the company announced a brand new trio of software development kits designed to help developers create better AR and hand tracking experiences, as well as adding in the ability for players to use their voice for search and control. Facebook calls this trio the Presence Platform, and it's one of the many ways the company is working to create a better Oculus Quest 2 platform for all players.

Hand tracking has been around since before the Quest 2 launched in Fall 2020, but it's always been a bit hit or miss. Newer software like Unplugged has proven that hand tracking isn't a lost cause, and Facebook's new developer tools should help more developers create experiences that are more similar to Unplugged instead of the janky early hand tracking titles.

Quest 2 Hand Tracking Interaction Sdk

Hand tracking improvements can be found in the new Interaction SDK. A new Unity library will include predefined actions like grab, poke, target, and select, making these complex interactions a significantly easier process to implement into games.

Similarly, the new Voice SDK will help make it easier to offer voice as a third form of input in games. Oculus used several examples of how voice could be added into a game, including searching for your next song in Beat Saber, issuing commands to a squad, or casting a magic spell.

Last is the Insight SDK, which helps enable better Augmented Reality (AR) or Mixed Reality (MR) experiences. Insight SDK enhances the passthrough capabilities of the Quest — that's how you can see the world around you via the Quest's external cameras — and allows developers to more easily create more cohesive experiences with the world around the player.

Several new technologies are being introduced with Insight SDK. Spatial anchors let developers and players add virtual objects to a real-world location so they can stay in place when the player walks around. That's great for keeping virtual walls in place in games like Space Pirate Trainer, or for tracking the keys of a piano and making it easier to learn how to play, as you'll see in the image below.

Note that, despite the player's head moving, the virtual notes stay in line with the keys.

Quest 2 Passthrough Magickeys Ar Piano

Scene understanding, likewise, helps the Quest understand how to better blend the real and virtual worlds together by mapping your room in the virtual space.

Facebook says that it's following its Responsible Innovation Principles for these developments, ensuring players are comfortable and that any data collection is outlined specifically before a user jumps into an experience.

Soon, Oculus will also debut the Tracked Keyboard SDK so you can bring your mouse and keyboard into VR with fewer restrictions.

Better experiences

Oculus Quest 2

$299 at Amazon $380 at Walmart $299 at Best Buy $299 at Walmart

Get the full effect

The Oculus Quest 2 offers almost everything that you could ask for from a VR headset like an impressive display and refresh rate, easy setup, and portability.



Source: androidcentral

Popular posts from this blog

The hidden cost of food delivery

Noah Lichtenstein Contributor Share on Twitter Noah Lichtenstein is the founder and managing partner of Crossover , a diversified private technology fund backed by institutional investors, technology execs and professional athletes and entertainers. More posts by this contributor What Studying Students Teaches Us About Great Apps I’ll admit it: When it comes to food, I’m lazy. There are dozens of great dining options within a few blocks of my home, yet I still end up ordering food through delivery apps four or five times per week. With the growing coronavirus pandemic closing restaurants and consumers self-isolating, it is likely we will see a spike in food delivery much like the 20% jump China reported during the peak of its crisis. With the food delivery sector rocketing toward a projected $365 billion by the end of the decade, I’m clearly not the only one turning to delivery apps even before the pandemic hit. Thanks to technology (and VC funding) we can get a ri

Cyber Monday Canada: Last-minute deals for everyone on your list

Best Cyber Monday Canada deals: Smart Home Audio Phones, Tablets & Accessories Wearables Laptops & PC Components Amazon products Gaming Televisions Cameras Lifestyle & Kitchen Toys & Kids Cyber Monday Canada is here, and retailers are rolling out the red carpet for customers who want to shop for everything from tech to kitchenware to games and everything in between. Unlike years past, Cyber Monday Canada deals look a bit different than normal. Instead of retailers trying to pack their stores with as many shoppers as possible, we're seeing tons of online deals that you can take advantage of from the comfort of your home. We've rounded up our favorites below, so feel free to browse through the best of what Canada Cyber Monday has to offer! This list is being updated with new Cyber Monday deals all the time, so check back often. Spotlight deals It's a Switch Nintendo Switch Fortnite Edition bundle $399.95 at Amazon It's a Switch.

Slack’s new integration deal with AWS could also be about tweaking Microsoft

Slack and Amazon announced a big integration late yesterday afternoon. As part of the deal, Slack will use Amazon Chime for its call feature, while reiterating its commitment to use AWS as its preferred cloud provider to run its infrastructure. At the same time, AWS has agreed to use Slack for internal communications. Make no mistake, this is a big deal as the SaaS communications tool increases its ties with AWS, but this agreement could also be about slighting Microsoft and its rival Teams product by making a deal with a cloud rival. In the past Slack CEO Stewart Butterfield has had choice words for Microsoft saying the Redmond technology giant sees his company as an “existential threat.” Whether that’s true or not — Teams is but one piece of a huge technology company — it’s impossible not to look at the deal in this context. Aligning more deeply with AWS sends a message to Microsoft, whose Azure infrastructure services compete with AWS. Butterfield didn’t say that of course

Turn your Raspberry Pi into a full-blown computer with the best screens

So you've already picked up the best Raspberry Pi kit , but you want to be able to actually see things, so you'll need to find the best Raspberry Pi screen. Then, of course, you'll need to find a display to use, regardless of whether you grabbed the Raspberry Pi 4 or even the Raspberry Pi 400 . So we've rounded up the best options to give your mini computer a display worth using. Super low power GeeekPi 7 Inch 1024x600 Capacitive Touch Screen HDMI Monitor Staff Pick This 7-inch capacitive display has a 1024x600 resolution and connects via HDMI. It also only requires 500mAh of power for its backlight. There are two additional USB ports for you to take advantage of and expand and extend. Plus, you won't have to worry about meddling around with any display drivers and can just plug and play this GeeekPi monitor with your Raspberry Pi. $70 at Amazon Ultimate flexibility ASUS VP28UQG 28" Monitor 4K/UHD Flexibility is the name of the game with a Raspber