Skip to main content

The Oculus Quest is about to get better AR and hand tracking experiences

The Presence Platform is Facebook's way of giving developers better tools to make better experiences.

What you need to know

  • Facebook is launching the Presence Platform for Oculus Quest, which includes three new development kits.
  • Insight SDK, Interaction SDK, and Voice SDK are designed to make these experiences easier for developers to successfully implement in their apps.
  • Users should see better hand tracking and AR experiences in the future, as well as the ability to use their voice for more natural input.

At Facebook Connect 2021, the company announced a brand new trio of software development kits designed to help developers create better AR and hand tracking experiences, as well as adding in the ability for players to use their voice for search and control. Facebook calls this trio the Presence Platform, and it's one of the many ways the company is working to create a better Oculus Quest 2 platform for all players.

Hand tracking has been around since before the Quest 2 launched in Fall 2020, but it's always been a bit hit or miss. Newer software like Unplugged has proven that hand tracking isn't a lost cause, and Facebook's new developer tools should help more developers create experiences that are more similar to Unplugged instead of the janky early hand tracking titles.

Quest 2 Hand Tracking Interaction Sdk

Hand tracking improvements can be found in the new Interaction SDK. A new Unity library will include predefined actions like grab, poke, target, and select, making these complex interactions a significantly easier process to implement into games.

Similarly, the new Voice SDK will help make it easier to offer voice as a third form of input in games. Oculus used several examples of how voice could be added into a game, including searching for your next song in Beat Saber, issuing commands to a squad, or casting a magic spell.

Last is the Insight SDK, which helps enable better Augmented Reality (AR) or Mixed Reality (MR) experiences. Insight SDK enhances the passthrough capabilities of the Quest — that's how you can see the world around you via the Quest's external cameras — and allows developers to more easily create more cohesive experiences with the world around the player.

Several new technologies are being introduced with Insight SDK. Spatial anchors let developers and players add virtual objects to a real-world location so they can stay in place when the player walks around. That's great for keeping virtual walls in place in games like Space Pirate Trainer, or for tracking the keys of a piano and making it easier to learn how to play, as you'll see in the image below.

Note that, despite the player's head moving, the virtual notes stay in line with the keys.

Quest 2 Passthrough Magickeys Ar Piano

Scene understanding, likewise, helps the Quest understand how to better blend the real and virtual worlds together by mapping your room in the virtual space.

Facebook says that it's following its Responsible Innovation Principles for these developments, ensuring players are comfortable and that any data collection is outlined specifically before a user jumps into an experience.

Soon, Oculus will also debut the Tracked Keyboard SDK so you can bring your mouse and keyboard into VR with fewer restrictions.

Better experiences

Oculus Quest 2

$299 at Amazon $380 at Walmart $299 at Best Buy $299 at Walmart

Get the full effect

The Oculus Quest 2 offers almost everything that you could ask for from a VR headset like an impressive display and refresh rate, easy setup, and portability.



Source: androidcentral

Popular posts from this blog

Spotify Q1 beats on sales of $2B with monthly active users up 31% to 286M

The coronavirus may be decimating some corners of the economy, but the impact on the digital music, as evidenced by the world’s biggest music streaming company, appears to be minimal. Today Spotify reported its earnings for Q1 with revenues of €1.848 billion ($2 billion at today’s rates) and an inching into a positive net income of $1 million. Monthly active users (not total subscribers) now stand at 286 million, with paid (premium) users at 130 million and ad-supported monthly active users at 163 million. Ad-supported users are growing at a slightly higher rate at the moment, at 32% versus 31%, Spotify said. Spotify beat  analysts’ forecasts on both sales — they had on average been expecting revenues of $1.86 billion — and EPS, which had been forecast to be -$0.49 but came in at -$0.20 on a diluted basis and $0.00 undiluted. The numbers underscore the positive signals we’ve had from the wider industry. More generally, we have seen a huge boost in streaming media services — includ

Adobe is giving students and teachers free access to Creative Cloud

Your university's IT admin will need to make an application for access. What you need to know Adobe is temporarily making Creative Cloud free for teachers and students. The offer is aimed at enabling them to continue being productive as they work and study from home. Students cannot individually avail the promo, however, as the application for access needs to be made by a university's IT admin. As universities around the world shut their campuses and organizations ask their employees to work from home, many tech companies are making their products available to educational institutes free for use. Google and Microsoft have both made their large-scale communication and videoconferencing tools free for everyone, and now Adobe is temporarily giving free Creative Cloud access to students and teachers. The subscription, which usually costs $79.49 per month, will give affected students and teachers access to the entire range of Adobe's applications, such as Photoshop

Google's new Guest Mode is like incognito mode for Google Assistant

Your interactions with Google Assistant will not be saved when Guest Mode is turned on. What you need to know Google Assistant is getting a new Guest Mode for privacy-conscious users. When it's turned on, the virtual assistant will not save any of its interactions with you. Turning it on and off is as simple as a single voice command. Google this week announced a new Guest Mode for its virtual assistant that's designed with privacy-conscious folks in mind. A simple "Hey Google, turn on Guest Mode" will ensure that none of your interactions with Google Assistant are collected by the company and nor will they be used to 'personalize your experience' — often an indirect way of referring to targeted ads. When it's on, the Assistant will play a special chime to let you know. Smart displays with Assistant will also show a guest icon on the screen. And you can always check for yourself by saying, "Hey Google, is Guest Mode on?" Even with G

Coronavirus tech updates: Twitter removes misleading COVID-19 tweets

The coronavirus has spread to 181 countries around the world, and it shows no signs of abating . The pandemic has proved particularly devastating in recent weeks, with total confirmed cases crossing 2.6 million and fatalities of over 183,000 globally. The virus has effectively shut down all sporting leagues around the world, major gatherings including tech events and music festivals, and closed down restaurants and malls. It has transformed how we live and work, and how we connect with our friends and families. Tech brands are doing their part to assist, with Google teaming up with Apple to build a coronavirus tracking tool . Here's the latest on the coronavirus and how it's affecting not only the tech industry, but also the world at large. April 22, 2020: Twitter takes action against misleading COVID-19 tweets Global COVID-19 cases have crossed 2.6 million, with 74,000 new cases registered in the last 24 hours. With six times as many cases as any other country, the U.