Skip to main content

The Oculus Quest is about to get better AR and hand tracking experiences

The Presence Platform is Facebook's way of giving developers better tools to make better experiences.

What you need to know

  • Facebook is launching the Presence Platform for Oculus Quest, which includes three new development kits.
  • Insight SDK, Interaction SDK, and Voice SDK are designed to make these experiences easier for developers to successfully implement in their apps.
  • Users should see better hand tracking and AR experiences in the future, as well as the ability to use their voice for more natural input.

At Facebook Connect 2021, the company announced a brand new trio of software development kits designed to help developers create better AR and hand tracking experiences, as well as adding in the ability for players to use their voice for search and control. Facebook calls this trio the Presence Platform, and it's one of the many ways the company is working to create a better Oculus Quest 2 platform for all players.

Hand tracking has been around since before the Quest 2 launched in Fall 2020, but it's always been a bit hit or miss. Newer software like Unplugged has proven that hand tracking isn't a lost cause, and Facebook's new developer tools should help more developers create experiences that are more similar to Unplugged instead of the janky early hand tracking titles.

Quest 2 Hand Tracking Interaction Sdk

Hand tracking improvements can be found in the new Interaction SDK. A new Unity library will include predefined actions like grab, poke, target, and select, making these complex interactions a significantly easier process to implement into games.

Similarly, the new Voice SDK will help make it easier to offer voice as a third form of input in games. Oculus used several examples of how voice could be added into a game, including searching for your next song in Beat Saber, issuing commands to a squad, or casting a magic spell.

Last is the Insight SDK, which helps enable better Augmented Reality (AR) or Mixed Reality (MR) experiences. Insight SDK enhances the passthrough capabilities of the Quest — that's how you can see the world around you via the Quest's external cameras — and allows developers to more easily create more cohesive experiences with the world around the player.

Several new technologies are being introduced with Insight SDK. Spatial anchors let developers and players add virtual objects to a real-world location so they can stay in place when the player walks around. That's great for keeping virtual walls in place in games like Space Pirate Trainer, or for tracking the keys of a piano and making it easier to learn how to play, as you'll see in the image below.

Note that, despite the player's head moving, the virtual notes stay in line with the keys.

Quest 2 Passthrough Magickeys Ar Piano

Scene understanding, likewise, helps the Quest understand how to better blend the real and virtual worlds together by mapping your room in the virtual space.

Facebook says that it's following its Responsible Innovation Principles for these developments, ensuring players are comfortable and that any data collection is outlined specifically before a user jumps into an experience.

Soon, Oculus will also debut the Tracked Keyboard SDK so you can bring your mouse and keyboard into VR with fewer restrictions.

Better experiences

Oculus Quest 2

$299 at Amazon $380 at Walmart $299 at Best Buy $299 at Walmart

Get the full effect

The Oculus Quest 2 offers almost everything that you could ask for from a VR headset like an impressive display and refresh rate, easy setup, and portability.



Source: androidcentral

Popular posts from this blog

FCC approves broadband 'nutrition labels' to help you shop for internet

The FCC is pushing nutrition labels for internet providers. What you need to know The FCC has voted to move forward with new rules for ISPs to display nutrition labels. The proposed rulemaking would mandate ISPs to display relevant speed and pricing information to consumers. This should make it easier for consumers to make an informed decision on their broadband. The FCC voted unanimously on a plan that would allow consumers to make better decisions about their broadband internet. The proposal will require internet service providers (ISPs) - including many of the best wireless carriers in the U.S. — to display "nutrition labels" that display relevant service information for consumers at point-of-sale. This includes internet speeds, allowances, and clear information on rates. "If you walk into any grocery store and pull boxes of cereal from the shelves, you can easily compare calories and carbohydrates," FCC Chair Jessica Rosenworcel said in a statemen

Slack’s new integration deal with AWS could also be about tweaking Microsoft

Slack and Amazon announced a big integration late yesterday afternoon. As part of the deal, Slack will use Amazon Chime for its call feature, while reiterating its commitment to use AWS as its preferred cloud provider to run its infrastructure. At the same time, AWS has agreed to use Slack for internal communications. Make no mistake, this is a big deal as the SaaS communications tool increases its ties with AWS, but this agreement could also be about slighting Microsoft and its rival Teams product by making a deal with a cloud rival. In the past Slack CEO Stewart Butterfield has had choice words for Microsoft saying the Redmond technology giant sees his company as an “existential threat.” Whether that’s true or not — Teams is but one piece of a huge technology company — it’s impossible not to look at the deal in this context. Aligning more deeply with AWS sends a message to Microsoft, whose Azure infrastructure services compete with AWS. Butterfield didn’t say that of course

Yandex spins out self-driving car unit from its Uber JV, invests $150M into newco

Self-driving cars are still many years away from becoming a ubiquitous reality, but today one of the bigger efforts to build and develop them is taking a significant step out as part of its strategy to be at the forefront for when they do. Yandex — the publicly-traded Russian tech giant that started as a search engine but has expanded into a number of other, related areas (similar to US counterpart Google) — today announced that it is spinning out its self-driving car unit from MLU BV — a ride-hailing and food delivery joint venture it operates in partnership with Uber. The move comes amid reports that Yandex and Uber were eyeing up an IPO for MLU  last year. At the time, the JV was estimated to be valued at around $7.7 billion. It’s not clear how those plans will have been impacted in recent months, with COVID-19 putting huge pressure on ride-hailing and food-delivery businesses globally, and IPOs generally down compared to a year ago. In that context, spinning out the unit could

Elon Musk sends yet another notice trying to terminate the Twitter deal

Kristen Radtke / The Verge; Getty Images Elon Musk has sent a third letter to Twitter attempting to terminate his $44 billion acquisition of the company . Musk’s legal team cited Twitter’s multimillion dollar severance payment to former security chief and whistleblower Peiter Zatko as a violation of the merger agreement and a reason to end the deal. The letter, dated September 9th, was sent to Twitter’s chief legal officer Vijaya Gadde, and was included in a filing Twitter made with the SEC on Friday (which you can read at the bottom of this article). Last month, Zatko made headlines by accusing Twitter of misleading investors about the number of bots on the service, failing to delete users’ data, and having poor security practices, among other things. Musk jumped on the accusations, citing them in his second termination letter and subpoenaing Zatko to testify in the lawsuit. Zatko was set to be deposed on Friday. Elon Musk sent his first letter of termination in July , say