Skip to main content

Google reveals Project Starline specs and proof that it's better than Zoom

The classic restaurant booth design gets a 21st century upgrade.

What you need to know

  • Project Starline is a new way to remotely connect with people by providing the feeling of being present with them, known as telepresense.
  • The booth uses an 8K display with a parallax barrier-like lens array to display 3D images without the use of glasses.
  • User movement and audio are tracked via 3 "pods" that are used to render a life-like 3D version of a person to transmit wirelessly.

When Google announced Project Starline back at Google I/O 2021 in May, no one was under any illusion that the tech behind it was simple. A new whitepaper published by Google research, spotted by 9to5Google, details just how complicated the tech actually is.

It all starts with the booth design, which is similar to a familiar restaurant booth and gives users a comfortable place to sit while they meet or converse with other people remotely. Google says it chose a seated design primarily for this purpose.

Since comfort was paramount to the design, Google opted to develop a technology that didn't require users to wear anything — like any of the best VR headsets or 3D glasses — and still be able to see and hear the person on the other side as realistically as possible.

Google also wanted to ensure that users had the freedom to move around a bit, stretch their legs, and still get a full view of the person on the other end from head to waist.

Google built Project Starline booths with the ability to display a realistic 3D recreation of the person on the other end, complete with the ability to view them from multiple angles, maintain eye contact, and even hear audio as if it were coming from the other person's mouth.

In order to achieve this, Project Starline records and tracks individuals with a set of three "pods" — two located above the display on the left and right sides, and one centered below the display — which contains four synchronized 1280×1024 monochrome cameras operating at 120 Hz, with filters to block near-infrared light so that extra display information isn't erroneously picked up.

Think about how a Wii remote would freak out when sunlight poured into a room and you'll quickly understand the importance of blocking this type of light.

The bottom pod contains an extra RGB camera that captures the color necessary to properly replicate an individual in 3D space. Four cardioid microphones are also found throughout these pods, helping the system to replicate exactly where the sound comes from when it eventually recreates the person on the other end.

Visual and audio information captured from these cameras is then rendered on a Lenovo P920 PC with four GPUs — that's two NVIDIA Quadro RTX 6000 GPU and two NVIDIA GeForce Titan RTX GPUs — then sent over the internet via WebRTC. Essentially, a composite image is created using all of the pods' images combined into one big piece.

The 3D-rendered recreation of the person sitting in the Project Starline booth enables Google to not only send a higher quality image than can be delivered via 2D video as you'd find on Zoom, Skype, or FaceTime, but it also grants the ability to move and rotate the 3D model to create the illusion of a three-dimensional person sitting in front of you.

That display is a custom 65-inch 8K panel with stereoscopic lenses, which at least have a passing similarity to the display found in a Nintendo 3DS, which uses a parallax barrier. Unlike a parallax barrier, which has a small "sweet spot" where the 3D image is created, the lenses in Project Starline are used to send a different image to each eye, recreating 3D vision in a wholly natural way.

It can be argued that VR can create a similar experience in many ways, but Google points out that existing VR headsets don't have a wide enough field of view and have trouble properly recreating a face since a VR headset blocks quite a bit of it when worn.

Latency and other commonplace issues that still plague internet communication can also affect Starline a bit, but it seems like it might do a better job than what we've come to expect from current 2D video solutions.

Project Starline has been used by Google for many reasons, including on-boarding and meetings, but it's not clear how widely used we'll see Starline throughout offices or other commercial areas in the future. For now, check out Google's original announcement video below to see it in action.



Source: androidcentral

Popular posts from this blog

Follow these steps to connect a Pro Controller to your Android phone

Playing games on your smartphone is one of the best ways to entertain yourself. However, it can be tough to play with some games when you're just tapping on a screen. Fortunately, it's possible to sync up a traditional controller. That's where it's nice to connect your Nintendo Switch Pro Controller and get playing on the best gaming phones . By the way, the Playstation 4 controller as well as the Xbox One controller are also compatible with Android devices, if you'd prefer to use one of those. Note: You will only be able to use a Pro Controller if your phone is running Android 10 and if the game you're playing supports controllers. Additionally, the process for syncing the controller with your phone will be different from one phone to the next. How to use Switch controller on Android: Sync Pro Controller to your phone via Bluetooth Do keep in mind that some Android games — including some of the most popular titles like Genshin Impact — don't act

FCC approves broadband 'nutrition labels' to help you shop for internet

The FCC is pushing nutrition labels for internet providers. What you need to know The FCC has voted to move forward with new rules for ISPs to display nutrition labels. The proposed rulemaking would mandate ISPs to display relevant speed and pricing information to consumers. This should make it easier for consumers to make an informed decision on their broadband. The FCC voted unanimously on a plan that would allow consumers to make better decisions about their broadband internet. The proposal will require internet service providers (ISPs) - including many of the best wireless carriers in the U.S. — to display "nutrition labels" that display relevant service information for consumers at point-of-sale. This includes internet speeds, allowances, and clear information on rates. "If you walk into any grocery store and pull boxes of cereal from the shelves, you can easily compare calories and carbohydrates," FCC Chair Jessica Rosenworcel said in a statemen

You can make your new Pixel look like a Teenage Mutant Ninja Turtle

A cool thing about Google’s Pixel 6 series phones is their unique camera bar design . If the finish of that strip were a different color than black — specifically blue, orange, purple, or red — it would totally look kind of like the Teenage Mutant Ninja Turtles . And now that you can’t unsee the resemblance, device outfitter Dbrand would like to help make your Pixel 6 device look like one of your favorite childhood heroes. With Google’s latest phone the Pixel 6a releasing next week , Dbrand decided it's a good time to revisit the sewers and launch its Teenage Mutant Ninja Pixels decals for all three phones. They match the green heroes-in-a-half-shell plus their masks, and include four camera decal strips that reflect the colors of Leonardo, Michelangelo, Donatello, and Raphael. Personally, I think the Pixel 6a’s two-camera array does the best job looking like proper eyes (the spidery camera array of the Pixel 6 and 6 Pro, not so much). Available now for the Pixel 6a: https://

HBO just canceled this comedy, despite its 100% Rotten Tomatoes rating

HBO has canceled animated comedy after three seasons.  Close Enough was created by JG Quintel, the man behind cult comedy Regular Show, who also topped the bill of voice actors, which included Gabrielle Walsh, Jason Mantzoukas, Kimiko Glenn, Jessica DiCicco, James Adomian and Danielle Brooks. Close Enough followed Josh and Emily – and their young daughter Candice – a couple in their late 30s, who live in a Los Angeles duplex with their divorced friends, Alex and Bridgette. The show chronicled their lives as they dealt with everyday challenges, with things frequently taking surreal and sci-fi style turns.  Originally intended to air on TBS in 2017, after a series of delays, the show debuted on HBO Max in 2020. Three seasons of eight episodes each have been broadcast, with the most recent season coming to a close in early April of 2022.  The show has featured a number of high-profile guest stars during its run, including the likes of Jane Lynch, Henry Winkler, "Weird Al"