Skip to main content

How does Google's Real Tone camera feature work?

Best answer: The same machine learning that helps improve portrait photos and power Magic Eraser also makes the Pixel 6 camera more inclusive for all skin tones through its Real Tone feature.

What is Real Tone?

Google developed its Real Tone camera tech with a mission to make its camera and image products more equitable when photographing people of color, especially for those with darker skin tones. Historically, a lack of diverse testing meant that today's cameras weren't built to accurately portray all skin tones in their natural beauty. Unfortunately, this also means that smartphones continue to carry that bias, ultimately delivering unflattering photos for people of color. But it's not just smartphone cameras that struggle here. We've seen all sorts of camera-enabled tech issues when it comes to people who aren't light-skinned.

So with the launch of its Pixel 6, Google is trying to tackle this issue using Real Tone. With this feature, the camera hardware and software work in tandem to match the actual tone of the people in frame. And it works surprisingly well, especially for a first-generation product.

How it works isn't that simple to explain without sounding like there's a good bit of magic at play. But really, it's no different than any other aspect of computational photography that powers the best Android camera phones. It just needed a company to spend the time and money to work on it.

When you tap the shutter button in the camera app on your phone, the work of building a great photograph has already started. Camera lenses and sensors aren't particularly smart, but they're very good at their intended purposes: collecting and focusing light. Using multiple captures and electronic filters, sensor data is collected at very specific points of light in colors red, blue, and green.

That data isn't a photo, though. It's just data. It takes some processing to turn millions of individual points of light into an image, and that's where Google has always been really good at the game. Using machine learning and AI, the camera stream can look for shapes and contrasts to build a face, differentiate between the subject and the background, and more. One of the very important things that need to happen to camera sensor data is to make the colors in the finished photograph look the same as what a human eye can see.

That's where Real Tone shines. The camera software was refined to evaluate the skin tones it sees and expands on the number of different shades it thinks a person can be. Think about the people you know and how different the color of their skin can be from each other or from yours. Humans aren't just beige or brown, and camera software shouldn't act like they are. If you're a white person like I am, you probably haven't ever had an issue with your skin color in photos. But a lot of people always have.

This wasn't an easy undertaking — but it was a necessary one. Over-brightening darker skin or applying less contrast just doesn't work, and we have billions of photos that prove it. Something like Google's Real Tone project is long overdue.

Our Pick

Google Pixel 6 - 5G

From $599 at Amazon From $599 at Best Buy From $599 at B&H

Finally, a proper Pixel flagship has arrived.

After years of fatal flaws and stagnant design, Google has finally given us the shock-and-awe upgrade we've been waiting for. Tensor's AI prowess makes most Assistant features feel magically fast. Major camera updates for hardware and processing give us significantly better photos, especially when photographing people of color and moments of action.



Source: androidcentral

Popular posts from this blog

The hidden cost of food delivery

Noah Lichtenstein Contributor Share on Twitter Noah Lichtenstein is the founder and managing partner of Crossover , a diversified private technology fund backed by institutional investors, technology execs and professional athletes and entertainers. More posts by this contributor What Studying Students Teaches Us About Great Apps I’ll admit it: When it comes to food, I’m lazy. There are dozens of great dining options within a few blocks of my home, yet I still end up ordering food through delivery apps four or five times per week. With the growing coronavirus pandemic closing restaurants and consumers self-isolating, it is likely we will see a spike in food delivery much like the 20% jump China reported during the peak of its crisis. With the food delivery sector rocketing toward a projected $365 billion by the end of the decade, I’m clearly not the only one turning to delivery apps even before the pandemic hit. Thanks to technology (and VC funding) we can get a ri

Cyber Monday Canada: Last-minute deals for everyone on your list

Best Cyber Monday Canada deals: Smart Home Audio Phones, Tablets & Accessories Wearables Laptops & PC Components Amazon products Gaming Televisions Cameras Lifestyle & Kitchen Toys & Kids Cyber Monday Canada is here, and retailers are rolling out the red carpet for customers who want to shop for everything from tech to kitchenware to games and everything in between. Unlike years past, Cyber Monday Canada deals look a bit different than normal. Instead of retailers trying to pack their stores with as many shoppers as possible, we're seeing tons of online deals that you can take advantage of from the comfort of your home. We've rounded up our favorites below, so feel free to browse through the best of what Canada Cyber Monday has to offer! This list is being updated with new Cyber Monday deals all the time, so check back often. Spotlight deals It's a Switch Nintendo Switch Fortnite Edition bundle $399.95 at Amazon It's a Switch.

Slack’s new integration deal with AWS could also be about tweaking Microsoft

Slack and Amazon announced a big integration late yesterday afternoon. As part of the deal, Slack will use Amazon Chime for its call feature, while reiterating its commitment to use AWS as its preferred cloud provider to run its infrastructure. At the same time, AWS has agreed to use Slack for internal communications. Make no mistake, this is a big deal as the SaaS communications tool increases its ties with AWS, but this agreement could also be about slighting Microsoft and its rival Teams product by making a deal with a cloud rival. In the past Slack CEO Stewart Butterfield has had choice words for Microsoft saying the Redmond technology giant sees his company as an “existential threat.” Whether that’s true or not — Teams is but one piece of a huge technology company — it’s impossible not to look at the deal in this context. Aligning more deeply with AWS sends a message to Microsoft, whose Azure infrastructure services compete with AWS. Butterfield didn’t say that of course

iPhone 13 Pro vs. iPhone 15 Pro Buyer's Guide: 50+ Differences Compared

The iPhone 15 Pro brings over 50 new features and improvements to Apple's high-end smartphones compared to the iPhone 13 Pro, which was released two years prior. This buyer's guide breaks down every major difference you should be aware of between the two generations and helps you to decide whether it's worth upgrading. The ‌iPhone 13‌ Pro debuted in 2021, introducing a brighter display with ProMotion technology for refresh rates up to 120Hz, the A15 Bionic chip, a telephoto camera with 3x optical zoom, Macro photography and photographic styles, Cinematic mode for recording videos with shallow depth of field, ProRes video recording, a 1TB storage option, and five hours of additional battery life. The ‌iPhone 13‌ Pro was discontinued upon the announcement of the iPhone 14 Pro in 2022, but it is still possible to get hold of it second-hand. Our guide helps to answer the question of how to decide which of these two iPhone models is best for you and serves as a way to c