Skip to main content

Meta's AI tool won't draw without a sketch assist from you

AI-generated images are all the rage right now with people using Craiyon (formerly known as DALL-E mini) to create nonsensical memes. Now Meta is throwing its hat into the ring with its own image generator, but with a bigger emphasis on creating artistic pieces. 

The AI tool is called Make-A-Scene and it uses a combination of text prompts and sketch outlines to generate a 2,048 x 2,048-pixel image. Meta demonstrated the tool in a video where the company asks several artists to create an art piece.

One artist, Alexander Reben, prompted Make-A-Scene to create a high-definition image of a hot dog floating in the sky and entered into the system a simple sketch of an oval above a square. Sure enough, Make-A-Scene created a detailed image of a floating hot dog above a body of water. The sketches themselves don’t have to be super detailed. It’s about giving the AI a general idea of how the final image is supposed to look.

AI art

Meta added sketches as part of the image generation process because, it claims, text prompts alone don’t do a very good job of reflecting an artist’s intent. The company gives the example of asking the tool to create an image of a zebra riding a bike. With only the text prompt, the zebra in the image may be too big or facing the wrong direction. Sketches give Make-A-Scene a structure to follow.

Images created with Make-A-Scene are more faithful to the sketch outline rather than the text prompt. According to developer tests and evaluators, generated images were found to be “better aligned” to the outline 99.54 percent of the time. The tool took the text prompt into account 66.3 percent of the time.

It’s unknown if and when Make-A-Scene will be made available to the public. Meta alludes to the tool being used to help people with their own creative endeavors or an art director with their marketing campaign. We also don’t know how the sketches will work.

Will people be able to upload their own outlines to the image generator or will they be provided by developers? We asked Meta for more information about the sketches and we'll update this post if it ever responds.

Meta states that it will be holding a presentation for Make-A-Scene at this year’s ECCV event (European Conference on Computer Vision) which is being held in Tel Aviv, Israel. The event starts on October 23 and goes on until the 27th.

Analysis: Future with AI

AI generator tools are a fascinating concept that has created some incredible results. We created some of our own unusual AI art with Google's Imagen AI generator. 

AI imaging tools aren't quite ready to rival skilled artists and most aren't available to the public due to fears of misuse, aside from Craiyon which uses an open source model to replicate OpenAI's DALL-E. But there are developers creating AI tools outside of art creation. Namecheap, for instance, is an AI tool that can generate a name for your business if you’re stuck on ideas.

There are also AI writing tools to help quickly compose content. In fact, we have a list of the best ones for 2022, but they do require human intervention to edit them. We just hope they don't get too good or we're out of a job.

Source: TechRadar

Popular posts from this blog

Cyber Monday Canada: Last-minute deals for everyone on your list

Best Cyber Monday Canada deals: Smart Home Audio Phones, Tablets & Accessories Wearables Laptops & PC Components Amazon products Gaming Televisions Cameras Lifestyle & Kitchen Toys & Kids Cyber Monday Canada is here, and retailers are rolling out the red carpet for customers who want to shop for everything from tech to kitchenware to games and everything in between. Unlike years past, Cyber Monday Canada deals look a bit different than normal. Instead of retailers trying to pack their stores with as many shoppers as possible, we're seeing tons of online deals that you can take advantage of from the comfort of your home. We've rounded up our favorites below, so feel free to browse through the best of what Canada Cyber Monday has to offer! This list is being updated with new Cyber Monday deals all the time, so check back often. Spotlight deals It's a Switch Nintendo Switch Fortnite Edition bundle $399.95 at Amazon It's a Switch.

The hidden cost of food delivery

Noah Lichtenstein Contributor Share on Twitter Noah Lichtenstein is the founder and managing partner of Crossover , a diversified private technology fund backed by institutional investors, technology execs and professional athletes and entertainers. More posts by this contributor What Studying Students Teaches Us About Great Apps I’ll admit it: When it comes to food, I’m lazy. There are dozens of great dining options within a few blocks of my home, yet I still end up ordering food through delivery apps four or five times per week. With the growing coronavirus pandemic closing restaurants and consumers self-isolating, it is likely we will see a spike in food delivery much like the 20% jump China reported during the peak of its crisis. With the food delivery sector rocketing toward a projected $365 billion by the end of the decade, I’m clearly not the only one turning to delivery apps even before the pandemic hit. Thanks to technology (and VC funding) we can get a ri

Slack’s new integration deal with AWS could also be about tweaking Microsoft

Slack and Amazon announced a big integration late yesterday afternoon. As part of the deal, Slack will use Amazon Chime for its call feature, while reiterating its commitment to use AWS as its preferred cloud provider to run its infrastructure. At the same time, AWS has agreed to use Slack for internal communications. Make no mistake, this is a big deal as the SaaS communications tool increases its ties with AWS, but this agreement could also be about slighting Microsoft and its rival Teams product by making a deal with a cloud rival. In the past Slack CEO Stewart Butterfield has had choice words for Microsoft saying the Redmond technology giant sees his company as an “existential threat.” Whether that’s true or not — Teams is but one piece of a huge technology company — it’s impossible not to look at the deal in this context. Aligning more deeply with AWS sends a message to Microsoft, whose Azure infrastructure services compete with AWS. Butterfield didn’t say that of course

iPhone 13 Pro vs. iPhone 15 Pro Buyer's Guide: 50+ Differences Compared

The iPhone 15 Pro brings over 50 new features and improvements to Apple's high-end smartphones compared to the iPhone 13 Pro, which was released two years prior. This buyer's guide breaks down every major difference you should be aware of between the two generations and helps you to decide whether it's worth upgrading. The ‌iPhone 13‌ Pro debuted in 2021, introducing a brighter display with ProMotion technology for refresh rates up to 120Hz, the A15 Bionic chip, a telephoto camera with 3x optical zoom, Macro photography and photographic styles, Cinematic mode for recording videos with shallow depth of field, ProRes video recording, a 1TB storage option, and five hours of additional battery life. The ‌iPhone 13‌ Pro was discontinued upon the announcement of the iPhone 14 Pro in 2022, but it is still possible to get hold of it second-hand. Our guide helps to answer the question of how to decide which of these two iPhone models is best for you and serves as a way to c