Skip to main content

More Details About iOS 18's AI Features Revealed

Apple is planning to introduce new AI features including Smart Replies for messages and a generative retouch tool for photos in iOS 18, a new report claims.


A new article from AppleInsider today revealed some further detail about several of ‌iOS 18‌'s widely anticipated AI features. Siri is rumored to receive some major upgrades including:


  • Improved Responses: Significantly updated response generation capabilities with a new smart response framework that takes into account entities such as people, companies, calendar events, locations, dates, and more.

  • Enhanced Voices: "More natural" voices with better text-to-speech functionality.

  • Cross-Device Media Controls: Use ‌Siri‌ on one device to control playback on another, such as via the Apple Watch for the Apple TV. This feature is not expected to arrive until later in 2024.

  • Catch Up: Users can request an overview of their recent notifications via ‌Siri‌.


A range of other AI-powered features are also in the works for specific apps in ‌iOS 18‌:


  • Smart Replies: Allows users to reply to messages and emails with automatically generated text responses.

  • Transcription and Summarization: New AI tools for the Notes app allowing users to edit audio in the app, transcribe audio, and summarize text.

  • Math Notes: Support for proper mathematical notation in the Notes app with Calculator app integation. Math Notes will allow the Notes app to recognise mathematical equations and come up with solutions and generate graphs.

  • Keyboard Math Predictions: Input enhancements for mathematics enabling the completion of complex mathematical expressions when recognised as part of text input, similar to predictive text or inline text completion.

  • Clean Up: Remove objects from photos using generative AI. This tool will replace Apple's current "Retouch" feature.

  • Generative Playground: Application that uses generative AI to create and edit images with an iMessage app extension. It is currently designed for Apple's internal test environments only, but indicates that there are plans to allow users to generate images and then share them via iMessage. This could be related to rumored plans to allow users to generate custom emojis.


visionOS 2 will also apparently gain an improved predictive text model thanks to integration with Apple's Transformer LM, as well as a redesigned Voice Commands UI. Updates to the Calendar and Freeform apps, as well as System Settings for macOS, are also said to be planned. Apple's selection of new AI features are expected to be previewed during the company's WWDC keynote on June 10.
Related Roundup: iOS 18

This article, "More Details About iOS 18's AI Features Revealed" first appeared on MacRumors.com

Discuss this article in our forums



Source: TechRadar

Popular posts from this blog

Apple and Meta Reportedly Discussed AI Partnership for iOS 18

Apple has held discussions with Meta about integrating the Facebook owner's AI model into iOS 18 as part of its Apple Intelligence feature set, according to a report over the weekend. Meta launched Llama 2, its large language model, in July 2023, and in April, the company released the latest versions of its AI models, called Llama 3 . The Wall Street Journal reports that the two longtime rivals have held talks about offering Meta's model as an additional option to OpenAI's ChatGPT. The paywalled report notes that the discussions haven't been finalized and could fall through. As part of Apple Intelligence, Apple has announced a partnership with OpenAI that will allow Siri to access ChatGPT directly in iOS 18, iPadOS 18, and macOS Sequoia to provide better responses in relevant situations. Using ChatGPT will be optional, so users with concerns about the technology can abstain and still make use of Apple's own new AI features. Speaking at WWDC 2024, Apple's

Apple Wasn't Interested in AI Partnership With Meta Due to Privacy Concerns

Apple turned down an AI partnership with Facebook parent company Meta due to privacy concerns, according to a report from Bloomberg . Meta and Apple had a brief discussion about a possible partnership in March, but the talks did not progress and Apple does not plan to integrate Meta's large language model (LLM) into iOS. Over the weekend, The Wall Street Journal suggested that Apple and Meta were in active discussions about integrating Llama, Facebook's LLM, into iOS 18 as part of Apple Intelligence. The report suggested that the discussions were ongoing had not been finalized, but Bloomberg 's follow-up indicates Apple never seriously considered a partnership. Preliminary talks happened at the same time that Apple began discussions with OpenAI and Google parent company Alphabet, but Apple decided not to move on to a more formal discussion because "it doesn't see that company's privacy practices as stringent enough." Apple did end up signing a d

iPhone 13 Pro vs. iPhone 16 Pro: 60+ Upgrades to Expect

The iPhone 16 Pro is set to succeed 2023's iPhone 15 Pro , introducing over 25 new features and improvements to Apple's high-end smartphones. With many users adopting three-year upgrade cycles, plenty of iPhone 13 Pro owners will be looking to upgrade to the ‌iPhone 16 Pro‌ later this year, so this guide breaks down every major difference you should be aware of between the two generations based on rumors. The ‌‌iPhone 13‌‌ Pro debuted in 2021, introducing a brighter display with ProMotion technology for refresh rates up to 120Hz, the A15 Bionic chip, a telephoto camera with 3x optical zoom, macro photography and photographic styles, Cinematic mode for recording videos with shallow depth of field, ProRes video recording, a 1TB storage option, and up to five hours of additional battery life. Three years later, the ‌iPhone 16 Pro‌ is expected to offer over 60 upgrades. All of the changes the ‌iPhone 16 Pro‌ models are expected to feature compared to their 2021 predecessors

Here Are the macOS Sequoia Features Intel Macs Won't Support

When Apple released macOS Monterey in 2021, some key features required a Mac with Apple silicon. The same scenario played out with macOS Ventura in 2022, and then again the following year with the release of macOS Sonoma. With macOS Sequoia set to arrive in the fall, which new features can Intel Mac owners expect to be unavailable to them this time around? Apple says that macOS Sequoia is compatible with the same Macs as macOS Sonoma, but Apple's fine print reveals that certain new features won't work on Intel machines. If you're still on an Intel Mac, here's what you won't have access to. Apple Intelligence Apple Intelligence , a deeply integrated, personalized AI feature set for Apple devices that uses cutting-edge generative artificial intelligence to enhance the user experience, won't be available on Intel Macs. Apple says the advanced features require its M1 chip or later, so if your Mac was released before November 2020, you're out of luck. T