iOS 18: Here are the new AI features in the works

2024 is shaping up to be the “Year of AI” for Apple, with big updates planned for iOS 18 and more. The rumors – and Tim Cook himself – make it clear that there are new AI features for Apple’s platforms in the works. Here’s everything we know about the ways Apple is exploring AI features…

iOS 18: New AI features in the works

There have been a number of rumors about the various AI features in the works inside Apple. Bloomberg has reported that Apple thinks iOS 18 will be one of the “biggest iOS updates” ever, headlined by a number of new AI features.

Mark Gurman reported last July that Apple created its own Large Language Model (LLM) system, which has been dubbed AppleGPT. The project uses a framework called “Ajax” that Apple started building in 2022 to base various machine learning projects on a shared foundation. This Ajax framework will serve as the basis for Apple’s forthcoming AI features across all of its platform.

9to5Mac found evidence of Apple’s work on new AI and large language model technology in iOS 17.4. We reported that Apple is relying on OpenAI’s ChatGPT API for internal testing to help the development of its own AI models. 

Bloomberg has reported that Apple’s iOS 18 features will be powered by an “entirely on-device” large language model, which offers a number of privacy and speed benefits.

Here are some of the rumors about new AI features coming to iOS 18:

• A new version of Siri that is more intelligent and based on large language model technology, similar to platforms like ChatGPT and Google’s Gemini.
• New AI features for Apple Music that let users automatically generate playlists.
• AI integration into Pages, Keynote, and Numbers for summarization, content creation, and more.
• AI features for Xcode that can complete blocks of code, help test applications, and more.
• An upgraded version of Spotlight Search that is powered by generative AI and can perform more complex tasks.
• An AI-powered wellness coaching feature that is integrated into Apple Health and Apple Watch.
• New AI features for the Messages app that can auto-complete messages, answer questions, and summarize incoming text messages.
• For Safari, Apple is reportedly preparing new AI-powered summarization tools as well as a new Web Eraser feature.

Apple’s AI frameworks

Did you know that Apple has actually already launched a number of powerful AI frameworks and models? Here’s a recap of those:

Apple AI announcements coming this year

During a recent Apple earnings call, Tim Cook offered a rare teaser for a future product announcement. According to Cook, Apple is spending a “tremendous amount of time and effort” on artificial intelligence technologies, and the company is “excited to share the details of our ongoing work in that space later this year.”

It’s extraordinarily rare for Cook to even remotely hint at Apple’s plans for future product announcements. Why did he do it this time? Likely to ease the concerns of investors and analysts worried about Apple falling behind the likes of OpenAI, Google, and Microsoft. Whether the teaser is enough to calm those fears until an actual product announcement materializes remains to be seen.

Also during an earnings call recently, Cook touted the advantages that Apple has which will set its AI apart from the competition:

“We believe in the transformative power and promise of AI, and we believe we have advantages that will differentiate us in this new era, including Apple’s unique combination of seamless hardware, software, and services integration, groundbreaking Apple Silicon with our industry-leading neural engines, and our unwavering focus on privacy, which underpins everything we create.”

A partnership with Google? Or Open AI?

In a surprising twist, Bloomberg has reported that Apple is in active negotiations with Google about potentially licensing Gemini, which is Google’s set of generative AI models. The report explains that Apple is specifically looking to partner on cloud-based generative AI models.

In this scenario, Apple would rely on a partner such as Google for its cloud-based features. Other features would still be powered on-device by Apple’s own technology.

The generative AI features under discussion would theoretically be baked into Siri and other apps. New AI capabilities based on Apple’s homegrown models, meanwhile, would still be woven into the operating system. They’ll be focused on proactively providing users with information and conducting tasks on their behalf in the background, people familiar with the matter said.

While Apple is said to be in “active negotiations” for this partnership with Google, the company has also reportedly held talks with OpenAI as well.

In fact, most recently, it was reported that Apple had resumed talks with OpenAI about a partnership. According to reports, Apple would use OpenAI’s technology to power an AI-based chatbot in iOS 18.

Wrap up

At this point, the question is which of the many rumors will come to fruition this year.

I’d be surprised if all of these rumored AI features are ready for this year. My assumption is that Apple is working on all of this stuff (and more), but will pare down the final list of features included in iOS 18. Features that don’t make the cut will likely come in a later update to iOS 18 or with iOS 19 in 2025.

Apple has officially set WWDC for June 10 this year, and that’s where we expect the bulk of its AI announcements to be made.

Where do you want to see Apple direct its attention toward for new AI features this year? Let us know down in the comments.

Follow Chance: Threads, Twitter, Instagram, and Mastodon.