Apple’s Generative AI Features in iOS 18 Will Use On-Device Processing Instead of Cloud-Based For Faster Operations

Apple has not offered any if its generative AI features to the public as of yet, as it lags behind the likes of Google and OpenAI in a lot of aspects. However, the company is working on its biggest update for the iPhone which will bring AI to the the company’s ecosystem and offer a wide range of utilities on a system level. We have previously reported that the company plans to offer its AI technology on all iPhone models that will be compatible with iOS 18. It is now being reported that Apple plans to implement its LLM or large language models to run on-device for a range of benefits over cloud-based processing.

Apple is developing LLM for on-device processing on the iPhone for faster and more secure operations

A few weeks ago, we reported that iOS 18’s forthcoming AI features will be able to perform operations with on-device processing. This means that the forthcoming utilities will not be restricted to certain hardware requirements, but the company could distribute high-end features on premium or newer models. In a new version of the Power On newsletter, Mark Gurman reaffirms that Apple’s LLM with generative AI additions will use on-device processing in iOS 18.

Gurman states that based on all indicators, Apple’s large language models will operate on-device instead of cloud-based processing. While it is good news for users who own older iPhone models, there are certain drawbacks to it. For instance, on-device processing will make the technology less capable than the cloud-based solution. However, the company could compensate for the capability with better privacy and security, as entire operations are happening on-device.

Another major benefit is the speed of operations, as the LLM models will be able to respond in real-time, instead of showing a waiting sign so the device can fetch information from the cloud before presenting it to the user. While it remains to be seen how the large language models work on the iPhone, Apple was reported to not include a chatbot with the release of iOS 18. The company was planning to bridge the gap by licensing the technology from Google, OpenAI, and Baidu, but no further details are available on whether any company struck a deal with Apple.

Since Siri is expected to come with generative AI integration, it remains to be seen how the company’s offering will be different than the competition, but it could give the virtual assistant a major boost against Google Assistant and Amazon Alexa. Furthermore, we suspect that the on-device AI technology will be used within apps as faster performance that plays a vital role for a seamless user experience. However, for open-ended features such as a dedicated ChatGPT-like chatbot, we presume the company will rely on cloud-based solutions.