Apple to show its vision of the AI-powered future at WWDC 2024

Investors and customers now want to see what the iPhone maker has in store.

New AI features are coming at Apple’s Worldwide Developers Conference (WWDC), which takes place on Monday at Apple’s campus in Cupertino, California. Apple CEO Tim Cook has teased “big plans,” a change of approach for a company that doesn’t like to talk about products before they’re released.

WWDC isn’t typically a major investor attraction. On the first day, the company announces annual updates to its iOS, iPadOS, WatchOS and MacOS software in what’s usually a two-hour videotaped keynote launch event emceed by Cook. This year, the presentation will be screened at Apple’s headquarters. App developers then get a week of parties and virtual workshops where they learn about the new Apple software.

Apple fans get a preview of the software coming to iPhones. Developers can get to work updating their apps. New hardware products, if they appear at all, are not the showcase.

But this year, everyone will be listening for the most hyped acronym in tech.

With more than 1 billion iPhones in use, Wall Street wants to hear what AI features are going to make the iPhone more competitive against Android rivals and how the company can justify its investment in developing its own chips.

Investors have rewarded companies that show a clear AI strategy and vision. Nvidia, the primary maker of AI processors, has seen its stock price triple in the past year. Microsoft, which is aggressively incorporating OpenAI into its products, is up 28% over the past year. Apple is only up 9% over that same period, and has seen the other two companies surpass it in market cap.

“This is the most important event for Cook and Cupertino in over a decade,” Dan Ives, an analyst at Wedbush, told CNBC. “The AI strategy is the missing piece in the growth puzzle for Apple and this event needs to be a showstopper and not a shrug-the-shoulders event.”

Taking the stage will be executives including software chief Craig Federighi, who will likely address the real-life uses of Apple’s AI, whether it should be run locally or in massive cloud clusters and what should be built into the operating system versus distributed in an app.

Privacy is also a key issue, and attendees will likely want to know how Apple can deploy the data-hungry technology without compromising user privacy, a centerpiece of the company’s marketing for over half a decade.

“At WWDC, we expect Apple to unveil its long-term vision around its implementation of generative AI throughout its diverse ecosystem of personal devices,” wrote Gil Luria, an analyst at D.A. Davidson, in a note this week. “We believe that the impact of generative AI to Apple’s business is one of the most profound in all of technology, and unlike much of the innovation in AI that’s impacting the developer or enterprise, Apple has a clear opportunity to reach billions of consumer devices with generative AI functionality.”

Last month, OpenAI revealed a voice mode for its AI software called ChatGPT-4o.

In a short demo, OpenAI researchers held an iPhone and spoke directly to the bot inside the ChatGPT app, which was able to do impressions, speak fluidly and even sing. The conversation was snappy, the bot gave advice and the voice sounded like a human. Further demos at the live event showed the bot singing, teaching trigonometry, translating and telling jokes.

Apple users and pundits immediately understood that OpenAI had demoed a preview of what Apple’s Siri could be in the future. Apple’s voice assistant debuted in 2011 and since has gained a reputation for not being useful. It’s rigid, only able to answer a small proportion of well-defined queries, partially because it’s based on older machine learning techniques.

Apple could team up with OpenAI to upgrade Siri next week. It’s been discussing licensing chatbot technology from other companies, too, including Google and Cohere, according to a report from The New York Times.

Apple declined to comment on an OpenAI partnership.

One possibility is that Apple’s new Siri won’t compete directly with fully featured chatbots, but will improve its current features, and toss off queries that can only be answered by a chatbot to a partner. It’s close to how Apple’s Spotlight search and Siri work now. Apple’s system tries to answer the question, but if it can’t, it turns to Google. That agreement is part of a deal worth $18 billion per year to Apple.

Apple might also shy away from a full-throated embrace of an OpenAI partnership or chatbot. One reason is that a malfunctioning chatbot could generate embarrassing headlines, and could undermine the company’s emphasis on user privacy and personal control of user data.

“Data security will be a key advantage for the company and we expect them to spend time talking about their privacy efforts during the WWDC as well,” Citi analyst Atif Malik said in a recent note.

OpenAI’s technology is based on web scraping, and ChatGPT user interactions are used to improve the model itself, a technique that could violate some of Apple’s privacy principles.

Large language models like OpenAI’s still have problems with inaccuracies or “hallucinations,” like when Google’s search AI said last month that President Barack Obama was the first Muslim president. OpenAI CEO Sam Altman recently found himself in the middle of a thorny societal debate about deepfakes and deception when he denied accusations from actress Scarlett Johansson that OpenAI’s voice mode had ripped off her voice. It’s the kind of conflict that Apple executives prefer to avoid.

Outside of Apple, AI has become reliant on big server farms using powerful Nvidia processors paired with terabytes of memory to crunch numbers.

Apple, by contrast, wants its AI features to run on iPhones, and iPads, and Macs, which operate on battery power. Cook has highlighted Apple’s own chips as superior for running AI models.

“We believe in the transformative power and promise of AI, and we believe we have advantages that will differentiate us in this new era, including Apple’s unique combination of seamless hardware, software, and services integration, groundbreaking Apple Silicon with our industry-leading neural engines, and our unwavering focus on privacy,” Cook told investors in May on an earnings call.

Samik Chatterjee, an analyst at JPMorgan, wrote in a note this month that, “We expect Apple’s presentation at WWDC keynote to be focused on the features and the on-device capabilities as well as the GenAI models being run on-device to enable those features.”

In April, Apple published research about AI models it calls “efficient language models” that would be able to run on a phone. Microsoft is also publishing research on the same concept. One of Apple’s “OpenELM” models has 1.1 billion parameters, or weights — far smaller than OpenAI’s 2020 GPT-3 model which has 175 billion parameters, and smaller even than the 70 billion parameters in one version of Meta’s Llama, which is one of the most widely used language models.

In the paper, Apple’s researchers benchmarked the model on a MacBook Pro laptop running Apple’s M2 Max chip, showing that these efficient models don’t necessarily need to connect to the cloud. That can improve response speed, and provide a layer of privacy, because sensitive questions could be answered on the device itself, rather than being sent back to Apple servers.

Some of the features built into Apple’s software could include providing users a summary of their missed text messages, image generation for new emojis, code completing in the company’s development software Xcode, or drafting email responses, according to Bloomberg.

Apple could also decide to load up its M2 Ultra chips in its data centers to process AI queries that need more horsepower, Bloomberg reported.

WWDC won’t strictly be about AI.

The company has more than 2.2 billion devices in use, and customers want improved software and new apps.

One potential upgrade could be Apple’s adoption of RCS, an improvement to the older system of text messaging known as SMS. Apple’s messages app diverts texts between iPhones to its own iMessage system, which displays conversations as blue bubbles. When an iPhone texts an Android phone, the bubble is green. Many features such as typing notifications aren’t available.

Google led development of RCS, adding encryption and other features to text messaging. Late last year Apple confirmed that it would add support for RCS alongside iMessage. The debut of iOS 18 would be the logical time to show its work.

The conference will also be the first anniversary of Apple’s reveal of the Vision Pro, its virtual and augmented reality headset, which was released in the U.S. in February. Apple could announce its expansion to more countries, including China and the U.K.

Apple said in its WWDC announcement that the Vision Pro would be in the spotlight. Vision Pro is currently on the first version of its operating system, and core features, such as its Persona videoconferencing simulation, are still in beta.

For users with a Vision Pro, Apple will offer some of its virtual sessions at the event in a 3D environment.