Here’s Everything Apple Plans to Show at Its AI-Focused WWDC Event

Apple’s approach to AI will involve integrating the technology into as many of its apps as possible, in ways that ideally ease the daily lives of customers. The company is less focused on whiz-bang technology — like image and video generation — and instead concentrating on features with broad appeal. 

The new capabilities will be opt-in, meaning Apple won’t make users adopt them if they don’t want to. The company will also position them as a beta version. The processing requirements of AI will mean that users need an iPhone 15 Pro or one of the models coming out this year. If they’re using iPads or Macs, they’ll need models with an M1 chip at least.

Apple’s AI features will be powered by its own technology and tools from OpenAI. The services will either rely on on-device processing or cloud-based computing, depending on the sophistication of the task at hand. The new operating systems will include an algorithm to determine which approach should be taken for any particular task.

After years of discouraging the use of cloud servers for processing data — and even chastising rivals that did so — Apple risks sparking controversy by using the cloud for AI. So a large part of its announcement will focus on the precautions that the company is taking, including security features on the chips that it’s using in its data centers. Apple also won’t build user profiles based on customer data, and the company will generate reports to show that consumers’ information is secure and not being sold or read. At the same time, Apple will still tout the merits of on-device processing — when available.

A major component of the AI push is summarization. Apple is planning features that can quickly recap articles and web pages in the Safari browser. They’ll also be able to sum up meetings notes, text messages and emails. And Apple is planning a catch-up feature for missed notifications, allowing users to quickly absorb what they missed when they weren’t looking at their phones. 

Another part of this is reply suggestions. The iPhone will be able to automatically create fully fleshed-out responses to emails and text messages on behalf of the user. 

Siri will be a part of the new AI push as well, with Apple planning a revamp to its voice-control service based on large language models — a core technology behind generative AI. For the first time, Siri users will be able to have precise control over individual features and actions within apps. For instance, people will be able to tell Siri to delete an email, edit a photo or summarize a news article. Over time, Apple will expand this to third-party apps and allow users to string multiple commands together into a single request. These features are unlikely to arrive until next year, however.

Xcode, Apple’s software for developing apps, is getting a big AI infusion too. It will work similarly to Microsoft Corp.’s GitHub Copilot, which can complete code for programmers automatically. Though Apple has already been using this new developer tool internally, it’s unlikely to release it in its full form to third-party developers until next year.

The Mail app is getting a big upgrade as well. It will include a Gmail-like feature that automatically categorizes incoming messages. 

One feature that will likely get a lot of attention among Gen Z — and perhaps the rest of the population — will be AI-created emoji. This will use AI to create custom emoji characters on the fly that represent phrases or words as they’re being typed. That means there will be many more options than the ones in the standardized emoji library that has long been built into the iPhone. 

Voice Memos will get a much-needed AI infusion, with the company adding the ability to automatically transcribe recordings. That’s a feature that Google Pixel devices and many third-party voice recording apps have had for years. 

AI is coming to the Photos app as well, which will embed new capabilities into photo editing. That will make it easier to enhance an image or remove a person or object from the frame.

For decades, Apple’s industrial design team dictated the look and feel of all of the company’s products, ensuring that the software running on devices matched the clean lines and simplicity of the hardware. Now, customers are going to get a bit more say. In the latest iPhone operating system — iOS 18, codenamed Crystal — app icons will no longer have to remain in a neat grid. Instead, users will be able to place icons wherever they choose on their home screen. Moreover, icon colors will be customizable for the first time. That means users could make all their social media apps blue or finance-related icons green. All together, it’s considered to be the biggest upgrade to the home screen in the iPhone’s 17-year history.

Control Center, another core part of the iPhone operating system, will get an updated interface that allows shortcut buttons to be rearranged within the Control Center view itself and placed across multiple pages. It will also have a new music widget and an updated interface for controlling smart home appliances.

The Settings app, which has remained generally unchanged since the first version of the iPhone, is getting updated on iOS, iPadOS and macOS with a focus on improved navigation, better organization and more reliable search.

The Messages app is getting some non-AI tweaks, including a change to the effects feature — the thing that lets you send fireworks and other visual elements to the people you’re texting. Users will now be able to trigger an effect with individual words, rather than the entire message. There will be new colorful icons for Tapbacks, which let you quickly respond to a message with a heart, exclamation point or other character (they’re currently gray). And users will have the ability to Tapback a message with any emoji. There’s another frequently requested feature coming as well: the ability to schedule a message to be sent later. And Apple announced last November that it will be bringing RCS — or rich communication services — to the iPhone later this year, reversing a long-held stance. That will make it easier to share messages with Android users.

Apple is launching a Passwords app for iOS 18, iPadOS 18 and macOS 15 that will offer an alternative to the 1Password and LastPass services. This will essentially be an app version of the company’s long-existing iCloud Keychain feature, which is currently hidden in the Settings app.

The company has revamped the Calculator app and is bringing it to the iPad for the first time. On the iPad and Mac, the app will use the same overall interface — with round buttons — as the existing iPhone version.

Calendar is getting some updates, including the ability to bring in data from the Reminders app. But the two apps aren’t getting combined on iOS or macOS.

The Health app is getting some upgrades, including improved blood pressure data management — in preparation for future Apple Watches to have hypertension detection. There also will be support for a new hearing test feature on Apple’s AirPods. The earbuds are getting a new hearing-aid feature as well, but this may not be announced until later this year. The Health app, meanwhile, will better tailor data, such as cycle tracking, if a person is pregnant.

The watchOS 11 update, codenamed Moonstone, will add an updated Siri interface that uniquely formats responses depending on the type of query. There are also major changes coming to some key apps such as Fitness.

Safari in macOS 15, codenamed Glow, is getting some changes, but it seems unlikely that Apple is going to unveil its own ad blocker — something that’s been reported as a possibility. Advertisers already pushed back heavily against Apple’s App Tracking Transparency, or ATT, in iOS 14 a few years ago, and the company doesn’t need another privacy-related headache.

Apple’s devices are getting new wallpaper packs, including Mac versions that reference old school icons and slogans. The iPhone wallpapers will have options that look similar to early ones on the phone.

The company’s newest product, the Vision Pro, won’t get a major overhaul with visionOS 2 — codenamed Constellation — but the software will include features like new environments, the Passwords app and Vision Pro versions of iPad software. That should make the experience a bit more polished. Overall, the software is more focused on filling in gaps from the first version rather than breaking new ground