Apple finally breaks the AI ice in its latest Keynote event. There is a lot of content to go over, but here we will dive into their AI advancements.
Daniel MacDougall
WWDC 2024: Unveiling Apple Intelligence
Apple's Worldwide Developers Conference (WWDC) 2024 has introduced groundbreaking updates, with a significant focus on Apple Intelligence. Here’s an in-depth look at the latest advancements and device compatibility.
Device Compatibility
Apple Intelligence is compatible with the following devices:
iPhone 15 Pro Max/Pro
iPad Pro
iPad Air
MacBook Air/Pro
iMac
Mac mini
Mac Studio
Mac Pro
These devices must feature the M1 chip or later versions. Beta testing for Apple Intelligence will commence this fall.
How does Apple's AI three-tier system work?
There will be three AI checkpoints when using Apple Intelligence. Most of the AI capabilities will be on the phone. In the second part, if the phone's AI system cannot handle the AI operation, the demand will head to Apple's AI cloud system.
And, if that cannot complete the task, ChatGPT steps in and takes over. All of this is supposed to happen with your permission while using Apple Intelligence, and during the Keynote, as per usual Apple continuously hit the privacy reminder. Letting everyone know that it's going a-okay when using this AI system. We will see...
Key Announcements from WWDC 2024
VisionOS and Spatial Images
The new VisionOS for Apple Vision Pro adds depth to 2D images, transforming them into spatial experiences. This enhancement provides a more immersive visual experience by giving images a three-dimensional feel.
Photos App Enhancements
The iOS Photos app now includes auto-categorization and advanced semantic search, making it easier to find specific images using enhanced search capabilities. Apple Intelligence will organize your photos for you.
Apple Watch Innovations
Apple Watch receives significant updates, including real-time on-site translation, enabling seamless communication in different languages while traveling or interacting locally. This feature, previously available on iPhone, is now accessible on the watch.
iPad Calculator App
A new calculator app for the iPad solves math problems in real-time when using the Apple Pencil. The Math Notes feature handles complex equations, provides angles and physics solutions, and integrates with the Notes app, learning your handwriting style with Smart Script. It will actually clean up your writing as you write.
Advanced Machine Learning with Apple Intelligence
Apple Intelligence evolves into a sophisticated machine learning system that personalizes your experience across various apps, emails, and contacts.
It tailors content specifically for you, similar to Microsoft's Copilot+ system, summarizing content and displaying it in push notifications. Long text messages and emails are condensed into one-sentence summaries for quicker readability. After significant use, the phone will tailor priorities and recommendations based on your use and interests.
Enhanced Siri Integration
Siri sees deeper integration into the AI ecosystem, now capable of answering support questions and collaborating with ChatGPT when needed. If Siri cannot handle a query, it will prompt the user to pass the question to ChatGPT.
Users can also type their questions instead of only using voice. Why did this option take so long???
Siri now performs actions within apps, such as copying and pasting images in Notes and summarizing meetings it has listened to.
One of the coolest features is the use of Siri for any operation, support, and license questions users may have. Have a question if your allowed to use your iPhone for something? Ask Siri. Far better than spending your time reading documents on what you can and cannot do.
Built-In AI Writing Tools
Apple introduces AI writing tools directly integrated into devices, akin to existing AI writing assistants but now seamlessly built into the Apple ecosystem.
Genmoji and Image Playground
The new Genmoji feature allows users to create personalized emojis. The Image Playground lets users generate AI images directly on their phones with built-in AI capabilities, eliminating the need for third-party AI image generator subscriptions.
This feature works within Messages, Keynote, Pages, and through a dedicated app. Although, in the presentation, all of the AI-generated images were cartoonish in appearance. If you're looking for a more realistic approach to images, you might have to lean on third-party AI image generators.
Mainstream Adaptation and AI Integration
Apple’s AI advancements aim to bring mainstream adoption by embedding AI capabilities directly into devices, making them easily accessible.
While some critics argue that Apple is playing it safe by not introducing groundbreaking developments, the convenience of having integrated AI across devices is a significant step forward.
With these updates, Apple firmly positions itself in the AI landscape, enhancing user experiences and expanding the functionality of its devices through intelligent, integrated solutions. For more detailed information, please refer to the official Apple website.