Following a keynote presentation at WWDC 2024 that both introduced Apple Intelligence and confirmed a partnership that brings GPT access to Siri through an deal with OpenAI, SVP Craig Federighi confirmed plans to work with additional third-party models.
The first example given by the executive was one the companies with which Apple was exploring a partnership.
“We’re looking forward to doing integrations with other models, including Google Gemini, for instance, in the future,” Federighi said during a post-keynote conversation.
Apple says users will be able to access the system without having to sign up for an account or paying for premium services.
“Now you can do it right through Siri, without going through another tool,” the Apple executive said.
Elon Musk is threatening to ban iPhones from all his companies over the newly announced OpenAI integrations Apple announced at WWDC 2024 on Monday.
This allows users to get an answer from ChatGPT without having to open the ChatGPT iOS app.
Apple also announced another integration that would allow users have access to ChatGPT system-wide within Writing Tools via a “compose” feature.
That’s great news for OpenAI, which will soon have a massive influx of requests from Apple users.
Apple users may not understand the nuances of the privacy issues here, of course — which is what Musk is counting on by making these complaints.
Apple kicked off its weeklong Worldwide Developers Conference (WWDC 2024) event today with the customary keynote at 1 p.m. ET/10 a.m. PT.
But the biggest news came with the reveal of Apple Intelligence, the company’s big entrance into the competitive AI market.
You can watch watch the archive over on Apple’s events page, or you can watch the YouTube archive right here and via the embed below.
The latest reports have put a name to Apple’s AI efforts: Apple Intelligence, along with the caveat that not all recent Apple devices will be able to use the new system.
And you can bet that many of iOS 18’s AI features will make their way to macOS 15, as well.
Siri got a makeover at Apple’s WWDC 2024 in Cupertino, courtesy of the tech giant’s overarching generative AI push this year.
Siri is now more natural, more relevant and more personal — and it has new look, including a revamped icon.
Siri will also have the ability to take action in and across apps, so you can ask Siri to “make this photo pop” and then “add this photo” to another app.
That’s thanks to the new App Intents API, which allows devs to let Siri take actions in their apps, and the upgraded Siri’s awareness of personal context including messages, calendar events, files and photos.
Apple gave the example of Siri finding a photo of your license, extracting your ID number and entering it into a web form for you.
At Apple’s WWDC 2024, the company revealed a handy new feature for Apple TV+ called InSight.
Apple TV+’s new feature appears to be similar to Amazon’s X-Ray technology, where Fire TV users get an overview of actor bios and behind-the-scenes information while watching TV shows and movies.
To use “InSight,” Apple TV+ subscribers can use their remote to bring up a display with actor names and character information in real-time.
Apple also announced several updates to tvOS, the software running on Apple TV.
According to the company, there will be better vocal clarity over background noise, music, and action scenes on Apple TV 4K.
An “Apple Intelligence” (AI)-powered feature coming in iOS 18 will allow iPhone users to create AI images of people they’re messaging with — a feature that works something like an AI-upgraded Bitmoji.
Image Credits: AppleFor example, Apple showed off making an AI Bitmoji of a friend celebrating their birthday with an image that included cake, balloons and flowers.
The Genmoji can be used as a sticker for reacting to messages with a Tapback or inline with your messages, Apple said.
Apple Intelligence will also suggest concepts related to your messages conversation, but all this takes place on the device, according to Apple.
Also at WWDC 2024, Apple announced updates to Siri and introduced macOS Sequoia.
Apple is bringing ChatGPT, OpenAI’s AI-powered chatbot experience, to Siri and other first-party apps and capabilities across its operating systems.
You can include photos with the questions you ask ChatGPT via Siri, or ask questions related to your docs or PDFs.
Apple’s also integrated ChatGPT into system-wide writing tools like Writing Tools, which lets you create content with ChatGPT — including images — or ask an initial idea and send it to ChatGPT to get a revision or variation back.
ChatGPT integrations will arrive on iOS 18, iPadOS 18, and MacOS Sequoia later this year, Apple says, and will be free without the need to create a ChatGPT or OpenAI account.
Subscribers to one of OpenAI’s ChatGPT premium plans will be able to access paid features within Siri and Apple’s other apps with ChatGPT integrations.
Apple announced a ton of new AI features under the new Apple Intelligence moniker.
While the features are free to use, only a limited number of devices will get access to them.
These devices include on iPhone 15 Pro along with iPad and Mac with M1 or newer chips.
So older iPhones or iPhone 15 users won’t be able to use these abilities.
The new Apple Intellgience features include revamped Siri, writing features across the system, image generation capabilities, and genAI-powered emoji.
Apple Intelligence, Apple’s new generative AI offering, won’t only be a consumer-facing feature — developers will be able to take advantage of the latest technology too.
In its keynote address at Apple’s Worldwide Developer Conference on Monday, the company announced that developers would be able to integrate the experience powered by Apple Intelligence into their own apps.
For this, Apple demonstrated how an app like Bear Notes would automatically be able to allow users to rewrite, proofread and summarize their notes.
The App Intents framework, which allows for lightweight app-like interactions without the app being installed, will also gain access to Apple Intelligence.
Image Credits: AppleThese intents are defined and tested so they’re easier for developers to adopt, Apple claims.
The latest version is MacOS Sequoia.
Notifications on Mac bring up iPhone mirror mode, and iPhone audio comes through the Mac as well — but the paired iPhone stays locked.
Elsewhere, MacOS Sequoia introduces automatic window tiling, and a presenter preview mode for video conferencing with a built-in background replacement.
On the gaming front, Apple announced Game Porting Toolkit 2, the newest version of its game porting toolkit.
The MacOS Sequoia beta will be available this month, with final releases to come this fall.
