The highlight of today's (December 11) OpenAI live streaming was the deep integration of ChatGPT into Apple Intelligence as part of the iOS 18.2 release. This integration turns Siri into a more capable assistant by leveraging ChatGPT's advanced reasoning and language capabilities.
Users with Apple Intelligence-enabled iPhones running iOS 18.2 can now open Siri, ask it to analyze a document, and send the task directly to ChatGPT for further processing. However, the use of ChatGPT must be enabled in the iPhone's “Settings.”
In the demo, OpenAI showed how Siri with ChatGPT can review documents like holiday playlists, answer questions about them, and edit them in real time. This partnership with Apple enhances Siri's capabilities, allowing users to create project lists, generate music playlists, and even open ChatGPT's canvas to customize output. This integration bridges the gap between Siri's on-device processing and OpenAI's advanced model. The integration also allows users to refine and extend outputs without having to switch between multiple tools.
Another use case introduced Visual Intelligence, another addition to iOS 18.2 that works with iPhone 16 models and uses images captured by the camera to examine more information. In the Visual Intelligence demo, a user took a photo of a live stream host wearing a Christmas sweater and asked ChatGPT to determine what he or she was wearing. The system not only provided humorous commentary, but demonstrated the practical application of visual understanding as to why one holiday sweater won out over another. (Sam Altman won, by the way.)
This partnership between OpenAI and Apple heralds a new era for virtual assistants; Siri, often criticized for its limited functionality, benefits from ChatGPT's advanced AI capabilities Siri is now smarter, more versatile, and able to handle more complex requests.
This integration gives users access to the best of both worlds: the on-device privacy and efficiency of Apple Intelligence and the extensive reasoning and creative possibilities of ChatGPT. Tasks that once seemed tedious, such as creating detailed project lists or reviewing technical documentation, are now streamlined into a few simple commands.
Sam Altman summed it up perfectly in a live stream: “We are excited about this release. We are excited about this release, and as AI continues to evolve, this partnership is a big step forward in creating a seamless AI-driven user experience across devices.
From Siri's new discovery feature with ChatGPT to Sora's innovative video generation and Canvas' powerful editing tools, OpenAI is setting new standards for productivity and creativity. As an added bonus, Sam Altman has hinted at “faster image generation” in the near future. We can only hope that the team's “12 Days of OpenAI Announcements” list will include.
Comments