Apple has announced iOS 18.2 for developers: Siri can answer questions about what's on the screen

Apple has announced the first beta version of iOS 18.2 for developers, which includes integration with ChatGPT. Now you can ask Siri details about what is displayed on your device's screen.

Here's How It Works

With this new feature, users can ask questions such as "where is this?" or "what building is in this photo?" while viewing content.

Siri will take a screenshot and send it to ChatGPT, which will use its database to provide an answer. Before doing so, Siri will ask for permission to take the picture to ensure privacy.

This feature will be useful for owners of iPhone 15 Pro and compatible iPads, allowing them to get information about objects on the camera. Apple is also working on its own feature, which will be available in future iOS updates.

In addition to ChatGPT integration, iOS 18.2 will include Image Playground, Genmoji, and an updated Mail app. The beta version is currently available only for iPhone 15 Pro and newer models, and the official release is scheduled for December.

Source: 9to5Mac