Google Lens now knows how to search for video information with Gemini

Google has updated the Google Lens app, adding the ability to search for information based on video. Users can now record video and ask questions with their voice about what they see.

Here's What We Know

The feature uses Gemini's artificial intelligence model to analyse video content and provide answers. For example, if a user sees fish in an aquarium and wants to know why the fish are swimming together, all they would need to do is record a video and ask a question with their voice. Google Lens will process the video and provide an answer based on information from the web, as shown in the example below.

Google has also added the ability to ask questions by voice when searching through photos. Previously, users could only enter questions by text after taking a photo.

The new feature is available on Android and iOS, but only in English for now. In the future, Google plans to add support for recognising sounds in videos, which will allow, for example, to identify birds by their singing.

Source: The Verge