Google and the University of Singapore create a tool to add camera motion to videos using AI

By: Anry Sergeev | today, 14:35

Google Research, together with the National University of Singapore (NUS ), has introduced a new tool called Generative Video Camera Controls, which allows users to add camera movement to pre-produced videos using text commands and artificial intelligence. With this solution, users can easily control camera movement, perspective changes and other animation effects by entering instructions in a simple text form.

This tool is aimed at non-professionals who no longer need complex editing or programming skills to create animated video content. Using AI technology, Generative Video Camera Controls allows you to control frames, camera position, object movement, and other animation elements, simplifying the process to a few clicks.

How Generative Video Camera Controls works:

  • The user enters a text command, such as "move camera right" or "zoom in".
  • Artificial intelligence processes the command and generates the desired changes in the video, adding camera movement effects and other animation elements.
  • The tool automatically takes into account the context of the video, making the changes look natural and harmonious.

Video before processing:

Video after processing:

This project, developed in partnership with NUS, is an example of effective collaboration between academia and a technology company. Google Research and NUS have combined resources and academic expertise to create a tool that democratises video editing and makes it accessible to a wider audience.

The tool will be useful for content creators, marketers and designers who can quickly add professional effects to videos without having to learn complex software. More details about the new tool and a demonstration of its capabilities are available on the official Generative Video Camera Controls website.