Google recently announced a new tool that can automatically generate unique soundtracks for AI-created videos. The tool, called V2A, is part of the DeepMind AI generator and aims to enhance the overall viewing experience of AI-generated videos by adding synchronized audio.
Several AI-generated video creators have impressed users in recent years, but one challenge has been the lack of suitable soundtracks to accompany the visuals. Google’s V2A tool aims to address this issue by combining video pixels with natural language text prompts to generate rich soundscapes that align with the on-screen action.
The tool can be used with video generation models like Veo to create spectacular soundtracks that enhance the auditory atmosphere of any scene. Google’s examples of the tool in action include a Western-style soundtrack for a cowboy on horseback and a suspenseful soundtrack for a man walking through a destroyed building.
Creators using the V2A tool have complete creative control over the generated soundtracks. They can give prompts and editing suggestions to guide the tool’s output in the desired direction, such as requesting audio for cinematic, suspenseful, or horror scenes. The tool can generate an unlimited number of soundtrack ideas based on the visual input and language cues provided.
Google’s DeepMind project, which combines the efforts of Google Brain and DeepMind to advance AI research, aims to harness the potential of AI for everyone. The organization is focused on building the next generation of artificial intelligence systems safely and responsibly.
The V2A tool is continuously being improved to address issues such as artifacts in the video input affecting audio quality and mismatches between generated speech and lip movements in videos with dialogue. Google’s commitment to enhancing its suite of AI-generated content providers demonstrates its dedication to advancing the capabilities of AI-generated videos and soundtracks.
Article Source
https://www.the-sun.com/tech/11677209/new-google-ai-generated-movies-deepmind/amp/