New update allows Google AI to generate music for video clips

Google has introduced a new update to its Video-to-Audio technology, allowing users to apply AI-generated scores, sound effects, and dialogues to video clips. The technology combines video pixels with natural language text prompts to create rich soundscapes for on-screen action. According to Google, this update is a significant step towards bringing generated movies to life.

The artificial intelligence research lab at Google has stated that the technology can understand raw pixels without the need for text prompts, although they can enhance the accuracy of the software. The update also provides improved creative control, with the ability to generate an unlimited number of soundtracks for any video input. Users can define a “positive message” to guide the generated output towards desired sounds or a “negative message” to avoid unwanted sounds.

While the update has not been publicly released yet, Google acknowledges that there are still limitations to address, and further investigations are ongoing. The quality of the audio output depends on the quality of the video input, and artifacts or distortions in the video can impact the audio quality. The goal is to minimize these limitations and improve the overall user experience.

This new technology showcases the potential of AI in enhancing video content creation and providing users with more tools for creative expression. By allowing AI to generate sound effects and dialogues based on video inputs, Google is opening up new possibilities for filmmakers and content creators. The update represents a significant advancement in AI-generated content and sets the stage for more innovations in the field.

Overall, Google’s Video-to-Audio update is a promising development that brings together AI, video technology, and creative control to offer users a unique way to enhance their video content. As the technology continues to evolve, we can expect to see more innovative applications and improvements in the user experience. Stay tuned for further updates and advancements in AI-generated content creation.

Article Source
https://mixmag.net/read/google-ai-update-generate-soundtracks-audio-effects-video-deepmind-tech