2024

Fortune

Generation

DeepMind, Google’s AI research lab has revealed that it is working on an AI tool known as V2A, which can create sound and dialogue for AI-generated videos. V2A, which stands for video-to-audio uses text-based prompts and video pixels to generate dialogue, music, and sound effects for videos. 
Also read: <a href="https://www.cryptopolitan.com/google-introduces-tacticai-soccer-tactics/">Google DeepMind Introduces TacticAI: Revolutionizing Soccer Tactics</a> 
According to DeepMind, the sound effects and music generated match the intended tone and characters of the video. DeepMind further explained that the technology could help bring more life to AI-generated videos. 
<h2 id="v2a-matches-audio-to-video-scenes">V2A matches audio to video scenes</h2> 
While audio-generating technology is nothing new, DeepMind claims its V2A tool is the first of its kind, which automatically matches audio to video. 
“Video generation models are advancing at an incredible pace, but many current systems can only generate silent output,” wrote DeepMind in a <a href="https://deepmind.google/discover/blog/generating-audio-for-video/" rel="nofollow noopener" target="_blank">blog post</a>. 
<blockquote>
 “By training on video, audio, and the additional annotations, our technology learns to associate specific audio events with various visual scenes, while responding to the information provided in the annotations or transcripts.” 
 DeepMind.
</blockquote> 
The company added <a href="https://twitter.com/GoogleDeepMind/status/1802733643992850760" rel="nofollow noopener" target="_blank">its technology</a> is automatic as opposed to time-consuming manual alignment which requires adjusting sounds, videos, and timings. 
According to DeepMind, the V2A tool can be used to generate an unlimited number of soundtracks for any video output. A positive prompt can be “defined to guide the generated output toward desired sounds, or a negative prompt to guide it away from undesired sounds.” 
“This flexibility gives users more control over V2A’s output, making it possible to rapidly experiment with different audio outputs and choose the best match,” said the company. 
<blockquote class="twitter-tweet" data-width="550" data-dnt="true"> 
 We're sharing progress on our video-to-audio (V2A) generative technology. 🎥 
 It can add sound to silent clips that match the acoustics of the scene, accompany on-screen action, and more. 
 Here are 4 examples – turn your sound on. 🧵🔊 <a href="https://t.co/VHpJ2cBr24" rel="nofollow" target="_blank">https://t.co/VHpJ2cBr24</a> <a href="https://t.co/S5m159Ye62" rel="nofollow" target="_blank">pic.twitter.com/S5m159Ye62</a> 
 — Google DeepMind (@GoogleDeepMind) <a href="https://twitter.com/GoogleDeepMind/status/1802733643992850760?ref_src=twsrc%5Etfw" rel="nofollow noopener" target="_blank">June 17, 2024</a>
</blockquote> 
<script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> 
<h2 id="deepmind-unmoved-by-competition">Deepmind unmoved by competition</h2> 
The latest innovation comes as DeepMind wants to consolidate its dominance in the industry. Earlier this year, UK AI voice generator firm ElevenLabs achieved a milestone after its series B funding round generated $80 million, valuing the company over $1 billion, according to <a href="https://www.verdict.co.uk/deepmind-is-working-on-ai-that-generates-sound-and-dialogue-for-videos/?cf-view" rel="nofollow noopener" target="_blank">Verdict</a>. 
The company says its users have generated over 100 years of audio. It also claims its audio software is currently used by 41% of Fortune 500 companies. 
Also read: <a href="%20The%20Race%20in%20AI%20Video%20Generation%20Heats%20Up">Google DeepMind vs. OpenAI: The Race in AI Video Generation Heats Up</a> 
Despite this competition, DeepMind has indicated that they are not in a haste to release the technology to the public. 
“Before we consider opening access to the wider public, our V2A technology will undergo rigorous safety assessments and testing,” said the company. 
DeepMind also indicated that V2A is pairable with video generation models like <a href="https://deepmind.google/technologies/veo/" rel="nofollow noopener" target="_blank">Veo</a>, which helps create realistic sound effects. 
Cryptopolitan reporting by Enacy Mapakame

Google DeepMind develops V2A that creates sound for AI videos

Table of Contents

Cryptopolitan_News

Other articles published on Jun 18, 2024

Altcoins That Could Make You a Crypto Millionaire

Central Banks of Bhutan, Venezuela, and Iran Acquiring Bitcoin, Claims Industry Voices

MoonBag Crypto is Wooing Investors with 15000% ROI as Slothana and ICP Play Catch-up

5.1 Billion XRP Traded in 24 Hours Despite Market Slump

CRYPTO TAX FORUM 2.0: Bringing Together Tax Authorities and Crypto Companies

PlayDoge Game Merges Blockchain And Tamagotchi – Best Crypto ICO?

Join our free newsletter for daily crypto updates!