when

Meta

Meta debuted a suite of artificial intelligence models called “Movie Gen” on Oct. 4 capable of generating photorealistic movies up to 16 seconds long, complete with sound effects and backing music tracks.&nbsp;
Movie Gen isn’t the first multimodal AI model capable of generating video and audio from simple text prompts, but it appears to demonstrate state-of-the-art capabilities. The researchers responsible for the application’s development <a data-ct-non-breakable="null" href="https://ai.meta.com/static-resource/movie-gen-research-paper" rel="null" target="null" text="null" title="null">claim</a> it outperformed rival systems in human testing.&nbsp;
<figure>
 <img alt="Meta unveils AI models that create photorealistic movies with sound" src="https://s3.cointelegraph.com/uploads/2024-10/01925855-b225-7ff2-9420-c17bc83ccef9" title="">
 <figcaption style="text-align: center;">
 A still image taken from a movie generated by Meta Movie Gen. Source: Meta
 </figcaption>
</figure>
<h2 id="movie-gen">Movie Gen</h2>
According to a blog post from Meta, Movie Gen is currently capable of outputting movies up to 16 seconds long at a frame rate of 16 frames per second (FPS). To put this into perspective, Hollywood films prior to the digital age were traditionally shot at 24 FPS to achieve what’s called the “film look.”&nbsp;
While higher FPS rates are considered better in gaming and other graphical applications, Meta’s 16 FPS isn’t far off from what would be considered professional-quality movie imagery.&nbsp;
The Movie Gen models can generate completely novel movies based on simple text prompts or modify existing images or videos to replace or modify objects and backgrounds.&nbsp;
<figure>
 <img alt="Meta unveils AI models that create photorealistic movies with sound" src="https://s3.cointelegraph.com/uploads/2024-10/01925856-2d89-7ef1-b924-9ca4ffb6f8de" title="">
 <figcaption style="text-align: center;">
 Still images from an uploaded movie edited three different ways. Source: Meta
 </figcaption>
</figure>
Its most advanced contribution, however, may be the AI suite’s ability to <a data-ct-non-breakable="null" href="https://ai.meta.com/static-resource/movie-gen-research-paper" rel="null" target="null" text="null" title="null">generate</a> up to 45 seconds of audio featuring sound effects and background music. According to Meta, Movie Gen integrates and syncs the audio to the motion in the generated videos.&nbsp;
Related: <a data-ct-non-breakable="null" href="https://cointelegraph.com/news/meta-shows-web3-reality-bridge-hyperscape-metaverse-demo" rel="" target="_self" text="null" title="https://cointelegraph.com/news/meta-shows-web3-reality-bridge-hyperscape-metaverse-demo">Meta shows off Web3-to-reality bridge with ‘Hyperscape’ metaverse demo</a>
<h2 id="research-only">Research only&nbsp;</h2>
Meta is keeping the foundation models behind Movie Gen under wraps for the time being. The company hasn’t given a timeframe for the product’s launch and said it would require further safety testing before deployment.
Per a research paper from Meta’s AI team:
<blockquote>
 “The Movie Gen cast of foundation models were developed for research purposes and&nbsp;need multiple improvements before deploying them … when we do deploy these models, we will incorporate safety models that can reject input prompts or generations that violate our policies to prevent misuse.”
</blockquote>
Magazine: <a data-ct-non-breakable="null" href="https://cointelegraph.com/magazine/anti-aging-multi-millionaire-bryan-johnson-almost-devoted-life-crypto/" rel="null" target="null" text="null" title="null">Anti-aging tycoon Bryan Johnson almost devoted his life to crypto</a>

Meta unveils AI models that create photorealistic movies with sound

Table of Contents

Cointelegraph

Other articles published on Oct 4, 2024

Orbis86 X Hotcoin X Hedera: Web3 Networking Mixer a Resounding Success

Ripple Vs SEC Case: Here’s What US SEC Is Appealing In XRP Lawsuit

Altcoin Sentiment Shifts: Analyzing SUI, EIGEN, TAO, FET, and PYTH

Why Dogecoin (DOGE) and Pepe (PEPE) Investors Allocate Their Holding to Dogen (DOGEN) Pre-Sale

Ethereum on the Brink: Will ETH Crash to $2,150? Top Investor Warns of Major Downside Risk

‘Uptober’ mentions on social media plummet amid crypto rout

Join our free newsletter for daily crypto updates!