Meta is bringing its AI video tricks to Instagram with a new feature that lets users change their videos simply by changing the image using text. From adding glitter to changing the background, you can do just about anything you can imagine.
“We’re very excited about Movie Gen, our early AI research model that lets you change nearly every aspect of a video with a simple text prompt,” Instagram head Adam Mosseri said in a video announcement. .
In the video, Mosseri appears in his original outfit and location (a gray jacket and a normal-looking bedroom), and the scenery changes randomly, such as showing him in Paris, New York, and a pool, or switching clothes from one to another. It starts to change. Like a leather jacket or fluffy sweater when you’re in the Himalayas.
“You should be able to change your clothes, change the way you’re sitting, add chains, anything you can think of,” Mosseri said, demonstrating a seamless background change to change your appearance. .
Meta announced Movie Gen a few months ago, introducing several generations that surpass the output of other models in terms of quality and instant compliance. The company also unveiled AI-generated Instagram Reels created by social media influencers such as Paige Piskin, as well as social media brand 10pm Curfew’s Girls and K5sh accounts.
Beyond generating videos, Movie Gen handles video repair. That is, change certain things in the video while leaving all other elements the same. This makes the model extremely versatile, allowing users to transform a person into a doll-like cartoon version by changing the person’s outfit, swapping out the background, and even manipulating the overall style. You can perform various visual operations. scene
The technology appears to be built on Meta’s Movie Gen AI model, which Decrypt reported last year. This is the company’s answer to similar tools from competitors, such as OpenAI’s recently announced Sora video generator, Runway’s repair feature, and even some open source tools like Propainter.
For Instagram, this is the first time Meta is bringing video AI capabilities directly to users. Movie Gen lets you create brand new 16-second videos or modify existing videos with synchronized sound effects and music.
The generative video scene has been on a roll lately, with some very important developments announced in recent months after a somewhat quiet year with releases spaced out.
Sora has finally been released, but there are interesting alternatives such as Invideo V3 (which can generate entire scripts, scenes, and 10-minute videos from a single idea) and Dream Machine (which can generate consistency and realism). There were many. Google’s Veo2 (which allows you to create videos even in hyper-realistic scenarios), Google’s Veo2 (which allows you to produce fast, highly compliant, and highly realistic videos), and Showrunner (which allows you to create small cartoon sketches).
Meta has not announced a specific release date, but Mosseri said it will be released in 2024.
Edited by Andrew Hayward
Generally intelligent newsletter
A weekly AI journey told by Gen, a generative AI model.
