NAIROBI, Kenya- Meta is taking a leap forward in the AI race with the introduction of Movie Gen, a model designed to create realistic video and audio clips from user prompts.
Announced on Friday, the model rivals popular tools from other major players like OpenAI and ElevenLabs, adding a new dimension to AI-generated media.
Movie Gen has the ability to generate short video clips, up to 16 seconds long, complete with synchronized audio tracks, including background music and sound effects.
In one demonstration, Meta showcased the tool by creating videos of animals swimming and surfing, as well as clips where real people, using their photos, were depicted doing activities like painting.
What sets Movie Gen apart is its capability to edit existing videos. For example, it inserted pom-poms into the hands of a man running in a desert and transformed a dry parking lot into a puddle-filled space for a skateboarding video.
The model can also create up to 45 seconds of audio, adding yet another layer of depth to its video creation capabilities.
This move comes as Hollywood grapples with the implications of AI in filmmaking. While technologists see tools like Movie Gen as ways to enhance production, there’s growing concern over the potential misuse of AI, especially when it comes to content that may be trained on copyrighted works without permission .
Meta claims that Movie Gen outperforms offerings from competitors like OpenAI’s Sora and Runway, based on blind test results shared in its blog post.
The AI-generated content appears more natural and compelling compared to other models currently available, according to Meta’s research.
However, despite the promising results, Meta has no plans to make Movie Gen widely available to developers, citing concerns over the potential risks associated with generative AI.
Instead, Meta is focusing on collaborations within the entertainment industry, working directly with filmmakers and content creators. The tool is expected to be integrated into Meta’s products sometime next year, positioning it as a key player in the future of AI-enhanced media .
As Meta rolls out its new tool, other companies are also exploring AI’s potential in the entertainment space.
Lions Gate Entertainment, known for films like The Hunger Games and Twilight, recently partnered with AI startup Runway, granting access to its extensive film library to train an AI model.
This model will be used by filmmakers to enhance their creative work, illustrating how studios are starting to embrace AI’s possibilities while navigating the legal and ethical complexities involved .
Yet, the debate around AI in Hollywood is far from settled. Earlier this year, actress Scarlett Johansson accused OpenAI of using her voice without permission, highlighting the anxieties many in the industry have about AI’s encroachment on intellectual property rights .
