Luma Unveils Ray3 Modify: AI Tool for Seamless Video Transitions and Actor Transformations

Luma, the a16z-backed AI video and 3D model company, introduces Ray3 Modify, an advanced AI model that allows users to generate seamless video transitions and transform actors' appearances by providing start and end frames. The new tool aims to solve the challenges of preserving human performance while editing or generating effects using AI.

Ray3 Modify Enhances Creative Control

Ray3 Modify enables creative studios to modify existing footage by providing character reference images that preserve the original performance. This feature ensures that the actor's motion, timing, eye line, and emotional delivery remain intact during the transformation process. Users can also provide start and end reference frames to guide the model in creating transitional footage, offering greater control over the final output.

“Generative video models are incredibly expressive but also hard to control. Today, we are excited to introduce Ray3 Modify that blends the real-world with the expressivity of AI while giving full control to creatives,” says Amit Jain, co-founder and CEO of Luma AI. “This means creative teams can capture performances with a camera and then immediately modify them to be in any location imaginable, change costumes, or even go back and reshoot the scene with AI, without recreating the physical shoot.”

Integration and Funding

The new model is available through Luma’s Dream Machine platform, which competes with other AI-driven video tools like Runway and Kling. Luma recently secured a $900 million funding round, led by Saudi Arabia’s Public Investment Fund-owned AI company Humain, to further develop its AI capabilities. Existing investors, including a16z, Amplify Partners, and Matrix Partners, also participated in the round.

With the fresh funding, Luma plans to build a 2GW AI cluster in Saudi Arabia in collaboration with Humain. This strategic move aims to enhance the company’s computational power and expand its global footprint.

Industry Impact and Future Outlook

The release of Ray3 Modify marks a significant step forward in the integration of AI into the creative industry. By providing tools that offer both expressivity and control, Luma aims to empower filmmakers, advertisers, and content creators to produce high-quality, visually compelling content more efficiently.

As the demand for AI-driven solutions in the entertainment and media sectors continues to grow, Luma’s innovative approach positions it as a key player in the evolving landscape of digital content creation.

References

• Luma releases a new AI model that lets users generate a video from a start and end frame | TechCrunch