Runway Gen-2 Enhances AI Video Creation with Multi Motion Brush

The realm of AI video continues to evolve, and Runway, a New York City-based generative AI startup, is at the forefront of these advancements. Today, Runway announced a significant update to its Gen-2 foundation model, introducing a groundbreaking tool called Multi Motion Brush. This innovative feature empowers creators to incorporate multiple directions and types of motion into their AI video projects, setting it apart from competitors in the market.

Unlike other products currently available, Runway's Multi Motion Brush allows users to apply motion independently to various areas of their video, offering a level of control unprecedented in commercially available AI video projects. This enhancement builds upon the previously introduced Motion Brush feature from November 2023, which permitted creators to add only a single type of motion at a time.

The Multi Motion Brush was initially unveiled through Runway's Creative Partners Program, providing select power users with unlimited plans and exclusive access to pre-release features. Now, it is accessible to all Gen-2 users, complementing the existing repertoire of over 30 tools designed for creative video production.

This development solidifies Runway's position in the rapidly expanding creative AI market, where it competes with notable players like Pika Labs and Leonardo AI.

What Sets Multi Motion Brush Apart?

The concept behind Multi Motion Brush is straightforward yet powerful: it grants users precise control over their AI-generated videos by enabling them to add independent motion to chosen areas. This could range from animating facial expressions to controlling the movement of clouds in the sky.

Users initiate the process by uploading a still image as a prompt and using a digital brush controlled by their computer cursor to "paint" desired areas. Runway's web interface then provides slider controls for users to determine the direction and intensity of motion for each painted portion independently. Horizontal, vertical, and proximity sliders allow users to specify left/right, up/down, or closer/further movements, and the adjustments can be saved.

Runway emphasizes the versatility of the controls, stating, "Each slider is controlled with a decimal point value with a range from -10 to +10. You can manually input numerical value, drag the text field left or right, or use the sliders. If you need to reset everything, click the ‘Clear’ button to reset everything back to 0."

Gen-2's Evolving Capabilities The addition of Multi Motion Brush further enriches the suite of tools available for controlling video outputs from the Gen-2 model. Originally introduced in March 2023, Gen-2 brought text, video, and image-based generation as a significant upgrade over its predecessor, Gen-1, which solely supported video-based outputs.

Initially limited to generating clips of up to four seconds, Gen-2 expanded its capabilities in August, allowing users to extend clips up to 18 seconds. Additional features, such as "Director Mode," enabling users to choose camera movement direction and intensity/speed in generated videos, were also introduced. Users can select from various video styles, including 3D cartoon, render, cinematic, and advertising.

In the competitive landscape of AI-driven video generation, Runway faces rivals like Pika Labs and Stability AI's Stable Video Diffusion models. Runway also offers a text-to-image tool, competing with platforms like Midjourney and DALL-E 3. While these tools have shown improvement over time, it's crucial to note that outputs may still exhibit imperfections, such as blurred, incomplete, or inconsistent images/videos.

How was the article?

• Change Image

  Good
• Change Image

  Bad