Runway Act-One With AI-Powered Facial Expression Capture Capability Added to Gen-3 Alpha Model

Runway Act-One feature can work with a single input video and a character image.

Advertisement
Written by Akash Dutta, Edited by Siddharth Suvarna | Updated: 23 October 2024 14:07 IST
Highlights
  • Runway’s Act-One feature is gradually rolling out to all users
  • The AI firm claims the feature does not require any motion capture
  • The feature can generate both animated and realistic videos
Runway Act-One With AI-Powered Facial Expression Capture Capability Added to Gen-3 Alpha Model

Act-One can capture details such as eye-lines, micro-expressions, pacing and delivery of the user

Photo Credit: Runway

Runway AI, an artificial intelligence (AI) firm focusing on video generation models, announced a new feature on Tuesday. Dubbed Act-One, the new capability is available within the company's latest Gen-3 Alpha large language model (LLM) and is said to accurately capture facial expressions from a source video and then reproduce them on an AI-generated character in a video. The feature solves a significant pain point in AI video generation technology which is converting real people into AI characters while not losing out on realistic expressions.

Runway Act-One Capability in Gen-3 Alpha Introduced

In a blog post, the AI firm detailed the new video generation capability. Runway stated that the Act-One tool can create live-action and animated content using video and voice performances as inputs. The tool is aimed at offering expressive character performance in AI-generated videos.

AI-generated videos have changed the video content creation process significantly as individuals can now generate specific videos using text prompts in natural language. However, there are certain limitations that have prevented the adaptation of this technology. One such limitation is the lack of controls to change the expressions of a character in a video or to improve their performance in terms of delivery of a sentence, gestures, and eye movement.

However, with Act-One, Runway is trying to bridge that gap. The tool, which only works with the Gen-3 Alpha model, simplifies the facial animation process, which can often be complex and require multi-step workflows. Today, animating such characters requires recording videos of an individual from multiple angles, manual face rigging, and capturing their facial motion separately.

Advertisement

Runway claims Act-One replaces the workflow and turns it into a two-step process. Users can now record a video of themselves or an actor from a single-point camera, which can also be a smartphone, and select an AI character. Once done, the tool is claimed to faithfully capture not only facial expressions but also minor details such as eye movements, micro-expressions as well as the style of delivery.

Highlighting the scope of this feature, the company stated in the blog post, “The model preserves realistic facial expressions and accurately translates performances into characters with proportions different from the original source video. This versatility opens up new possibilities for inventive character design and animation.”

Advertisement

Notably, while Act-One can be used for animated characters, it can also be used for live-action characters in a cinematic sequence. Further, the tool can also capture details even if the angle of the actor's face is different from the angle of the AI character's face.

This feature is currently being rolled out to all users gradually, however, since it only works with Gen-3 Alpha, those on the free tier will get a limited number of tokens to generate videos with this tool.

 

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Advertisement

Related Stories

Popular Mobile Brands
  1. Oppo Reno 14 5G, Reno 14 Pro 5G India Launch Timeline Leaked
  2. Redmi Pad 2 With 11-Inch 2.5K Display, 9,000mAh Battery Launched in India
  3. Apple Back to School Offer Brings Discounts on iPad Air, Other Products
  4. Vivo Y400 Pro 5G: Everything We Know Ahead of India Launch on June 20
  5. iQOO Z10 Lite 5G With 6,000mAh Battery Launched in India: Price, Features
  6. Pixel 10, Pixel 10 Pro Alleged Case Hint at Design Changes
  7. Vivo X200 FE Launch Date, Colours, and Design Revealed Ahead of Launch
  8. Boat Wave Fortune Smartwatch With NFC Tap & Pay Feature Launched in India
  9. Gemini and ChatGPT Would Not Exist Without This Dutch Company: Know Why
  10. Nothing Headphone 1 Price, Colour Options Leaked Ahead of Launch
  1. SpaceX Launches 26 Starlink Satellites from California to Expand Low Earth Orbit Internet Network
  2. NASA and DoD Simulate Critical Abort Scenarios to Secure Artemis II Moon Mission
  3. Brain’s Built-In Signal Threshold Helps Differentiate Imagination from Reality
  4. Feather-Legged Lace Weaver Spider Uses Toxic Silk Instead of Fangs to Kill Its Prey
  5. New Habitability Model Helps Identify Which Alien Planets Might Be Able to Host Life
  6. Warner Bros. Games Restructures to Focus on Harry Potter, Game of Thrones, Mortal Kombat and DC Franchises
  7. Google Pixel 10, Pixel 10 Pro Alleged Case Suggests Minor Design Changes From Predecessors
  8. Oppo Reno 14 5G, Reno 14 Pro 5G India Launch Timeline Leaked
  9. Nothing Phone 3 to Offer Longer Android and Security Update Support Than Its Predecessor
  10. Boat Wave Fortune Smartwatch With NFC Tap & Pay Feature, Bluetooth Calling Launched in India
Gadgets 360 is available in
Download Our Apps
Available in Hindi
© Copyright Red Pixels Ventures Limited 2025. All rights reserved.