Stability AI Releases Stable Video 3D, an AI Model That Can Render 3D Videos From 2D Images

Stable Video 3D is available now for commercial and non-commercial usage.

Written by Akash Dutta, Edited by Siddharth Suvarna | Updated: 19 March 2024 11:31 IST

Highlights

Stable Video 3D generates orbital videos based on single image inputs
The model comes in two variants — SV3D_u and SV3D_p
Stability AI has made the model weights available on Hugging Face

Stability AI Releases Stable Video 3D, an AI Model That Can Render 3D Videos From 2D Images

Stable Video 3D uses 3D Neural Radiance Fields (NeRF) to improve the quality of the output

Photo Credit: X/Stability AI

Stability AI released a new 3D video rendering model dubbed Stable Video 3D (SV3D) on Monday. The artificial intelligence (AI) model generates videos, but unlike popular video generators such as OpenAI's Sora, Runway AI, and Pika 1.0, it does not take text inputs. The main focus of SV3D is to take the image input and turn the 2D photo into an orbital 3D model. The company has made the new AI model public for commercial as well as non-commercial usage.

The announcement was made by the official account of Stability AI on X (formerly known as Twitter) in a post where it said, “Today, we are releasing Stable Video 3D, a generative model based on Stable Video Diffusion. This new model advances the field of 3D technology, delivering greatly improved quality and multi-view.” The announcement came just a month after the AI firm announced Stable Diffusion 3, which improves performance in multi-subject prompts.

Today, we are releasing Stable Video 3D, a generative model based on Stable Video Diffusion. This new model advances the field of 3D technology, delivering greatly improved quality and multi-view.

The model is available now for commercial and non-commercial use with a Stability… pic.twitter.com/cc5T9RRH3L
— Stability AI (@StabilityAI) March 18, 2024

Stable Video 3D AI model is being made available in two different variants — SV3D_u and SV3D_p. The former is capable of generating orbital videos based on single image inputs but it does not use camera conditioning. This means that while the objects in the 2D image will be converted into 3D renders, there will not be any camera movement. The more capable variant is SV3D_p which accommodates both single images and orbital views which will also allow it to create fully rendered 3D videos along specified camera paths.

As per the company, the AI model solves the inconsistency issues faced by older generation models such as Stable Zero123. SV3D leverages Neural Radiance Fields (NeRF) and mesh representations to improve the quality and consistency of rendered videos. “Additionally, in order to reduce the issue of baked-in lighting, Stable Video 3D employs a disentangled illumination model that is jointly optimized along with 3D shape and texture,” Stability AI said in a detailed blog post.

The Stable Video 3D is now available for both commercial and non-commercial usage. For commercial usage, users will require a Stability AI membership which starts at $20 (roughly Rs. 1650) a month for the Professional tier. For non-commercial usage, users can download the model weights on Hugging Face.

Is the Samsung Galaxy Z Flip 5 the best foldable phone you can buy in India right now? We discuss the company's new clamshell-style foldable handset on the latest episode of Orbital, the Gadgets 360 podcast. Orbital is available on Spotify, Gaana, JioSaavn, Google Podcasts, Apple Podcasts, Amazon Music and wherever you get your podcasts.

Affiliate links may be automatically generated - see our ethics statement for details.

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.