The LTX Video model can generate five seconds of 24fps videos in four seconds.
The open-source LTX Video AI model can be downloaded from Huggingface and ComfyUI
Photo Credit: Lightricks
Lightricks, a software company focused on image and video editing, released an open-source artificial intelligence (AI) video model in preview last week. Dubbed LTX Video, the AI model can generate medium-resolution videos in real time. While real-time video generation capability exists in a few large language models (LLMs), this is the first one to be open-sourced. The company also stated that once the full version is released, it will be free for both personal and commercial use and can be integrated into the LTX Studio.
In a series of posts on X (formerly known as Twitter), Lightricks detailed its open-source AI model. The LTX Video accepts both text and images as input and can generate five-second-long videos in 768 x 512p resolution. While the preview model caps the video quality at medium resolution, it offers near real-time generation with four seconds of wait time. However, this generation time is possible on devices equipped with the Nvidia H100 chip.
The company claims that the AI model can generate dynamic videos with high prompt adherence and does not require high-end resources to run. To locally run the LTX Video, users will need a GPU similar to the level of RTX 4090. Lightricks also highlighted that the model architecture is based on the Diffusion Transformer but uses only two billion parameters to keep its size small.
LTX Video is currently available on GitHub, Hugging Face, and ComfyUI to download. To test the model's capabilities before downloading it from the hosting websites, users can go to the model page on Fal.ai here.
The AI model can also be integrated with a wide range of external editing tools to further fine-tune the generated videos. The company also plans to release the full version of the video model and make it open source for both personal use cases and commercial usage. The full version of the tool will also be integrated with the LTX Studio, the company's AI-powered storyboard platform.
Get your daily dose of tech news, reviews, and insights, in under 80 characters on Gadgets 360 Turbo. Connect with fellow tech lovers on our Forum. Follow us on X, Facebook, WhatsApp, Threads and Google News for instant updates. Catch all the action on our YouTube channel.