98 lines
6.7 KiB
Markdown
98 lines
6.7 KiB
Markdown
# ComfyUI-LTXVideo
|
|
|
|
[](https://github.com/Lightricks/LTX-2)
|
|
[](https://ltx.io/model)
|
|
[](https://huggingface.co/Lightricks/LTX-2)
|
|
[](https://github.com/Lightricks/LTX-2/tree/main/packages/ltx-trainer)
|
|
[](https://app.ltx.studio/ltx-2-playground/i2v)
|
|
[](https://videos.ltx.io/LTX-2/grants/LTX_2_Technical_Report_compressed.pdf)
|
|
[](https://discord.gg/ltxplatform)
|
|
|
|
|
|
A collection of powerful custom nodes that extend ComfyUI's capabilities for the LTX-2 video generation model.
|
|
|
|
LTX-2 is built into ComfyUI core ([see it here](https://github.com/comfyanonymous/ComfyUI/tree/master/comfy/ldm/lightricks)), making it readily accessible to all ComfyUI users. This repository hosts additional nodes and workflows to help you get the most out of LTX-2's advanced features.
|
|
|
|
**To learn more about LTX-2** See the [main LTX-2 repository](https://github.com/Lightricks/LTX-2) for model details and additional resources.
|
|
|
|
|
|
## Prerequisites
|
|
Before you begin using an LTX-2 workflow in ComfyUI, make sure you have:
|
|
|
|
* ComfyUI installed (Download here](https://www.comfy.org/download)
|
|
* CUDA-compatible GPU with 32GB+ VRAM
|
|
* 100GB+ free disk space for models and cache
|
|
|
|
|
|
## Quick Start 🚀
|
|
|
|
We recommend using the LTX-2 workflows available in Comfy Manager.
|
|
|
|
1. Open ComfyUI
|
|
2. Click the Manager button (or press Ctrl+M)
|
|
3. Select Install Custom Nodes
|
|
4. Search for “LTXVideo”
|
|
5. Click Install
|
|
6. Wait for installation to complete
|
|
7. Restart ComfyUI
|
|
|
|
The nodes will appear in your node menu under the “LTXVideo” category. Required models will be downloaded on first use.
|
|
|
|
|
|
## Example Workflows
|
|
|
|
The ComfyUI-LTXVideo installation includes several example workflows.
|
|
You can see them all at:
|
|
'''
|
|
ComfyUI/custom_nodes/ComfyUI-LTXVideo/example_workflows/
|
|
'''
|
|
|
|
* [`Text to video full model`](./example_workflows/LTX-2_T2V_Full_wLora.json)
|
|
* [`Text to video distilled model (Fast)`](./example_workflows/LTX-2_T2V_Distilled_wLora.json)
|
|
* [`Image to video full model`](./example_workflows/LTX-2_I2V_Full_wLora.json)
|
|
* [`Image to video distilled model (Fast)`](./example_workflows/LTX-2_I2V_Distilled_wLora.json)
|
|
* [`Video to video detailer`](./example_workflows/LTX-2_V2V_Detailer.json)
|
|
* [`IC-LoRA distilled model (depth + human pose + edges)`](./example_workflows/LTX-2_ICLoRA_All_Distilled.json)
|
|
|
|
## Required Models
|
|
|
|
Download the following models:
|
|
|
|
**LTX-2 Model Checkpoint** (choose and download one of the following)
|
|
* [`ltx-2-19b-dev-fp8.safetensors`](https://huggingface.co/Lightricks/LTX-2/blob/main/ltx-2-19b-dev-fp8.safetensors)
|
|
* [`ltx-2-19b-distilled-fp8.safetensors`](https://huggingface.co/Lightricks/LTX-2/blob/main/ltx-2-19b-distilled-fp8.safetensors)
|
|
* [`ltx-2-19b-dev.safetensors`](https://huggingface.co/Lightricks/LTX-2/blob/main/ltx-2-19b-dev.safetensors)
|
|
* [`ltx-2-19b-distilled.safetensors`](https://huggingface.co/Lightricks/LTX-2/blob/main/ltx-2-19b-distilled.safetensors)
|
|
|
|
**Spatial Upsampler** - Required for current two-stage pipeline implementations in this repository
|
|
* [`ltx-2-spatial-upsampler-x2-1.0.safetensors`](https://huggingface.co/Lightricks/LTX-2/blob/main/ltx-2-spatial-upsampler-x2-1.0.safetensors)
|
|
|
|
**Temporal Upsampler** - Required for current two-stage pipeline implementations in this repository
|
|
* [`ltx-2-temporal-upsampler-x2-1.0.safetensors`](https://huggingface.co/Lightricks/LTX-2/blob/main/ltx-2-temporal-upsampler-x2-1.0.safetensors)
|
|
|
|
**Distilled LoRA** - Required for current two-stage pipeline implementations in this repository (except DistilledPipeline and ICLoraPipeline)
|
|
* [`ltx-2-19b-distilled-lora-384.safetensors`](https://huggingface.co/Lightricks/LTX-2/blob/main/ltx-2-19b-distilled-lora-384.safetensors)
|
|
|
|
**Gemma Text Encoder** (download all assets from the repository)
|
|
* [`Gemma 3`](https://huggingface.co/google/gemma-3-12b-it-qat-q4_0-unquantized/blob/main)
|
|
|
|
**LoRAs**
|
|
* [`ltx-2-19b-ic-lora-canny-control.safetensors`](https://huggingface.co/Lightricks/LTX-2-19b-IC-LoRA-Canny-Control/blob/main/ltx-2-19b-ic-lora-canny-control.safetensors)
|
|
* [`ltx-2-19b-ic-lora-depth-control.safetensors`](https://huggingface.co/Lightricks/LTX-2-19b-IC-LoRA-Depth-Control/blob/main/ltx-2-19b-ic-lora-depth-control.safetensors)
|
|
* [`ltx-2-19b-ic-lora-detailer.safetensors`](https://huggingface.co/Lightricks/LTX-2-19b-IC-LoRA-Detailer/blob/main/ltx-2-19b-ic-lora-detailer.safetensors)
|
|
* [`ltx-2-19b-ic-lora-pose-control.safetensors`](https://huggingface.co/Lightricks/LTX-2-19b-IC-LoRA-Pose-Control/blob/main/ltx-2-19b-ic-lora-pose-control.safetensors)
|
|
* [`ltx-2-19b-lora-camera-control-dolly-in.safetensors`](https://huggingface.co/Lightricks/LTX-2-19b-LoRA-Camera-Control-Dolly-In/blob/main/ltx-2-19b-lora-camera-control-dolly-in.safetensors)
|
|
* [`ltx-2-19b-lora-camera-control-dolly-left.safetensors`](https://huggingface.co/Lightricks/LTX-2-19b-LoRA-Camera-Control-Dolly-Left/blob/main/ltx-2-19b-lora-camera-control-dolly-left.safetensors)
|
|
* [`ltx-2-19b-lora-camera-control-dolly-out.safetensors`](https://huggingface.co/Lightricks/LTX-2-19b-LoRA-Camera-Control-Dolly-Out/blob/main/ltx-2-19b-lora-camera-control-dolly-out.safetensors)
|
|
* [`ltx-2-19b-lora-camera-control-dolly-right.safetensors`](https://huggingface.co/Lightricks/LTX-2-19b-LoRA-Camera-Control-Dolly-Right/blob/main/ltx-2-19b-lora-camera-control-dolly-right.safetensors)
|
|
* [`ltx-2-19b-lora-camera-control-jib-down.safetensors`](https://huggingface.co/Lightricks/LTX-2-19b-LoRA-Camera-Control-Jib-Down/blob/main/ltx-2-19b-lora-camera-control-jib-down.safetensors)
|
|
* [`ltx-2-19b-lora-camera-control-jib-up.safetensors`](https://huggingface.co/Lightricks/LTX-2-19b-LoRA-Camera-Control-Jib-Up/blob/main/ltx-2-19b-lora-camera-control-jib-up.safetensors)
|
|
* [`ltx-2-19b-lora-camera-control-static.safetensors`](https://huggingface.co/Lightricks/LTX-2-19b-LoRA-Camera-Control-Static/blob/main/ltx-2-19b-lora-camera-control-static.safetensors)
|
|
|
|
|
|
## Advanced Techniques
|
|
|
|
### Low VRAM
|
|
* For systems with low VRAM you can use the model loader nodes from [low_vram_loaders.py](./low_vram_loaders.py). Those nodes ensure the correct order of execution and perform the model offloading such that generation fits in 32 GB VRAM.
|
|
* For complete information about using LTX-2 models, workflows, and nodes in ComfyUI, please visit our [Open Source documentation](https://docs.ltx.video/open-source-model/integration-tools/comfy-ui).
|