aigc-apps-VideoX-Fun/comfyui/README.md

ComfyUI CogVideoX-Fun

Easily use CogVideoX-Fun inside ComfyUI!

• Installation
• Node types
• Example workflows

1. Installation

Option 1: Install via ComfyUI Manager

TBD

Option 2: Install manually

The CogVideoX-Fun repository needs to be placed at ComfyUI/custom_nodes/CogVideoX-Fun/.

cd ComfyUI/custom_nodes/

# Git clone the cogvideox_fun itself
git clone https://github.com/aigc-apps/CogVideoX-Fun.git

# Git clone the video outout node
git clone https://github.com/Kosinkadink/ComfyUI-VideoHelperSuite.git

cd CogVideoX-Fun/
python install.py

2. Download models into ComfyUI/models/CogVideoX-Fun/

Name	Storage Space	Url	Hugging Face	Description
CogVideoX-Fun-2b-InP.tar.gz	Before extraction:9.69 GB / After extraction: 13.0 GB	Download	🤗Link	Our official graph-generated video model is capable of predicting videos at multiple resolutions (512, 768, 1024, 1280) and has been trained on 144 frames at a rate of 24 frames per second.

Node types

• LoadCogVideoX_Fun_Model
  • Loads the CogVideoX-Fun model
• TextBox
  • Write the prompt for CogVideoX-Fun model
• CogVideoX_Fun_I2VSampler
  • CogVideoX-Fun Sampler for Image to Video
• CogVideoX_Fun_T2VSampler
  • CogVideoX-Fun Sampler for Text to Video
• CogVideoX_Fun_V2VSampler
  • CogVideoX-Fun Sampler for Video to Video

Example workflows

Video to video generation

Our ui is shown as follow, this is the download link of the json:

You can run the demo using following video: demo video

Image to video generation

Our ui is shown as follow, this is the download link of the json:

You can run the demo using following photo:

Text to video generation

Our ui is shown as follow, this is the download link of the json: