Extra Models for ComfyUI
This repository aims to add support for various random image diffusion models to ComfyUI.
Installation
Simply clone this repo to your custom_nodes folder using the following command: git clone https://github.com/city96/ComfyUI_ExtraModels custom_nodes/ComfyUI_ExtraModels.
DiT
Model info / implementation
- Uses class labels instead of prompts
- Limited to 256x256 or 512x512 images
- Same latent space as SD1.5 (works with the SD1.5 VAE)
- Works in FP16, but no other optimization (yet)
Usage
- Download the original model weights from the DiT Repo or the converted FP16 safetensor ones from Huggingface.
- Place them in
ComfyUI\models\dit(created on first run after installing the extension) - Load the model and select the class labels as shown in the image below
- Make sure to use the Empty label conditioning for the Negative input of the KSampler!
ConditioningCombine nodes should work for combining multiple labels. The area ones don't since the model currently can't handle dynamic input dimensions.