From 72a178ed63de7ecabf3e176799a59fee43cfe202 Mon Sep 17 00:00:00 2001 From: City <125218114+city96@users.noreply.github.com> Date: Sat, 21 Oct 2023 00:04:26 +0200 Subject: [PATCH] Update README.md --- README.md | 25 +++++++++++++++++++++++-- 1 file changed, 23 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 0ae20ff..d5c3bd1 100644 --- a/README.md +++ b/README.md @@ -1,2 +1,23 @@ -# ComfyUI_ExtraModels -Support for miscellaneous image models. Currently supports: DiT, +# Extra Models for ComfyUI + +This repository aims to add support for various random image diffusion models to ComfyUI. + +## Installation + +Simply clone this repo to your custom_nodes folder using the following command: `git clone https://github.com/city96/ComfyUI_ExtraModels custom_nodes/ComfyUI_ExtraModels`. + +## DiT +### Model info / implementation +- Uses class labels instead of prompts +- Limited to 256x256 or 512x512 images +- Same latent space as SD1.5 (works with the SD1.5 VAE) +- Works in FP16, but no other optimization (yet) + +### Usage + +1. Download the model weights from the [DiT Repo](https://github.com/facebookresearch/DiT) or via this [direct link to the XL/2-512x512 model](https://dl.fbaipublicfiles.com/DiT/models/DiT-XL-2-512x512.pt) +2. Place them in `ComfyUI\models\dit` (created on first run after installing the extension) +3. Load the model and select the class labels as shown in the image below + +Conditioning nodes *should* work for combining multiple labels. The area ones don't since the model currently can't handle dynamic input dimensions. +