ComfyUI-InstanceDiffusion
ComfyUI nodes to use InstanceDiffusion.
Original research repo: https://github.com/frank-xwang/InstanceDiffusion
Table of Contents
Installation
How to Install
Clone or download this repo into your ComfyUI/custom_nodes/ directory.
Then run pip install -r requirments.txt within the cloned repo (although if you have already set up ComfyUI you should have all these requirements already).
How to Configure Models
These models were trained by frank-xwang baked inside of StableDiffusion 1.5. These are spliced out into individual models to be used with other SD1.5 checkpoints.
Download each of these checkpoints and place them into the Installation Directory within ComfyUI/models/instance_models/ directory.
| Model Name | URL | Installation Directory |
|---|---|---|
| fusers.ckpt | huggingface | instance_models/fuser_models/ |
| positionnet.ckpt | huggingface | instance_models/positionnet_models/ |
| scaleu.ckpt | huggingface | instance_models/scaleu_models/ |
Nodes
TODO
Accompanying Node Repos
Examples
Example workflows can be found in the example_workflows/ directory.
Acknowledgements
- frank-xwang for creating the original repo, training models, etc.
- Kosinkadink for creating AnimateDiff-Evolved and providing support on integration