A powerful extension for ComfyUI that enables distributed and parallel processing across multiple GPUs and machines. Generate more images and videos and accelerate your upscaling workflows by leveraging all available GPU resources in your network.
Key Features
Parallel Workflow Processing
- Run the same workflow on multiple GPUs simultaneously with different seeds
- Get multiple outputs in the same time it takes to generate one
- The more workers you have, the more output you get
- Supports both video and images
Distributed Upscaling
- Supercharge Ultimate SD Upscale by having tiles processed across multiple GPUs
- Intelligent work distribution for asymmetrical GPU setups
- Static distribution for similar/same GPUs
- Supports both single images and image batches
Convenience
- Automatically set up your local workers and easily add remote and cloud workers
- Manage the workers through the UI panel
- Easily convert any workflow to a distributed one, using no more than 2 nodes
Management & Monitoring
- Worker Management - Launch and monitor workers from the UI
- Network Support - Use GPUs across different machines on your network
- Cloud Support - Use GPUs from cloud providers
- Real-time Monitoring - Track worker status and performance from the UI
- Easy Configuration - JSON-based configuration with UI controls
Requirements
- ComfyUI installation
- Desktop app not supported currently
- Multiple GPUs
- That's it
Installation
-
Clone this repository into your ComfyUI custom nodes directory:
git clone https://github.com/robertvoy/ComfyUI-Distributed.git -
Restart ComfyUI - If you'll be using remote/cloud workers, add
--enable-cors-headerto your launch arguments on the master
Nodes
Distributed Collector
Collects and combines results from distributed processing
Usage: Place after any image generation node to enable distributed processing. Works automatically when workers are enabled.
Distributed Seed
Ensures unique seeds across distributed workers for varied generations
Usage: Connect to any seed input. Each worker automatically receives an offset seed to ensure randomisation. Alternatively, you can connect a seed node directly to this node's seed input, which will automatically handle seed offsetting across all workers.
Image Batch Divider
Divides image batches, used video
Usage: Place after the Distributed Collector and set the divide_by to the number of GPUs you are using (including the master)
Ultimate SD Upscale Distributed
Distributed version of Ultimate SD Upscale that processes tiles across multiple GPUs, making upscaling much faster
Usage:
- Upscale your image with a regular upscale model (ESRGAN, etc.)
- Feed the upscaled image into this node
- Configure tile settings
- Enable workers for fast processing
Workflow Examples
Basic Distributed Generation
- Create your normal ComfyUI workflow
- Add Distributed Seed → connect to sampler's seed
- Add Distributed Collector → after VAE Decode
- Enable workers in the UI
- Run the workflow!
Distributed Upscaling
- Load your image
- Upscale with ESRGAN or similar
- Connect to Ultimate SD Upscale Distributed
- Configure tile settings
- Enable workers for faster processing
FAQ
Does it combine VRAM of multiple GPUs? No.
Does it speed up the generation of a single image/video? No, it gives you more images/videos, rather than a faster single one. However, it does speed up the upscaling of a single image using the Ultimate SD Upscale Distributed.
Does it work with ComfyUI desktop app? Not currently.
Can I combine my RTX 5090 with a GTX 980 to get faster results? You can, but this works best with cards that are similar. If you have a large imbalance between GPUs, you will run into bottlenecks. Although you could still benefit from Ultimate SD Upscale Distributed with static_distribution set to false. This will allow the faster card to process more. Note this only works for upscaling.
Does this work with cloud providers? Yes, see setup guides.
Can I make this work with my Docker setup? Yes, it does work, but you need to know how to set up your Docker environment. I won't be able to assist you with that.
Development
This project is under active development. Contributions are welcome!