nodes/pollockjj-ComfyUI-MultiGPU
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Documentation clean-up

Browse Source
This commit is contained in:
John Pollock
2025-10-13 02:41:07 -05:00
parent 5310d4a28d
commit ef07c0f41e
14 changed files with 253 additions and 29 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+52 -29
View File
@@ -75,40 +75,63 @@ The extension automatically creates MultiGPU versions of loader nodes. Each Mult
Currently supported nodes (automatically detected if available):
- Standard [ComfyUI](https://github.com/comfyanonymous/ComfyUI) model loaders:
- CheckpointLoaderSimpleMultiGPU/CheckpointLoaderSimpleDistorch2MultiGPU
- CLIPLoaderMultiGPU
- ControlNetLoaderMultiGPU
- DualCLIPLoaderMultiGPU
- TripleCLIPLoaderMultiGPU
- UNETLoaderMultiGPU/UNETLoaderDisTorch2MultiGPU, and
- VAELoaderMultiGPU
- [CheckpointLoaderAdvancedMultiGPU](web/docs/CheckpointLoaderAdvancedMultiGPU.md) / [CheckpointLoaderAdvancedDisTorch2MultiGPU](web/docs/CheckpointLoaderAdvancedDisTorch2MultiGPU.md)
- [CheckpointLoaderSimpleMultiGPU](web/docs/CheckpointLoaderSimpleMultiGPU.md) / [CheckpointLoaderSimpleDisTorch2MultiGPU](web/docs/CheckpointLoaderSimpleDisTorch2MultiGPU.md)
- [UNETLoaderMultiGPU](web/docs/UNETLoaderMultiGPU.md) / [UNETLoaderDisTorch2MultiGPU](web/docs/UNETLoaderDisTorch2MultiGPU.md)
- [UNetLoaderLP](web/docs/UNetLoaderLP.md)
- [VAELoaderMultiGPU](web/docs/VAELoaderMultiGPU.md) / [VAELoaderDisTorch2MultiGPU](web/docs/VAELoaderDisTorch2MultiGPU.md)
- [CLIPLoaderMultiGPU](web/docs/CLIPLoaderMultiGPU.md) / [CLIPLoaderDisTorch2MultiGPU](web/docs/CLIPLoaderDisTorch2MultiGPU.md)
- [DualCLIPLoaderMultiGPU](web/docs/DualCLIPLoaderMultiGPU.md) / [DualCLIPLoaderDisTorch2MultiGPU](web/docs/DualCLIPLoaderDisTorch2MultiGPU.md)
- [TripleCLIPLoaderMultiGPU](web/docs/TripleCLIPLoaderMultiGPU.md) / [TripleCLIPLoaderDisTorch2MultiGPU](web/docs/TripleCLIPLoaderDisTorch2MultiGPU.md)
- [QuadrupleCLIPLoaderMultiGPU](web/docs/QuadrupleCLIPLoaderMultiGPU.md) / [QuadrupleCLIPLoaderDisTorch2MultiGPU](web/docs/QuadrupleCLIPLoaderDisTorch2MultiGPU.md)
- [CLIPVisionLoaderMultiGPU](web/docs/CLIPVisionLoaderMultiGPU.md) / [CLIPVisionLoaderDisTorch2MultiGPU](web/docs/CLIPVisionLoaderDisTorch2MultiGPU.md)
- [ControlNetLoaderMultiGPU](web/docs/ControlNetLoaderMultiGPU.md) / [ControlNetLoaderDisTorch2MultiGPU](web/docs/ControlNetLoaderDisTorch2MultiGPU.md)
- [DiffusersLoaderMultiGPU](web/docs/DiffusersLoaderMultiGPU.md) / [DiffusersLoaderDisTorch2MultiGPU](web/docs/DiffusersLoaderDisTorch2MultiGPU.md)
- [DiffControlNetLoaderMultiGPU](web/docs/DiffControlNetLoaderMultiGPU.md) / [DiffControlNetLoaderDisTorch2MultiGPU](web/docs/DiffControlNetLoaderDisTorch2MultiGPU.md)
- WanVideoWrapper (requires [ComfyUI-WanVideoWrapper](https://github.com/kijai/ComfyUI-WanVideoWrapper)):
- WanVideoModelLoaderMultiGPU & WanVideoModelLoaderMultiGPU_2
- WanVideoVAELoaderMultiGPU
- LoadWanVideoT5TextEncoderMultiGPU
- LoadWanVideoClipTextEncoderMultiGPU
- WanVideoTextEncodeMultiGPU
- WanVideoBlockSwapMultiGPU
- WanVideoSamplerMultiGPU
- [WanVideoModelLoaderMultiGPU](web/docs/WanVideoModelLoaderMultiGPU.md)
- [WanVideoVAELoaderMultiGPU](web/docs/WanVideoVAELoaderMultiGPU.md)
- [WanVideoTinyVAELoaderMultiGPU](web/docs/WanVideoTinyVAELoaderMultiGPU.md)
- [WanVideoBlockSwapMultiGPU](web/docs/WanVideoBlockSwapMultiGPU.md)
- [WanVideoImageToVideoEncodeMultiGPU](web/docs/WanVideoImageToVideoEncodeMultiGPU.md)
- [WanVideoEncodeMultiGPU](web/docs/WanVideoEncodeMultiGPU.md)
- [WanVideoDecodeMultiGPU](web/docs/WanVideoDecodeMultiGPU.md)
- [WanVideoSamplerMultiGPU](web/docs/WanVideoSamplerMultiGPU.md)
- [WanVideoVACEEncodeMultiGPU](web/docs/WanVideoVACEEncodeMultiGPU.md)
- [WanVideoClipVisionEncodeMultiGPU](web/docs/WanVideoClipVisionEncodeMultiGPU.md)
- [WanVideoControlnetLoaderMultiGPU](web/docs/WanVideoControlnetLoaderMultiGPU.md)
- [WanVideoUni3C_ControlnetLoaderMultiGPU](web/docs/WanVideoUni3C_ControlnetLoaderMultiGPU.md)
- [WanVideoTextEncodeMultiGPU](web/docs/WanVideoTextEncodeMultiGPU.md)
- [WanVideoTextEncodeCachedMultiGPU](web/docs/WanVideoTextEncodeCachedMultiGPU.md)
- [WanVideoTextEncodeSingleMultiGPU](web/docs/WanVideoTextEncodeSingleMultiGPU.md)
- [LoadWanVideoT5TextEncoderMultiGPU](web/docs/LoadWanVideoT5TextEncoderMultiGPU.md)
- [LoadWanVideoClipTextEncoderMultiGPU](web/docs/LoadWanVideoClipTextEncoderMultiGPU.md)
- [FantasyTalkingModelLoaderMultiGPU](web/docs/FantasyTalkingModelLoaderMultiGPU.md)
- [Wav2VecModelLoaderMultiGPU](web/docs/Wav2VecModelLoaderMultiGPU.md) / [DownloadAndLoadWav2VecModelMultiGPU](web/docs/DownloadAndLoadWav2VecModelMultiGPU.md)
- GGUF loaders (requires [ComfyUI-GGUF](https://github.com/city96/ComfyUI-GGUF)):
- UnetLoaderGGUFMultiGPU/UnetLoaderGGUFDisTorch2MultiGPU
- UnetLoaderGGUFAdvancedMultiGPU
- CLIPLoaderGGUFMultiGPU
- DualCLIPLoaderGGUFMultiGPU
- TripleCLIPLoaderGGUFMultiGPU
- UNet family: [UnetLoaderGGUFMultiGPU](web/docs/UnetLoaderGGUFMultiGPU.md) / [UnetLoaderGGUFDisTorch2MultiGPU](web/docs/UnetLoaderGGUFDisTorch2MultiGPU.md)
- UNet Advanced bundles: [UnetLoaderGGUFAdvancedMultiGPU](web/docs/UnetLoaderGGUFAdvancedMultiGPU.md) / [UnetLoaderGGUFAdvancedDisTorch2MultiGPU](web/docs/UnetLoaderGGUFAdvancedDisTorch2MultiGPU.md)
- CLIP family: [CLIPLoaderGGUFMultiGPU](web/docs/CLIPLoaderGGUFMultiGPU.md) / [CLIPLoaderGGUFDisTorch2MultiGPU](web/docs/CLIPLoaderGGUFDisTorch2MultiGPU.md)
- Dual CLIP: [DualCLIPLoaderGGUFMultiGPU](web/docs/DualCLIPLoaderGGUFMultiGPU.md) / [DualCLIPLoaderGGUFDisTorch2MultiGPU](web/docs/DualCLIPLoaderGGUFDisTorch2MultiGPU.md)
- Triple CLIP: [TripleCLIPLoaderGGUFMultiGPU](web/docs/TripleCLIPLoaderGGUFMultiGPU.md) / [TripleCLIPLoaderGGUFDisTorch2MultiGPU](web/docs/TripleCLIPLoaderGGUFDisTorch2MultiGPU.md)
- Quadruple CLIP: [QuadrupleCLIPLoaderGGUFMultiGPU](web/docs/QuadrupleCLIPLoaderGGUFMultiGPU.md) / [QuadrupleCLIPLoaderGGUFDisTorch2MultiGPU](web/docs/QuadrupleCLIPLoaderGGUFDisTorch2MultiGPU.md)
- XLabAI FLUX ControlNet (requires [x-flux-comfy](https://github.com/XLabAI/x-flux-comfyui)):
- LoadFluxControlNetMultiGPU
- [LoadFluxControlNetMultiGPU](web/docs/LoadFluxControlNetMultiGPU.md)
- Florence2 (requires [ComfyUI-Florence2](https://github.com/kijai/ComfyUI-Florence2)):
- Florence2ModelLoaderMultiGPU
- DownloadAndLoadFlorence2ModelMultiGPU
- [Florence2ModelLoaderMultiGPU](web/docs/Florence2ModelLoaderMultiGPU.md)
- [DownloadAndLoadFlorence2ModelMultiGPU](web/docs/DownloadAndLoadFlorence2ModelMultiGPU.md)
- LTX Video Custom Checkpoint Loader (requires [ComfyUI-LTXVideo](https://github.com/Lightricks/ComfyUI-LTXVideo)):
- LTXVLoaderMultiGPU
- NF4 Checkpoint Format Loader(requires [ComfyUI_bitsandbytes_NF4](https://github.com/comfyanonymous/ComfyUI_bitsandbytes_NF4)):
- CheckpointLoaderNF4MultiGPU
- HunyuanVideoWrapper (requires [ComfyUI-HunyuanVideoWrapper](https://github.com/kijai/ComfyUI-HunyuanVideoWrapper)):
- HyVideoModelLoaderMultiGPU
- HyVideoVAELoaderMultiGPU
- DownloadAndLoadHyVideoTextEncoderMultiGPU
- [LTXVLoaderMultiGPU](web/docs/LTXVLoaderMultiGPU.md)
- NF4 Checkpoint Format Loader (requires [ComfyUI_bitsandbytes_NF4](https://github.com/comfyanonymous/ComfyUI_bitsandbytes_NF4)):
- [CheckpointLoaderNF4MultiGPU](web/docs/CheckpointLoaderNF4MultiGPU.md)
- MMAudio (requires [ComfyUI-MMAudio](https://github.com/comfyanonymous/ComfyUI-MMAudio)):
- [MMAudioModelLoaderMultiGPU](web/docs/MMAudioModelLoaderMultiGPU.md)
- [MMAudioFeatureUtilsLoaderMultiGPU](web/docs/MMAudioFeatureUtilsLoaderMultiGPU.md)
- [MMAudioSamplerMultiGPU](web/docs/MMAudioSamplerMultiGPU.md)
- Pulid (requires [PuLID_ComfyUI](https://github.com/cubiq/PuLID_ComfyUI)):
- [PulidModelLoaderMultiGPU](web/docs/PulidModelLoaderMultiGPU.md)
- [PulidInsightFaceLoaderMultiGPU](web/docs/PulidInsightFaceLoaderMultiGPU.md)
- [PulidEvaClipLoaderMultiGPU](web/docs/PulidEvaClipLoaderMultiGPU.md)
All MultiGPU nodes available for your install can be found in the "multigpu" category in the node menu.
web/docs/CLIPLoaderGGUFDisTorchMultiGPU.md
+5
View File
@@ -0,0 +1,5 @@
# CLIPLoaderGGUFDisTorchMultiGPU
> **Deprecated**: DisTorch V1 legacy nodes are no longer supported. Please migrate to [CLIPLoaderGGUFDisTorch2MultiGPU](CLIPLoaderGGUFDisTorch2MultiGPU.md) for maintained functionality.
This page is retained for archival purposes only. Use the DisTorch2 version linked above for current GGUF CLIP loading with MultiGPU support.
web/docs/DualCLIPLoaderGGUFDisTorchMultiGPU.md
+5
View File
@@ -0,0 +1,5 @@
# DualCLIPLoaderGGUFDisTorchMultiGPU
> **Deprecated**: DisTorch V1 legacy nodes are no longer supported. Please migrate to [DualCLIPLoaderGGUFDisTorch2MultiGPU](DualCLIPLoaderGGUFDisTorch2MultiGPU.md) for maintained functionality.
This documentation is retained for reference only. Use the DisTorch2 version above for dual GGUF CLIP workflows with modern allocation support.
web/docs/MMAudioFeatureUtilsLoaderMultiGPU.md
+28
View File
@@ -0,0 +1,28 @@
# MMAudioFeatureUtilsLoaderMultiGPU
`MMAudioFeatureUtilsLoaderMultiGPU` gathers the auxiliary MMAudio components (VAE, Synchformer, CLIP, and optional vocoder) on the device you choose so they can feed the sampler without consuming your main GPU.
## Inputs
### Required
| Parameter | Data Type | Description |
| --- | --- | --- |
| `vae_model` | `STRING` | VAE weights from `ComfyUI/models/mmaudio`. |
| `synchformer_model` | `STRING` | Synchformer weights from `ComfyUI/models/mmaudio`. |
| `clip_model` | `STRING` | CLIP weights from `ComfyUI/models/mmaudio`. |
### Optional
| Parameter | Data Type | Description |
| --- | --- | --- |
| `bigvgan_vocoder_model` | `VOCODER_MODEL` | Optional BigVGAN vocoder bundle. |
| `mode` | `STRING` | Feature resolution (`16k` or `44k`). |
| `precision` | `STRING` | Precision for aux weights (`fp16`, `fp32`, `bf16`). |
| `device` | `STRING` | Device receiving the feature utility stack. |
## Outputs
| Output Name | Data Type | Description |
| --- | --- | --- |
| `mmaudio_featureutils` | `MMAUDIO_FEATUREUTILS` | Fully prepared feature utility pack. |
web/docs/MMAudioModelLoaderMultiGPU.md
+24
View File
@@ -0,0 +1,24 @@
# MMAudioModelLoaderMultiGPU
`MMAudioModelLoaderMultiGPU` loads MMAudio diffusion checkpoints while letting you pin the model weights to a specific compute device. Use it to keep long-running audio generations off your primary image GPU.
## Inputs
### Required
| Parameter | Data Type | Description |
| --- | --- | --- |
| `mmaudio_model` | `STRING` | Model filename from `ComfyUI/models/mmaudio`. |
| `base_precision` | `STRING` | Weight precision to request (`fp16`, `fp32`, `bf16`). |
### Optional
| Parameter | Data Type | Description |
| --- | --- | --- |
| `device` | `STRING` | Target device for the loaded model (e.g. `cuda:0`, `cpu`). |
## Outputs
| Output Name | Data Type | Description |
| --- | --- | --- |
| `mmaudio_model` | `MMAUDIO_MODEL` | Loaded MMAudio diffusion pipeline. |
web/docs/MMAudioSamplerMultiGPU.md
+33
View File
@@ -0,0 +1,33 @@
# MMAudioSamplerMultiGPU
`MMAudioSamplerMultiGPU` renders audio clips with MMAudio while giving you control over which accelerator runs the diffusion loop and whether frames stay offloaded.
## Inputs
### Required
| Parameter | Data Type | Description |
| --- | --- | --- |
| `mmaudio_model` | `MMAUDIO_MODEL` | Core MMAudio checkpoint prepared by the loader. |
| `feature_utils` | `MMAUDIO_FEATUREUTILS` | Feature utility bundle containing VAE, Synchformer, CLIP, and optional vocoder. |
| `duration` | `FLOAT` | Target duration for the generated audio in seconds. |
| `steps` | `INT` | Number of sampler iterations to run. |
| `cfg` | `FLOAT` | Classifier-free guidance scale. |
| `seed` | `INT` | Random seed, `0` for deterministic repeatability. |
| `prompt` | `STRING` | Positive conditioning text. |
| `negative_prompt` | `STRING` | Negative conditioning text. |
| `mask_away_clip` | `BOOLEAN` | Hide supplied clip video frames during sampling. |
| `force_offload` | `BOOLEAN` | Force temporary offload of the model after sampling. |
### Optional
| Parameter | Data Type | Description |
| --- | --- | --- |
| `images` | `IMAGE` | Reference frames to guide the sampler. |
| `device` | `STRING` | Device that hosts the diffusion pass (`cuda:0`, `cpu`, etc.). |
## Outputs
| Output Name | Data Type | Description |
| --- | --- | --- |
| `audio` | `AUDIO` | Generated audio waveform tensor. |
web/docs/PulidEvaClipLoaderMultiGPU.md
+17
View File
@@ -0,0 +1,17 @@
# PulidEvaClipLoaderMultiGPU
`PulidEvaClipLoaderMultiGPU` prepares the EVA CLIP text encoder required by PuLID and keeps it on the device you nominate for downstream conditioning.
## Inputs
### Optional
| Parameter | Data Type | Description |
| --- | --- | --- |
| `device` | `STRING` | Device selected for the EVA CLIP encoder. |
## Outputs
| Output Name | Data Type | Description |
| --- | --- | --- |
| `eva_clip` | `EVA_CLIP` | Loaded EVA CLIP encoder instance. |
web/docs/PulidInsightFaceLoaderMultiGPU.md
+23
View File
@@ -0,0 +1,23 @@
# PulidInsightFaceLoaderMultiGPU
`PulidInsightFaceLoaderMultiGPU` boots the InsightFace detector needed by PuLID and pins it to the device you specify, ensuring face embeddings come from the best accelerator for your setup.
## Inputs
### Required
| Parameter | Data Type | Description |
| --- | --- | --- |
| `provider` | `STRING` | Execution backend (`CPU`, `CUDA`, `ROCM`, `CoreML`). |
### Optional
| Parameter | Data Type | Description |
| --- | --- | --- |
| `device` | `STRING` | Device assigned to the InsightFace runtime. |
## Outputs
| Output Name | Data Type | Description |
| --- | --- | --- |
| `faceanalysis` | `FACEANALYSIS` | Ready InsightFace analysis module. |
web/docs/PulidModelLoaderMultiGPU.md
+23
View File
@@ -0,0 +1,23 @@
# PulidModelLoaderMultiGPU
`PulidModelLoaderMultiGPU` loads PuLID identity preservation checkpoints onto your chosen device so facial guidance workloads can avoid your primary rendering GPU.
## Inputs
### Required
| Parameter | Data Type | Description |
| --- | --- | --- |
| `pulid_file` | `STRING` | PuLID model file from `ComfyUI/models/pulid`. |
### Optional
| Parameter | Data Type | Description |
| --- | --- | --- |
| `device` | `STRING` | Device that will host the PuLID weights. |
## Outputs
| Output Name | Data Type | Description |
| --- | --- | --- |
| `model` | `PULID` | Loaded PuLID model bundle. |
web/docs/QuadrupleCLIPLoaderGGUFDisTorchMultiGPU.md
+5
View File
@@ -0,0 +1,5 @@
# QuadrupleCLIPLoaderGGUFDisTorchMultiGPU
> **Deprecated**: DisTorch V1 legacy nodes are no longer supported. Please migrate to [QuadrupleCLIPLoaderGGUFDisTorch2MultiGPU](QuadrupleCLIPLoaderGGUFDisTorch2MultiGPU.md) for maintained functionality.
This record is kept solely for archival reasons; adopt the DisTorch2 loader referenced above for four-CLIP GGUF pipelines.
web/docs/TripleCLIPLoaderGGUFDisTorchMultiGPU.md
+5
View File
@@ -0,0 +1,5 @@
# TripleCLIPLoaderGGUFDisTorchMultiGPU
> **Deprecated**: DisTorch V1 legacy nodes are no longer supported. Please migrate to [TripleCLIPLoaderGGUFDisTorch2MultiGPU](TripleCLIPLoaderGGUFDisTorch2MultiGPU.md) for maintained functionality.
Only the DisTorch2 loader linked above receives updates; this legacy documentation is kept for historical context.
web/docs/UNetLoaderLP.md
+23
View File
@@ -0,0 +1,23 @@
# UNetLoaderLP
`UNetLoaderLP` is a low-precision variant of the standard UNet loader that disables high-precision LoRA tensors for CPU-stored models, freeing additional host memory while remaining compatible with MultiGPU device routing.
## Inputs
### Required
| Parameter | Data Type | Description |
| --- | --- | --- |
| `unet_name` | `STRING` | UNet checkpoint filename from `ComfyUI/models/unet`. |
### Optional
| Parameter | Data Type | Description |
| --- | --- | --- |
| `device` | `STRING` | Device that should serve the UNet after loading. |
## Outputs
| Output Name | Data Type | Description |
| --- | --- | --- |
| `model` | `MODEL` | Loaded UNet model with low-precision LoRA flag set. |
web/docs/UnetLoaderGGUFAdvancedDisTorchMultiGPU.md
+5
View File
@@ -0,0 +1,5 @@
# UnetLoaderGGUFAdvancedDisTorchMultiGPU
> **Deprecated**: DisTorch V1 legacy nodes are no longer supported. Please migrate to [UnetLoaderGGUFAdvancedDisTorch2MultiGPU](UnetLoaderGGUFAdvancedDisTorch2MultiGPU.md) for maintained functionality.
This legacy documentation is preserved only for reference. All new setups should switch to the DisTorch2-based loader noted above to receive current fixes and allocation features.
web/docs/UnetLoaderGGUFDisTorchMultiGPU.md
+5
View File
@@ -0,0 +1,5 @@
# UnetLoaderGGUFDisTorchMultiGPU
> **Deprecated**: DisTorch V1 legacy nodes are no longer supported. Please migrate to [UnetLoaderGGUFDisTorch2MultiGPU](UnetLoaderGGUFDisTorch2MultiGPU.md) for current DisTorch functionality.
The original DisTorch wrappers shipped with ComfyUI-MultiGPU V1 have been retired. This page remains for archival purposes only; new workflows should adopt the DisTorch2 node linked above, which receives ongoing fixes and feature updates.