Add MultiGPU support for various model loaders and encoders

This commit is contained in:
John Pollock
2025-10-13 02:10:41 -05:00
parent 01b41f4514
commit fd60ae6f65
25 changed files with 648 additions and 0 deletions
@@ -0,0 +1,26 @@
# LoadWanVideoT5TextEncoderMultiGPU
`LoadWanVideoT5TextEncoderMultiGPU` loads WanVideo T5 text encoders while letting you choose the MultiGPU device used for embedding work. The node returns both the encoder handle and the device string so downstream text nodes inherit placement automatically.
## Inputs
### Required
| Parameter | Data Type | Description |
| --- | --- | --- |
| `model_name` | `STRING` | T5 model from `ComfyUI/models/text_encoders`. |
| `precision` | `STRING` | Base precision for the encoder (`fp32` or `bf16`). |
### Optional
| Parameter | Data Type | Description |
| --- | --- | --- |
| `device` | `STRING` | MultiGPU device (defaults to secondary GPU when available). |
| `quantization` | `STRING` | Enable FP8 quantisation (`fp8_e4m3fn`) when supported. |
## Outputs
| Output Name | Data Type | Description |
| --- | --- | --- |
| `wan_t5_model` | `WANTEXTENCODER` | Loaded Wan T5 encoder bundle. |
| `load_device` | `MULTIGPUDEVICE` | Device string to reuse with `WanVideoTextEncode*` nodes. |