nodes/pollockjj-ComfyUI-MultiGPU
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Add MultiGPU support for various model loaders and encoders

Browse Source
This commit is contained in:
John Pollock
2025-10-13 02:10:41 -05:00
parent 01b41f4514
commit fd60ae6f65
25 changed files with 648 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
web/docs/DownloadAndLoadFlorence2ModelMultiGPU.md
+16
View File
@@ -0,0 +1,16 @@
# DownloadAndLoadFlorence2ModelMultiGPU
`DownloadAndLoadFlorence2ModelMultiGPU` mirrors the download-and-load helper supplied by `ComfyUI-Florence2`, but with explicit device and offload selection so large Florence2 checkpoints can live on secondary GPUs or CPU memory.
## Inputs
All original inputs from `DownloadAndLoadFlorence2Model` remain available. The MultiGPU wrapper introduces two optional selectors:
| Parameter | Data Type | Description |
| --- | --- | --- |
| `device` | `STRING` | Compute device to host the model once loaded. |
| `offload_device` | `STRING` | Device that receives automatic offloads (defaults to `cpu`). |
## Outputs
Outputs match the base Florence2 helper (model handle plus aux data). The only difference is that the returned model is already resident on the device you specified.