nodes/pollockjj-ComfyUI-MultiGPU
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
96 Commits 4 Branches 0 Tags
3679c268acfdff4b32fb1f03f1c6d011e65d1348
Commit Graph
96 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
John Pollock 3679c268ac 🔧 BREAKING CHANGE: DiffSynth functionality has been temporarily removed while investigating device management issue (Having two GPUs with different amounts of VRAM leads to OOMs pollockjj/ComfyUI-MultiGPU#13). 
If you were using nodes with DiffSynth in their name (like ...DiffSynthMultiGPU), please switch to the standard MultiGPU versions for now (e.g., ...MultiGPU). This change eliminates a device management issue that was affecting some Windows users.

See: https://github.com/pollockjj/ComfyUI-MultiGPU/issues/13

Most users won't be affected as this only impacts the DiffSynth variants of nodes.

If you need help modifying your workflows, please open an issue. Will revisit DiffSynth functionality once issue can be contained or worked-around

Update comfyregistry to 1.5.0 to reflect major change in functionality, in this case, a reduction.
 2025-02-06 00:32:21 -06:00
John Pollock 3e130e3dfb Remove log_comfy_states function - no longer needed 2025-01-31 06:45:43 -06:00
John Pollock 005b5b1882 This release includes an embeddings adapter for the IP2V part of kijai's CLIP loader for HunyuanVideo. See examples. Bump version to 1.4.3 and update category for HunyuanVideoEmbeddingsAdapter to multigpu; enhance README with new workflow examples for HunyuanVideo GGUF-quantized models. 2025-01-29 11:55:16 -06:00
John Pollock 3260b7e38e Add HunyuanVideoEmbeddingsAdapter class for using kijai's IP2V conditioning video embeddings in the standard sampler, allowing it to be used with GGUF/DisTorch methods. 2025-01-29 09:25:19 -06:00
John Pollock 185ecc2ab5 Push fix to check_module_exists() to Comfy Registry, thanks @3dluvr 2025-01-29 05:16:45 -06:00
John Pollock fc4e2b2f12 Merge pull request #12 from 3dluvr/main 
Fix check_module_exists() to use folder_paths
 2025-01-29 05:12:49 -06:00
3dluvr 379ecce687 Fix check_module_exists() to use folder_paths 
In Windows, module detection was failing because the method couldn't find the hard-coded custom_nodes/ folder in os.join.path.

We switch to using folder_paths which will return a correct path regardless of the platform.
 2025-01-28 19:59:44 -05:00
John Pollock 41e974f086 1.40 -->1.4.1 
Pop 1.4 (DisTorch) to Comfy Registry
 2025-01-28 15:41:13 -06:00
John Pollock 369255ff8d Merge branch 'main' of https://github.com/pollockjj/ComfyUI-MultiGPU into dev 2025-01-28 06:26:25 -06:00
John Pollock 5ff6a90b17 preparing DisTorch for release to :main: 2025-01-28 06:06:53 -06:00
John Pollock 8f3ff06fa3 rename files for consistency, new DisTorch examples 2025-01-28 05:19:50 -06:00
pollock c07a345c45 Fix case sensitivity in module check for HunyuanVideoWrapper in __init__.py 2025-01-27 18:32:20 -05:00
John Pollock 7ccea97c52 Update device allocation format and enhance module check for case insensitivity in __init__.py 2025-01-27 17:24:15 -06:00
John Pollock c74f66b9ad icon 2025-01-27 23:06:56 -06:00
John Pollock 3dbfcc7135 Chasing down bug causing incorrect patched device with distorch code. Re-integrated distorch into __init__.py as one of the consequences. 2025-01-25 17:49:12 -06:00
John Pollock d67b18474a Merge branch 'dev' of https://github.com/pollockjj/ComfyUI-MultiGPU into dev 2025-01-24 21:06:10 -06:00
John Pollock b99e152686 Refactor GGUF model patcher to enhance device handling and introduce model hashing for allocation tracking 2025-01-24 21:06:01 -06:00
pollock 101fb49848 Refactor model hash creation and logging for clarity; remove unnecessary logging statements in distorch.py 2025-01-24 11:00:38 -05:00
pollock ef614f840e Move distorch parameter storage from model attachment (non-working) to global table with hash. 2025-01-24 09:22:43 -05:00
pollock 2ac057d338 Implement model hash creation and allocation storage for MultiGPU support in GGUF model patcher 2025-01-24 05:37:17 -05:00
John Pollock 624c893942 Refactored into init.py and distorch.py 2025-01-23 13:16:18 -06:00
pollock 43d7d1582d Refactor UnetLoaderGGUF registration to support MultiGPU and DisTorch versions 2025-01-23 12:00:24 -05:00
pollock b8f314921c Refactor imports and logging messages for clarity and consistency 2025-01-23 08:50:48 -05:00
John Pollock d9899d4df1 Refactor GGUF model patcher and analysis functions to improve device handling and logging 2025-01-21 06:50:10 -06:00
John Pollock 5eb03a220a Add .vscode/settings.json to .gitignore to exclude IDE-specific settings, DisTorch work in progress. Clip also loaded and distributed. Much WIP. 2025-01-21 02:50:10 -06:00
John Pollock d8d122f397 Refactor MultiGPU module registration and improve device handling logic towards releasing on :main: 2025-01-20 12:11:12 -06:00
John Pollock 1a3cc9d151 Refactor MultiGPU device handling and improve logging for better traceability 2025-01-20 11:34:14 -06:00
John Pollock 455a4ef3f8 Refactor code structure for improved readability and maintainability 2025-01-20 07:40:33 -06:00
John Pollock a7c424f238 Continued clean-up of DisTorch code. 2025-01-19 21:04:16 -06:00
John Pollock 018aec49b0 Add detailed logging for MultiGPU device memory allocation analysis 2025-01-19 17:00:26 -06:00
John Pollock f119787bee ggml learning 2025-01-19 14:24:11 -06:00
John Pollock bb2b08efc8 docs: Update README to clarify device selection and model offloading features for ComfyUI 2025-01-15 09:35:32 -06:00
John Pollock ff7329298c feat: Releasing Hunyuan Video UNet device split support. Update project description and bump version to 1.4.0 2025-01-15 09:26:42 -06:00
John Pollock e73c8bd5e3 Add experimental DiffSynth block-swapping support via new GPU offload device 
- Adds HyVideoModelLoaderDiffSynthMultiGPU node implementing DiffSynth block-swapping
- Introduces offload_device selection for secondary GPU utilization
- Updates documentation with known behaviors and expected OOM patterns
- Adds example workflow demonstrating higher resolution/longer duration video generation
- Maintains backwards compatibility with existing MultiGPU workflows
 2025-01-15 06:53:59 -06:00
John Pollock 3ade69a38e Merge branch 'main' into dev 
give new dev branch proper start
 2025-01-14 22:12:25 -06:00
John Pollock 54157b59b6 adding animated icon 2025-01-14 15:32:12 -06:00
John Pollock a19bf2755b modified aspect ratio of icon 2025-01-12 13:24:38 -06:00
John Pollock 20ba9d099c fix: Bump version to 1.3.1 and update icon URL to raw GitHub link 2025-01-12 11:17:47 -06:00
John Pollock 92652cf816 feat: Update project description to include CPU device selection and bump version to 1.3.0; add icon URL for ComfyUI-MultiGPU 2025-01-12 11:08:41 -06:00
John Pollock 4e253c5d9a docs: Update README to reflect hunyuanvideowrapper examples and additional example for DeviceSelectorMultiGPU usage 2025-01-12 11:00:18 -06:00
John Pollock 5c6b55c61c added icon for comfy registry 2025-01-12 10:36:14 -06:00
John Pollock 2447586cf4 Added examples of device_selector node, include use with kijai's hunyuanvideowrapper custom_node showing both methods of usage 2025-01-11 17:58:15 -06:00
John Pollock 3814340e45 added test inpaint image from https://github.com/alimama-creative/FLUX-Controlnet-Inpainting 2025-01-11 10:36:50 -06:00
John Pollock ba24f572ee feat: Add DeviceSelectorMultiGPU node and device selection functionality - allowing the linking of one or more MultiGPU nodes to the same cuda device in cases where this would prevent accidental errors if should there be a device mismatch futher along in the pipeline due to non-loader nodes performing device-specific tasks or logic. 2025-01-11 10:03:40 -06:00
John Pollock 5c3c1a7f3b feat: Implement MultiGPU support for Hunyuan models and add module existence checks 
Nodes work, investating how determinisitically we MultiGPU can play nice with these nodes.
 2025-01-07 12:18:03 -06:00
John Pollock 61c9204207 Merge branch 'dev' of https://github.com/pollockjj/ComfyUI-MultiGPU into dev 
sync with upstream
 2025-01-07 07:51:43 -06:00
John Pollock 6faebe85d7 syncing with latest release from :main: 2025-01-07 06:51:01 -06:00
John Pollock 116dd935f2 chore: Rename publish workflow file and update version to 1.2.1 in pyproject.toml 2025-01-05 16:03:53 -06:00
John Pollock 4611332d12 chore: Bump version to 1.2.0 in pyproject.toml 2025-01-04 19:44:05 -06:00
John Pollock 3ce3598a5d feat: Add initial MultiGPU support for Pulid model, added module existence checks before creating MultiGPU node variant 2025-01-02 22:11:28 -06:00