Commit Graph
29 Commits
Author SHA1 Message Date
John Pollock 2f605e0db3 Add WanVideoVACEEncode and enhance WanVideoEncode for multi-GPU support
- Implemented WanVideoVACEEncode class for encoding with VACE, including input parameters for width, height, number of frames, and strength.
- Enhanced WanVideoEncode class to support multi-GPU encoding, with additional parameters for noise augmentation and latent strength.
- Updated device management to ensure proper device context during encoding processes.
2025-10-09 14:41:53 -05:00
John Pollock ddfc95d4a6 Deprecate HunyuanVideoWrapper support
Re-synchronize first node for WanVideoWrapper - LoadWanVideoT5TextEncoder
2025-10-05 23:54:41 -05:00
John Pollock 2a6a8f4c2b workflow cleanup 2025-09-30 20:33:48 -05:00
John Pollock 54b7c5b0e6 Advanced Checkpoint and Advanced DisTorch2 Checkpoint loaders (https://github.com/pollockjj/ComfyUI-MultiGPU/issues/95), Fix CLiP loading device when MultGPU or DisTorch2 is invoked.
Advanced Checkpoint Loaders allow users to map each of the elements of the checkpoint to a different device, or in the case of DisTorch2, shard the UNet and CLiP .safetensors arbitrarily whilst ensuring actual computation remains on selected `compute` device.

Added example workflow for standard and DisTorch2 MultGPU checkpoint loaders.
2025-08-31 01:45:13 -05:00
John Pollock 336e236105 Fix for wanvideo bug and add new example 2025-08-29 20:50:55 -05:00
John Pollock 4367c892d8 Eliminate unused safetensor loading analysis method and update example configurations, adding one with LoRAs as one of the tested configurations to avoid the issue seen during initial release. 2025-08-24 04:29:32 -05:00
John Pollock 545da7f741 Refactor: Reorganize and update example workflows
This commit introduces a major reorganization of the `examples` directory to improve clarity and discoverability. Workflows are now grouped into subdirectories based on the features they demonstrate (e.g., `distorch`, `distorch2`, `gguf`, `multiGPU`).

Key changes:
- Moved existing example JSON files into new categorized folders.
- Added several new and updated workflows, particularly for DisTorch2.
- Removed outdated or redundant example files.
- Renamed an internal function from `..._gguf_v2` to `..._safetensor_v2` to better reflect its broader functionality in DisTorch2.
2025-08-14 12:45:15 -05:00
John Pollock d4b930776e MultiGPU patches for WanVideoWrapper - took a slightly different approach on these nodes, as I my intention was always to play nice with Kijai's code.
Ideally this enables full MultiGPU capability for all of the WanVideoWrapper loader/block swap/sampler nodes.
2025-08-06 17:33:18 -05:00
John Pollock 582ca6a247 WanVideoWrapper MultiGPU integration - custom wrapper nodes
- Created custom implementations for all WanVideo nodes with explicit device selection
- Added WanVideoBlockSwap with dual device control (swap_device and model_offload_device)
- Created WanVideoModelLoader_TWO for multi-model workflows to avoid race conditions
- Discovered core ComfyUI bug: safetensors loader ignores device index (uses device.type instead of str(device))
- All wrapper nodes use runtime module patching to override WanVideoWrapper's cached device variables
- Extensive logging added for debugging device assignments
2025-08-05 18:59:16 -05:00
John Pollock 2d81ef0a21 Support for kijai's ComfyUI-WanVideoWrapper 2025-03-23 13:40:05 -05:00
John Pollock e36cec9fb7 Add new assets and update README for DisTorch 2.0 features 2025-02-07 21:45:41 -06:00
John Pollock c8c4e74692 cleaning up experimental workflows 2025-02-07 19:17:06 -06:00
John Pollock 1ffa88f271 Benchmarking JSON for Reddit user 2025-02-06 14:29:26 -06:00
John Pollock 08e3bbfcb0 add example for reddit user 2025-02-06 11:53:05 -06:00
John Pollock 4182275f85 Multiple LoRA DisTorch example 2025-02-05 10:55:17 -06:00
John Pollock df779bf820 Add new example JSON for Maleficent_End8551 workflow 2025-02-01 12:35:49 -06:00
John Pollock f5038d73bd bitsandbytes_NF4 example workflows 2025-02-01 08:00:00 -06:00
John Pollock 11d41b5192 Example of taking lowvram flow even lower 2025-02-01 06:19:40 -06:00
John Pollock 89ded6cc48 Added new ltxvideo example for lowvram, high dram - run ~5 minutes for a 5 second video on my 3090 2025-01-31 11:42:49 -06:00
John Pollock 005b5b1882 This release includes an embeddings adapter for the IP2V part of kijai's CLIP loader for HunyuanVideo. See examples. Bump version to 1.4.3 and update category for HunyuanVideoEmbeddingsAdapter to multigpu; enhance README with new workflow examples for HunyuanVideo GGUF-quantized models. 2025-01-29 11:55:16 -06:00
John Pollock 5ff6a90b17 preparing DisTorch for release to :main: 2025-01-28 06:06:53 -06:00
John Pollock 8f3ff06fa3 rename files for consistency, new DisTorch examples 2025-01-28 05:19:50 -06:00
John Pollock e73c8bd5e3 Add experimental DiffSynth block-swapping support via new GPU offload device
- Adds HyVideoModelLoaderDiffSynthMultiGPU node implementing DiffSynth block-swapping
- Introduces offload_device selection for secondary GPU utilization
- Updates documentation with known behaviors and expected OOM patterns
- Adds example workflow demonstrating higher resolution/longer duration video generation
- Maintains backwards compatibility with existing MultiGPU workflows
2025-01-15 06:53:59 -06:00
John Pollock 2447586cf4 Added examples of device_selector node, include use with kijai's hunyuanvideowrapper custom_node showing both methods of usage 2025-01-11 17:58:15 -06:00
John Pollock 67c1641ab2 Update to examples to include CPU offloads, as well as update readme.md with new examples and their requirements to run. 2024-12-27 13:22:16 -06:00
John Pollock d13f821547 Bump version to 1.1.0 and update README to reflect CPU offloading capabilities; rename example JSON for clarity 2024-12-27 04:54:21 -06:00
John Pollock 211b957f75 Adding hunyuan video 2 gpu example workflow. 2024-12-24 21:19:47 -06:00
John Pollock 19c0abd5ec Updated example workflows, added additional experimental workflows, added coverage for LTX loader 2024-12-23 15:39:23 -06:00
Alexander Dzhoganov b5462877f3 Initial commit 2024-08-04 19:36:59 +03:00