FearL0rd
f74eae7e64
Fixed infinite recursion: Added check if hasattr(replica, '_original_forward') and replica is target_model in the worker to use the original forward method when the replica is the original model, preventing parallel_forward from calling itself recursively. Device reference safety: Converted devices_ref and weights_ref to tuples to prevent accidental modification after assignment. Explicit device comparison: Used replica is target_model to detect when we're using the original model vs a clone. Consistent fallback handling: Both the single-device fallback and the OOM fallback now check for _original_forward to use the correct method. Better logging: Added explicit print at the end showing which devices are actually being used. This ensures that when CUDA:0 is the original device and CUDA:1 is a clone, both are used correctly without the original device causing a recursive loop.
15 lines
1.0 KiB
TOML
15 lines
1.0 KiB
TOML
# pyproject.toml
|
|
[project]
|
|
name = "ComfyUI-ParallelAnything" # Unique identifier for your node. Immutable after creation.
|
|
description = "This suite of nodes unlocks high-performance parallel processing in ComfyUI by utilizing **Model Replication**. Unlike standard offloading which moves a single model instance between devices, these nodes create independent replicas of the model on each selected GPU/CPU, allowing for true simultaneous batch processing."
|
|
version = "1.0.6" # Custom Node version. Must be semantically versioned.
|
|
license = { file = "LICENSE.txt" }
|
|
dependencies = [] # Filled in from requirements.txt
|
|
|
|
[project.urls]
|
|
Repository = "https://github.com/FearL0rd/ComfyUI-ParallelAnything"
|
|
|
|
[tool.comfy]
|
|
PublisherId = "fearl0rd" # TODO (fill in Publisher ID from Comfy Registry Website).
|
|
DisplayName = "ComfyUI-ParallelAnything" # Display name for the Custom Node. Can be changed later.
|
|
Icon = "https://raw.githubusercontent.com/FearL0rd/ComfyUI-ParallelAnything/refs/heads/main/icon.png" # SVG, PNG, JPG or GIF (MAX. 800x400px) |