Commit Graph
5 Commits
Author SHA1 Message Date
John Pollock ef07c0f41e Documentation clean-up 2025-10-13 02:41:07 -05:00
John Pollock fd60ae6f65 Add MultiGPU support for various model loaders and encoders 2025-10-13 02:10:41 -05:00
John Pollock 72a20338ef feat: patch load_models_gpu for accurate memory calculations; unpatch load_models_gpu
Refactor memory management in distorch_2.py to patch load_models_gpu instead of LoadedModel.model_memory_required. Implement correct memory reporting based on model flags (eject_models and is_distorch_model), ensuring proper eviction logic and improved handling of virtual VRAM. This drives behavior purely by either comfy core matching or DisTorch flag, fixing potential issues in multi-GPU setups.
2025-10-04 17:16:51 -05:00
John Pollock 989b3dc4c3 additional standard loaders documentation 2025-09-30 18:10:51 -05:00
John Pollock 7e0d484b17 docs: Add documentation for standard, gguf, and DisTorch nodes/wrappers 2025-09-30 18:05:48 -05:00