Commit Graph
2 Commits
Author SHA1 Message Date
John Pollock 72a20338ef feat: patch load_models_gpu for accurate memory calculations; unpatch load_models_gpu
Refactor memory management in distorch_2.py to patch load_models_gpu instead of LoadedModel.model_memory_required. Implement correct memory reporting based on model flags (eject_models and is_distorch_model), ensuring proper eviction logic and improved handling of virtual VRAM. This drives behavior purely by either comfy core matching or DisTorch flag, fixing potential issues in multi-GPU setups.
2025-10-04 17:16:51 -05:00
John Pollock 7e0d484b17 docs: Add documentation for standard, gguf, and DisTorch nodes/wrappers 2025-09-30 18:05:48 -05:00