nodes/1038lab-ComfyUI-QwenVL
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Enhance Qwen model support and fix VRAM leaks

Browse Source 
Expanded model support for Qwen3.5, Qwen3.6, and Qwen3.8. Improved memory management and installation guide, along with bug fixes and new features.
This commit is contained in:
AI Lab
2026-08-20 17:58:46 -07:00
committed by GitHub
parent b6f4e19242
commit 88d47a8e2b
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
update.md
+1
View File
@@ -6,6 +6,7 @@
- **Expanded Model Catalog**: Added direct support for Qwen3.5-VL-7B, Qwen3.6-VL-MoE, and Qwen3.8-VL-14B within the GGUF nodes.
- **Native Memory Management**: Implemented `comfy.model_management` to gracefully handle cache clearing (`soft_empty_cache` and `unload_all_models`) directly within the ComfyUI ecosystem, eliminating VRAM leaks when models are unloaded.
- **Simplified Installation Guide**: Updated `llama-cpp-python` dependency to `>=0.3.40` which natively supports all new vision chat handlers and MoE offloading without complex version matrices. Added clear console warnings pointing users to `docs/LLAMA_CPP_PYTHON_VISION_INSTALL.md` if the vision bindings are missing.
<img alt="image" src="https://github.com/user-attachments/assets/b257ad2e-b639-4b55-ac00-07a11955c187" />
### 🛠️ Feature Additions & Bug Fixes
- **VRAM Leak Fix (Issue #182)**: Fixed a critical issue where VRAM was not released after inference when `keep_model_loaded=False`. The GGUF nodes now explicitly call `self.llm.close()` to free the GGML C++ backend memory, and the Transformer nodes now properly clear `torch._dynamo` cache and force PyTorch garbage collection.