nodes/infinigence-ComfyUI_Model_Cache
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

[doc]: add reminder to readme

Browse Source
This commit is contained in:
zhaoyingzhuo
2025-03-28 10:35:14 +08:00
committed by Zhao Yingzhuo
parent 392178ee46
commit 4f1b7bbb4e
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+1 -1
View File
@@ -2,7 +2,7 @@
A model cached-loader custom node for ComfyUI. Recommended Comfy version: v0.3.26.
# How does it work?
Some custom nodes call comfy.utils.load_torch_file whey they are executed. However, it is waste of time for these frequently executed workflows. Here is a easy implementation for ComfyUI to cache torch file and avoid from duplicated loading torch files. By Using symbols hijack, many functions that read disk freqently can be cached in host memory. So when they are called next time, it will take no time. In order to trap tensor status after user clicks **`Clear Execution Cache`**(After user clicks that button, the tensors on gpu will be released and the caches are dirty), I add decorator "cache_model" to get the tensor status. If the tensors are released, they will load them again instead of use the dirty cache.
Some custom nodes call comfy.utils.load_torch_file whey they are executed. However, it is waste of time for these frequently executed workflows. Here is a easy implementation for ComfyUI to cache torch file and avoid from duplicated loading torch files. By Using symbols hijack, many functions that read disk freqently can be cached in host memory. So when they are called next time, it will take no time. In order to trap tensor status after user clicks **`Clear Execution Cache`**(After user clicks that button, the tensors on gpu will be released and the caches are dirty), I add decorator "cache_model" to get the tensor status. If the tensors are released, they will load them again instead of use the dirty cache. **As a reminder, this behavior will also take up some VRAM. This is the way to use VRAM to increase efficiency.**
# How to install?
This node has been registed to [Comfy Registry](https://registry.comfy.org/). If you have installed comfy manager, you can use command below: