nodes/SeanScripts-ComfyUI-Unload-Model
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update README.md

Browse Source 
I'm not great at markdown sorry
This commit is contained in:
SeanScripts
2024-09-02 17:39:29 -07:00
parent 3c510bced3
commit d1581ac750
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+2 -2
View File
@@ -6,12 +6,12 @@ Includes two nodes: Unload Model and Unload All Models. These are used as passth
The main use of this is to unload the CLIP model after getting the embedding for the prompt, because it's just a waste of VRAM to keep it loaded while sampling, and VRAM is at a premium with Flux. For example, if you use the Q4_K_S version of Flux dev, with unloading the CLIP model, only about 10 GB of VRAM is used when generating at 1024 x 1024, which means that users with 12 or 16 GB GPUs might be able to run the model without going into shared memory, which could be a huge speedup. Please let me know if you test it and see this benefit. This could also be useful if you want to free up VRAM so you can keep a local LLM loaded for prompt generation.
# Installation
## Installation
1. Clone this repo into the `custom_nodes` folder
2. Restart the ComfyUI server
# Usage
## Usage
Add the Unload Model or Unload All Models node in the middle of a workflow to unload a model at that step. Use any value for the `value` field and the model you want to unload for the `model` field, then route the output of the node to wherever you would have routed the input `value`.