molbal
fa73d497f1
Added LICENSE file, project icon, and moved image to assets directory. Updated README to reference new image location and added pyproject.toml for project metadata and configuration.
37 lines
1.2 KiB
Markdown
37 lines
1.2 KiB
Markdown
# LLM-CLIP Custom Nodes for ComfyUI
|
|
|
|
These nodes allow you to use a distilled Qwen3-4B model as your text encoder in Stable Diffusion XL.
|
|
|
|
## Installation
|
|
|
|
0. Download https://huggingface.co/molbal/qwen-clip-resampler-adapter/blob/main/resampler.pth and place it in the **text encoders** directory
|
|
1. Navigate to your ComfyUI custom nodes folder.
|
|
2. Clone this repository.
|
|
3. Install the required Python packages.
|
|
```bash
|
|
pip install transformers accelerate peft bitsandbytes
|
|
```
|
|
|
|
## Nodes
|
|
|
|
### LLM CLIP Loader
|
|
|
|
This node loads the LLM and the Resampler weights.
|
|
|
|
* **base_repo_id:** The Hugging Face ID of the base LLM (use `unsloth/Qwen3-4B-unsloth-bnb-4bit`).
|
|
* **resampler_name:** The local `.pth` file containing your trained Resampler weights.
|
|
* **lora_repo_id:** The Hugging Face ID or local path of your trained LoRA adapter. (use `molbal/qwen-clip-resampler-adapter`)
|
|
|
|
### LLM CLIP Text Encode
|
|
|
|
This node converts your text prompt into SDXL conditioning.
|
|
|
|
* **text:** Multiline input for your prompt.
|
|
* **clip_bundle:** Connection from the Loader node.
|
|
|
|
## Usage
|
|
|
|
|
|
|
|
Connect the `CONDITIONING` output from the **LLM CLIP Text Encode** node to the `positive` or `negative` inputs of a KSampler. This replaces the standard CLIP Text Encode nodes.
|