nodes/Zuellni-ComfyUI-ExLlama-Nodes
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update readme

Browse Source
This commit is contained in:
Zuellni
2023-11-23 20:12:02 +01:00
committed by GitHub
parent 2f1affecb4
commit 4d65f3c4db
1 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+3 -3
View File
@@ -8,12 +8,12 @@ git clone https://github.com/Zuellni/ComfyUI-ExLlama-Nodes
pip install -r requirements.txt pip install -r requirements.txt
``` ```
Optionally, you can also install [flash-attention](https://github.com/Dao-AILab/flash-attention) by uncommenting the relevant lines in the requirements file. If you see any ExLlama-related errors while loading, install it manually following the instructions from [here](https://github.com/turboderp/exllamav2#method-2-install-from-release-with-prebuilt-extension). Optionally, you can install [flash-attention](https://github.com/Dao-AILab/flash-attention) by uncommenting the relevant lines in the requirements file.<br>If you see any ExLlama-related errors while loading, install it manually following the instructions from [here](https://github.com/turboderp/exllamav2#method-2-install-from-release-with-prebuilt-extension).
## Nodes ## Nodes
Name | Description Name | Description
:--- | :--- :--- | :---
Loader | Used to load EXL2/GPTQ Llama models. You can find a lot of them on [Hugging Face](https://huggingface.co/TheBloke). Clone the model repository or download all the files in it and place them in an empty directory, then specify the path in `model_dir`. The `model.safetensors` file won't work on its own. Loader | Used to load EXL2/GPTQ Llama models. You can find a lot of them on [Hugging Face](https://huggingface.co/TheBloke).<br>Clone the model repo and place it in `models/llm` or specify your own `llm` path in `extra_model_paths.yaml`.
Generator | Generates a `string` based on the given input for use with other nodes. Generator | Generates a `string` based on the given input for use with other nodes.
Preview | Displays generated outputs in the UI. Preview | Displays generated outputs in the UI.
Replace | Replaces variables enclosed in brackets, such as `[a]`, with their values. Replace | Replaces variables enclosed in brackets, such as `[a]`, with their values.
@@ -21,4 +21,4 @@ Replace | Replaces variables enclosed in brackets, such as `[a]`, with their val
## Workflow ## Workflow
The image below can be opened in ComfyUI. The image below can be opened in ComfyUI.
![workflow](https://github.com/Zuellni/ComfyUI-ExLlama-Nodes/assets/123005779/26acb5fd-f2d9-473a-b0cf-6c92af3bac90) ![workflow](https://github.com/Zuellni/ComfyUI-ExLlama-Nodes/assets/123005779/cb20b040-9856-4dab-aed0-4b318bc2d805)