From 4d65f3c4db850871df8c122d0a2e75bd982fefbd Mon Sep 17 00:00:00 2001 From: Zuellni <123005779+Zuellni@users.noreply.github.com> Date: Thu, 23 Nov 2023 20:12:02 +0100 Subject: [PATCH] Update readme --- README.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/README.md b/README.md index ac8e65a..537cc09 100644 --- a/README.md +++ b/README.md @@ -8,12 +8,12 @@ git clone https://github.com/Zuellni/ComfyUI-ExLlama-Nodes pip install -r requirements.txt ``` -Optionally, you can also install [flash-attention](https://github.com/Dao-AILab/flash-attention) by uncommenting the relevant lines in the requirements file. If you see any ExLlama-related errors while loading, install it manually following the instructions from [here](https://github.com/turboderp/exllamav2#method-2-install-from-release-with-prebuilt-extension). +Optionally, you can install [flash-attention](https://github.com/Dao-AILab/flash-attention) by uncommenting the relevant lines in the requirements file.
If you see any ExLlama-related errors while loading, install it manually following the instructions from [here](https://github.com/turboderp/exllamav2#method-2-install-from-release-with-prebuilt-extension). ## Nodes Name | Description :--- | :--- -Loader | Used to load EXL2/GPTQ Llama models. You can find a lot of them on [Hugging Face](https://huggingface.co/TheBloke). Clone the model repository or download all the files in it and place them in an empty directory, then specify the path in `model_dir`. The `model.safetensors` file won't work on its own. +Loader | Used to load EXL2/GPTQ Llama models. You can find a lot of them on [Hugging Face](https://huggingface.co/TheBloke).
Clone the model repo and place it in `models/llm` or specify your own `llm` path in `extra_model_paths.yaml`. Generator | Generates a `string` based on the given input for use with other nodes. Preview | Displays generated outputs in the UI. Replace | Replaces variables enclosed in brackets, such as `[a]`, with their values. @@ -21,4 +21,4 @@ Replace | Replaces variables enclosed in brackets, such as `[a]`, with their val ## Workflow The image below can be opened in ComfyUI. -![workflow](https://github.com/Zuellni/ComfyUI-ExLlama-Nodes/assets/123005779/26acb5fd-f2d9-473a-b0cf-6c92af3bac90) +![workflow](https://github.com/Zuellni/ComfyUI-ExLlama-Nodes/assets/123005779/cb20b040-9856-4dab-aed0-4b318bc2d805)