nodes/Zuellni-ComfyUI-ExLlama-Nodes
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update readme

Browse Source
This commit is contained in:
Zuellni
2023-09-13 16:29:46 +02:00
committed by GitHub
parent 928d7e15c4
commit 6265771485
1 changed files with 6 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+6 -4
View File
@@ -9,7 +9,8 @@ Clone the repository to `custom_nodes` in your ComfyUI directory:
git clone https://github.com/Zuellni/ComfyUI-ExLlama-Nodes
```
Install the latest ExLlama package from https://github.com/jllllll/exllama/releases. Choose the version matching your platform, Python, and PyTorch CUDA/ROCm.
Install the latest ExLlama package from https://github.com/jllllll/exllama/releases.
Choose the version matching your platform, Python, and PyTorch CUDA/ROCm.
Example for Windows with Python 3.10 and CUDA 11.7:
```
pip install https://github.com/jllllll/exllama/releases/download/0.0.17/exllama-0.0.17+cu117-cp310-cp310-win_amd64.whl
@@ -28,6 +29,7 @@ Generates a `string` based on the given `prompt` for use with other nodes.
Default parameter values correspond to the `simple-1` preset from https://github.com/oobabooga/text-generation-webui.
ExLlama isn't deterministic, so the outputs may differ even with the same seed.
## Workflow
![workflow](https://github.com/Zuellni/ComfyUI-ExLlama/assets/123005779/005df502-9986-444c-b736-448b305e329c)
Can be loaded directly in ComfyUI.
## Example
The workflow Can be loaded directly in ComfyUI.
![workflow](https://github.com/Zuellni/ComfyUI-ExLlama/assets/123005779/005df502-9986-444c-b736-448b305e329c)