nodes/Zuellni-ComfyUI-ExLlama-Nodes
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update readme

Browse Source
This commit is contained in:
Zuellni
2024-04-07 20:00:44 +02:00
committed by GitHub
parent fb5b6d95ef
commit fb7b7ff683
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+2 -2
View File
@@ -40,12 +40,12 @@ git clone https://huggingface.co/LoneStriker/Mistral-7B-Instruct-v0.2-5.0bpw-h6-
<tr> <tr>
<td></td> <td></td>
<td><i>cache_bits</i></td> <td><i>cache_bits</i></td>
<td>Lowers VRAM usage as well as generation speed.</td> <td>Lower value equals lower VRAM usage but also impacts generation speed.</td>
</tr> </tr>
<tr> <tr>
<td></td> <td></td>
<td><i>max_seq_len</i></td> <td><i>max_seq_len</i></td>
<td>Max context, higher number equals higher VRAM usage. <code>0</code> will default to config.</td> <td>Max context, higher value equals higher VRAM usage. <code>0</code> will default to config.</td>
</tr> </tr>
<tr> <tr>
<td><b>Generator</b></td> <td><b>Generator</b></td>