 Zuellni
|
baed69aba5
|
Bump minimum exllamav2 version, add autosplit and q4 cache, some reformatting
|
2024-04-07 19:35:32 +02:00 |
|
|
Zuellni
|
72a44cbcca
|
Fix preview output
|
2023-11-22 16:14:28 +01:00 |
|
|
Zuellni
|
05a30fce3f
|
Remove unnecessary line in preview
|
2023-11-21 01:56:57 +01:00 |
|
|
Zuellni
|
a33a1ac395
|
Add gpu split, add 8bit cache toggle,
add min_p, encode specal tokens,
update requirements versions
|
2023-11-20 21:44:52 +01:00 |
|
|
Zuellni
|
f48ebd1c68
|
Some minor changes
|
2023-11-07 12:46:50 +01:00 |
|
|
Zuellni
|
ebb32253a9
|
Allow only some tokens in output, add condition node
save prompt without having to preview, auto set seq len and tokens if 0
and some other stuff I already forgot, it should all work, but likely won't
|
2023-10-10 22:20:39 +02:00 |
|
|
Zuellni
|
6e78068c1a
|
Split nodes into files, allow loading each separately without cloning the repo, some other minor stuff, install exllamav2 pip package by default
|
2023-10-07 10:56:18 +02:00 |
|