Commit Graph
6 Commits
Author SHA1 Message Date
Zuellni baed69aba5 Bump minimum exllamav2 version, add autosplit and q4 cache, some reformatting 2024-04-07 19:35:32 +02:00
Zuellni 7e97b26af9 Fix preview size 2023-11-07 12:55:39 +01:00
Zuellni f48ebd1c68 Some minor changes 2023-11-07 12:46:50 +01:00
Zuellni dcaade09c2 Remove loras for now, there seems to be a memory leak and idk how to fix it
Remove allowed strings, they don't seem very useful
2023-10-27 15:51:15 +02:00
Zuellni ebb32253a9 Allow only some tokens in output, add condition node
save prompt without having to preview, auto set seq len and tokens if 0
and some other stuff I already forgot, it should all work, but likely won't
2023-10-10 22:20:39 +02:00
Zuellni 6e78068c1a Split nodes into files, allow loading each separately without cloning the repo, some other minor stuff, install exllamav2 pip package by default 2023-10-07 10:56:18 +02:00