Commit Graph
6 Commits
Author SHA1 Message Date
Zuellni d2c554b69d Add loras, 8bit cache, fix random seed, unloading 2023-10-25 19:53:44 +02:00
Zuellni ebb32253a9 Allow only some tokens in output, add condition node
save prompt without having to preview, auto set seq len and tokens if 0
and some other stuff I already forgot, it should all work, but likely won't
2023-10-10 22:20:39 +02:00
Zuellni ebf8ccab60 Garbage collect model before reloading, should fix vram issues 2023-10-07 22:59:45 +02:00
Zuellni aa44ddb7b5 Change stop_on_newline to boolean 2023-10-07 22:39:47 +02:00
Zuellni 09bc77ba94 Check if the prompt's not empty before loading anything 2023-10-07 11:02:33 +02:00
Zuellni 6e78068c1a Split nodes into files, allow loading each separately without cloning the repo, some other minor stuff, install exllamav2 pip package by default 2023-10-07 10:56:18 +02:00