Commit Graph
83 Commits
Author SHA1 Message Date
Zuellni ebb32253a9 Allow only some tokens in output, add condition node
save prompt without having to preview, auto set seq len and tokens if 0
and some other stuff I already forgot, it should all work, but likely won't
2023-10-10 22:20:39 +02:00
Zuellni f16a2ab515 Update readme link 2023-10-08 20:09:23 +02:00
Zuellni ebf8ccab60 Garbage collect model before reloading, should fix vram issues 2023-10-07 22:59:45 +02:00
Zuellni aa44ddb7b5 Change stop_on_newline to boolean 2023-10-07 22:39:47 +02:00
Zuellni 09bc77ba94 Check if the prompt's not empty before loading anything 2023-10-07 11:02:33 +02:00
Zuellni 6e78068c1a Split nodes into files, allow loading each separately without cloning the repo, some other minor stuff, install exllamav2 pip package by default 2023-10-07 10:56:18 +02:00
Zuellni 796a6b8f25 Bump exllamav2 2023-10-05 18:16:29 +02:00
Zuellni ba03e64315 Update workflow 2023-09-29 18:33:22 +02:00
Zuellni 164b9e95e0 Rename formatter to replacer 2023-09-29 18:17:36 +02:00
Zuellni 8f39f98a7d Update readme 2023-09-29 14:46:45 +02:00
Zuellni d3fc58535d Add a text formatter node and shuffle some others around
Likely breaks the example workflow, will update it later
2023-09-29 14:44:10 +02:00
Zuellni b689267384 Update readme 2023-09-28 13:09:20 +02:00
Zuellni a134682823 Update readme 2023-09-28 13:02:11 +02:00
Zuellni f3b282296e Upgrade to ExLlamaV2 2023-09-28 12:59:36 +02:00
Zuellni a2fa19d5ec Update workflow 2023-09-28 12:57:53 +02:00
Zuellni e7e52f3e7f Update readme 2023-09-28 12:56:44 +02:00
Zuellni 8616948b0f Update readme 2023-09-28 11:26:17 +02:00
Zuellni 91d252cf57 Reorder nodes 2023-09-28 11:20:39 +02:00
Zuellni c5b9d97d52 Max_seq_len should be set after config defaults 2023-09-28 01:42:21 +02:00
Zuellni 30da14ecb2 Update readme 2023-09-27 15:58:38 +02:00
Zuellni 89120f2474 Update to ExLlamaV2, loras currently not supported 2023-09-27 15:55:24 +02:00
Zuellni eaac644f6b Even better version string 2023-09-26 10:41:07 +02:00
Zuellni 8cd538d470 Fix version string with rocm 2023-09-26 10:12:34 +02:00
Zuellni 3e4428d83c Rename the lora loader node 2023-09-24 09:59:08 +02:00
Zuellni f85c061c4d Revert category change on the off-chance some other nodes use it 2023-09-23 12:03:56 +02:00
Zuellni 5398b1a892 Fix output not being saved with metadata 2023-09-23 12:00:30 +02:00
Zuellni ce680213bf Update readme 2023-09-21 11:50:40 +02:00
Zuellni 8a4376b87d Update workflow 2023-09-21 11:47:44 +02:00
Zuellni b15c313aac Separate lora node and some fixes 2023-09-21 11:39:50 +02:00
Zuellni fe9b975866 Update readme 2023-09-21 00:44:28 +02:00
Zuellni ea1a881646 Fix console colors 2023-09-21 00:38:21 +02:00
Zuellni e069a4d10b Fix and simplify requirements 2023-09-21 00:33:40 +02:00
Zuellni c2570715fc Clarify instructions 2023-09-20 20:53:58 +02:00
Zuellni b6f3170fc3 Simplify the installation process a bit (hopefully) 2023-09-20 20:51:30 +02:00
Zuellni 68b6e3518c Update readme 2023-09-20 16:23:22 +02:00
Zuellni 866b4c12d2 Update readme 2023-09-20 10:45:19 +02:00
Zuellni 4407d4a5e9 Update workflow 2023-09-20 10:35:33 +02:00
Zuellni 66eb516c75 Merge remote-tracking branch 'refs/remotes/origin/main' 2023-09-20 10:16:57 +02:00
Zuellni b39275db7b Reorder imports 2023-09-20 10:16:45 +02:00
Zuellni b735335ef1 Update readme 2023-09-20 10:08:00 +02:00
Zuellni fe1608326b Move lora to generator so it can be loaded/unloaded at any point 2023-09-20 10:03:51 +02:00
Zuellni 52866b444f Fix loras not loading 2023-09-20 09:44:45 +02:00
Zuellni fb0c3bc90d Update readme 2023-09-19 22:20:49 +02:00
Zuellni dbc9cd8f04 Update workflow 2023-09-19 22:14:40 +02:00
Zuellni 443070ebc1 Add a lora loader 2023-09-19 22:13:25 +02:00
Zuellni a000b12812 Update readme 2023-09-19 13:29:09 +02:00
Zuellni 8ba5c9df1b Update readme 2023-09-19 13:25:45 +02:00
Zuellni e0201ed007 Add a note on model downloading 2023-09-19 10:05:02 +02:00
Zuellni 863bb143cc Print the outputs in console just in case 2023-09-18 16:39:52 +02:00
Zuellni 52fca04ecf Merge remote-tracking branch 'refs/remotes/origin/main' 2023-09-17 10:11:41 +02:00