nodes/Zuellni-ComfyUI-ExLlama-Nodes
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
83 Commits 1 Branch 0 Tags
ebb32253a9c28a50210cde5cb8366d704744b5e3
Commit Graph
83 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Zuellni ebb32253a9 Allow only some tokens in output, add condition node 
save prompt without having to preview, auto set seq len and tokens if 0
and some other stuff I already forgot, it should all work, but likely won't
 2023-10-10 22:20:39 +02:00
Zuellni f16a2ab515 Update readme link 2023-10-08 20:09:23 +02:00
Zuellni ebf8ccab60 Garbage collect model before reloading, should fix vram issues 2023-10-07 22:59:45 +02:00
Zuellni aa44ddb7b5 Change stop_on_newline to boolean 2023-10-07 22:39:47 +02:00
Zuellni 09bc77ba94 Check if the prompt's not empty before loading anything 2023-10-07 11:02:33 +02:00
Zuellni 6e78068c1a Split nodes into files, allow loading each separately without cloning the repo, some other minor stuff, install exllamav2 pip package by default 2023-10-07 10:56:18 +02:00
Zuellni 796a6b8f25 Bump exllamav2 2023-10-05 18:16:29 +02:00
Zuellni ba03e64315 Update workflow 2023-09-29 18:33:22 +02:00
Zuellni 164b9e95e0 Rename formatter to replacer 2023-09-29 18:17:36 +02:00
Zuellni 8f39f98a7d Update readme 2023-09-29 14:46:45 +02:00
Zuellni d3fc58535d Add a text formatter node and shuffle some others around 
Likely breaks the example workflow, will update it later
 2023-09-29 14:44:10 +02:00
Zuellni b689267384 Update readme 2023-09-28 13:09:20 +02:00
Zuellni a134682823 Update readme 2023-09-28 13:02:11 +02:00
Zuellni f3b282296e Upgrade to ExLlamaV2 2023-09-28 12:59:36 +02:00
Zuellni a2fa19d5ec Update workflow 2023-09-28 12:57:53 +02:00
Zuellni e7e52f3e7f Update readme 2023-09-28 12:56:44 +02:00
Zuellni 8616948b0f Update readme 2023-09-28 11:26:17 +02:00
Zuellni 91d252cf57 Reorder nodes 2023-09-28 11:20:39 +02:00
Zuellni c5b9d97d52 Max_seq_len should be set after config defaults 2023-09-28 01:42:21 +02:00
Zuellni 30da14ecb2 Update readme 2023-09-27 15:58:38 +02:00
Zuellni 89120f2474 Update to ExLlamaV2, loras currently not supported 2023-09-27 15:55:24 +02:00
Zuellni eaac644f6b Even better version string 2023-09-26 10:41:07 +02:00
Zuellni 8cd538d470 Fix version string with rocm 2023-09-26 10:12:34 +02:00
Zuellni 3e4428d83c Rename the lora loader node 2023-09-24 09:59:08 +02:00
Zuellni f85c061c4d Revert category change on the off-chance some other nodes use it 2023-09-23 12:03:56 +02:00
Zuellni 5398b1a892 Fix output not being saved with metadata 2023-09-23 12:00:30 +02:00
Zuellni ce680213bf Update readme 2023-09-21 11:50:40 +02:00
Zuellni 8a4376b87d Update workflow 2023-09-21 11:47:44 +02:00
Zuellni b15c313aac Separate lora node and some fixes 2023-09-21 11:39:50 +02:00
Zuellni fe9b975866 Update readme 2023-09-21 00:44:28 +02:00
Zuellni ea1a881646 Fix console colors 2023-09-21 00:38:21 +02:00
Zuellni e069a4d10b Fix and simplify requirements 2023-09-21 00:33:40 +02:00
Zuellni c2570715fc Clarify instructions 2023-09-20 20:53:58 +02:00
Zuellni b6f3170fc3 Simplify the installation process a bit (hopefully) 2023-09-20 20:51:30 +02:00
Zuellni 68b6e3518c Update readme 2023-09-20 16:23:22 +02:00
Zuellni 866b4c12d2 Update readme 2023-09-20 10:45:19 +02:00
Zuellni 4407d4a5e9 Update workflow 2023-09-20 10:35:33 +02:00
Zuellni 66eb516c75 Merge remote-tracking branch 'refs/remotes/origin/main' 2023-09-20 10:16:57 +02:00
Zuellni b39275db7b Reorder imports 2023-09-20 10:16:45 +02:00
Zuellni b735335ef1 Update readme 2023-09-20 10:08:00 +02:00
Zuellni fe1608326b Move lora to generator so it can be loaded/unloaded at any point 2023-09-20 10:03:51 +02:00
Zuellni 52866b444f Fix loras not loading 2023-09-20 09:44:45 +02:00
Zuellni fb0c3bc90d Update readme 2023-09-19 22:20:49 +02:00
Zuellni dbc9cd8f04 Update workflow 2023-09-19 22:14:40 +02:00
Zuellni 443070ebc1 Add a lora loader 2023-09-19 22:13:25 +02:00
Zuellni a000b12812 Update readme 2023-09-19 13:29:09 +02:00
Zuellni 8ba5c9df1b Update readme 2023-09-19 13:25:45 +02:00
Zuellni e0201ed007 Add a note on model downloading 2023-09-19 10:05:02 +02:00
Zuellni 863bb143cc Print the outputs in console just in case 2023-09-18 16:39:52 +02:00
Zuellni 52fca04ecf Merge remote-tracking branch 'refs/remotes/origin/main' 2023-09-17 10:11:41 +02:00
Zuellni 1de6916e0f Remove the resize code, shouldn't be needed with a separate node 2023-09-17 10:11:21 +02:00
Zuellni 6a5314c0cd Update workflow 2023-09-16 22:32:45 +02:00
Zuellni 0ec46fb285 Add a separate preview node to prevent generator from running twice, unique_id is buggy 2023-09-16 22:30:29 +02:00
Zuellni 57bfd8cb13 Add credit to script 2023-09-16 15:31:38 +02:00
Zuellni 3a28731030 Update LICENSE 2023-09-16 15:27:33 +02:00
Zuellni 1266401315 Update workflow 2023-09-16 15:12:44 +02:00
Zuellni 7e41dc9989 Show prompts in UI 2023-09-16 15:01:10 +02:00
Zuellni 9c0c07b092 Update exllama link to point to latest release 2023-09-16 10:11:54 +02:00
Zuellni 51796c0989 Update readme 2023-09-16 09:48:23 +02:00
Zuellni c4de1bd3b3 Fix typo 2023-09-16 09:02:53 +02:00
Zuellni 1528cecb5f Update readme 2023-09-16 09:01:07 +02:00
Zuellni 46a5e31380 Update workflow 2023-09-16 08:58:21 +02:00
Zuellni bd653a7245 Empty cache on model reload 2023-09-15 22:03:31 +02:00
Zuellni 251bff4510 Add sentencepiece to requirements since it's not installed automatically with exllama 2023-09-15 21:41:21 +02:00
Zuellni baa9a01cf7 Update readme 2023-09-15 10:31:49 +02:00
Zuellni 99f98f748f Update readme 2023-09-15 10:27:52 +02:00
Zuellni 41c4dfb268 Remove redundant import 2023-09-14 21:01:26 +02:00
Zuellni f749ba0af2 Merge remote-tracking branch 'refs/remotes/origin/main' 2023-09-14 11:16:33 +02:00
Zuellni 523a881343 Remove redundant callback, improve prompt visibility 2023-09-14 11:15:46 +02:00
Zuellni 9e7a702f8d Update readme 2023-09-13 16:32:02 +02:00
Zuellni 6265771485 Update readme 2023-09-13 16:29:46 +02:00
Zuellni 928d7e15c4 Update readme 2023-09-13 16:24:27 +02:00
Zuellni 5e1fc0de87 Update progress after gen is finished 2023-09-13 16:23:00 +02:00
Zuellni 55bbfd4606 Fix formatting 2023-09-13 10:26:34 +02:00
Zuellni 91f5eb672c Add progress bar and allow interrupting 2023-09-13 10:25:19 +02:00
Zuellni 68a24beac2 Update workflow 2023-09-11 15:42:09 +02:00
Zuellni caf9d68bde Resize workflow 2023-09-11 14:27:31 +02:00
Zuellni 8aff09ddf8 Update readme 2023-09-11 14:22:13 +02:00
Zuellni 217065e7d9 Update readme 2023-09-11 14:17:33 +02:00
Zuellni 0a7bcdd5e3 Update readme 2023-09-11 14:14:25 +02:00
Zuellni 83db844eb8 Add example workflow 2023-09-11 14:12:27 +02:00
Zuellni 676e565ced Swap to alt generator for stopping strings 2023-09-11 13:50:12 +02:00
Zuellni d5e859bea3 Initial commit 2023-09-11 13:18:47 +02:00