nodes/Zuellni-ComfyUI-ExLlama-Nodes
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
109 Commits 1 Branch 0 Tags
8ca924691f7243dae92715bd215c99ce2ad7745a
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Zuellni 8ca924691f Update readme 2023-11-23 22:47:49 +01:00
Zuellni 68f563eb4b Add field descriptions 2023-11-23 22:44:15 +01:00
Zuellni d881503d4e Add some info about model downloading 2023-11-23 22:15:10 +01:00
Zuellni 9cbbcb1e72 Update readme 2023-11-23 20:22:45 +01:00
Zuellni 4d65f3c4db Update readme 2023-11-23 20:12:02 +01:00
Zuellni 2f1affecb4 Simplify model loader 
Load from custom 'llm' dir specified in 'extra_model_paths.yaml' or from 'models/llm'
 2023-11-23 20:04:14 +01:00
Zuellni 8b75af13b3 Update workflow 2023-11-22 16:15:23 +01:00
Zuellni 72a44cbcca Fix preview output 2023-11-22 16:14:28 +01:00
Zuellni 51bb1bcf84 Revert autosplit 2023-11-22 16:04:01 +01:00
Zuellni 996fdd012d Update readme 2023-11-22 14:28:23 +01:00
Zuellni 51ff962f14 Add autosplit, temperature_last 2023-11-22 14:15:00 +01:00
Zuellni 957fe3e6a5 Bump exllamav2 2023-11-22 12:38:08 +01:00
Zuellni 05a30fce3f Remove unnecessary line in preview 2023-11-21 01:56:57 +01:00
Zuellni b6cd5f0de8 Update workflow 2023-11-20 23:37:17 +01:00
Zuellni a33a1ac395 Add gpu split, add 8bit cache toggle, 
add min_p, encode specal tokens,
update requirements versions
 2023-11-20 21:44:52 +01:00
Zuellni 9d20724d02 Update readme 2023-11-07 14:04:16 +01:00
Zuellni 47e38dabbc Update workflow 2023-11-07 13:04:37 +01:00
Zuellni cb7f195068 Merge pull request #9 from Zuellni/0.0.7 
0.0.7
 2023-11-07 13:03:56 +01:00
Zuellni 7e97b26af9 Fix preview size 2023-11-07 12:55:39 +01:00
Zuellni f48ebd1c68 Some minor changes 2023-11-07 12:46:50 +01:00
Zuellni 55871388b6 Move for clarity 2023-10-27 15:54:24 +02:00
Zuellni dcaade09c2 Remove loras for now, there seems to be a memory leak and idk how to fix it 
Remove allowed strings, they don't seem very useful
 2023-10-27 15:51:15 +02:00
Zuellni 2b3ddde76b Update README.md 2023-10-25 19:59:58 +02:00
Zuellni 0b94a076ab Update README.md 2023-10-25 19:57:16 +02:00
Zuellni d2c554b69d Add loras, 8bit cache, fix random seed, unloading 2023-10-25 19:53:44 +02:00
Zuellni 420b1fbd2d Update workflow 2023-10-10 22:21:58 +02:00
Zuellni ebb32253a9 Allow only some tokens in output, add condition node 
save prompt without having to preview, auto set seq len and tokens if 0
and some other stuff I already forgot, it should all work, but likely won't
 2023-10-10 22:20:39 +02:00
Zuellni f16a2ab515 Update readme link 2023-10-08 20:09:23 +02:00
Zuellni ebf8ccab60 Garbage collect model before reloading, should fix vram issues 2023-10-07 22:59:45 +02:00
Zuellni aa44ddb7b5 Change stop_on_newline to boolean 2023-10-07 22:39:47 +02:00
Zuellni 09bc77ba94 Check if the prompt's not empty before loading anything 2023-10-07 11:02:33 +02:00
Zuellni 6e78068c1a Split nodes into files, allow loading each separately without cloning the repo, some other minor stuff, install exllamav2 pip package by default 2023-10-07 10:56:18 +02:00
Zuellni 796a6b8f25 Bump exllamav2 2023-10-05 18:16:29 +02:00
Zuellni ba03e64315 Update workflow 2023-09-29 18:33:22 +02:00
Zuellni 164b9e95e0 Rename formatter to replacer 2023-09-29 18:17:36 +02:00
Zuellni 8f39f98a7d Update readme 2023-09-29 14:46:45 +02:00
Zuellni d3fc58535d Add a text formatter node and shuffle some others around 
Likely breaks the example workflow, will update it later
 2023-09-29 14:44:10 +02:00
Zuellni b689267384 Update readme 2023-09-28 13:09:20 +02:00
Zuellni a134682823 Update readme 2023-09-28 13:02:11 +02:00
Zuellni f3b282296e Upgrade to ExLlamaV2 2023-09-28 12:59:36 +02:00
Zuellni a2fa19d5ec Update workflow 2023-09-28 12:57:53 +02:00
Zuellni e7e52f3e7f Update readme 2023-09-28 12:56:44 +02:00
Zuellni 8616948b0f Update readme 2023-09-28 11:26:17 +02:00
Zuellni 91d252cf57 Reorder nodes 2023-09-28 11:20:39 +02:00
Zuellni c5b9d97d52 Max_seq_len should be set after config defaults 2023-09-28 01:42:21 +02:00
Zuellni 30da14ecb2 Update readme 2023-09-27 15:58:38 +02:00
Zuellni 89120f2474 Update to ExLlamaV2, loras currently not supported 2023-09-27 15:55:24 +02:00
Zuellni eaac644f6b Even better version string 2023-09-26 10:41:07 +02:00
Zuellni 8cd538d470 Fix version string with rocm 2023-09-26 10:12:34 +02:00
Zuellni 3e4428d83c Rename the lora loader node 2023-09-24 09:59:08 +02:00
Zuellni f85c061c4d Revert category change on the off-chance some other nodes use it 2023-09-23 12:03:56 +02:00
Zuellni 5398b1a892 Fix output not being saved with metadata 2023-09-23 12:00:30 +02:00
Zuellni ce680213bf Update readme 2023-09-21 11:50:40 +02:00
Zuellni 8a4376b87d Update workflow 2023-09-21 11:47:44 +02:00
Zuellni b15c313aac Separate lora node and some fixes 2023-09-21 11:39:50 +02:00
Zuellni fe9b975866 Update readme 2023-09-21 00:44:28 +02:00
Zuellni ea1a881646 Fix console colors 2023-09-21 00:38:21 +02:00
Zuellni e069a4d10b Fix and simplify requirements 2023-09-21 00:33:40 +02:00
Zuellni c2570715fc Clarify instructions 2023-09-20 20:53:58 +02:00
Zuellni b6f3170fc3 Simplify the installation process a bit (hopefully) 2023-09-20 20:51:30 +02:00
Zuellni 68b6e3518c Update readme 2023-09-20 16:23:22 +02:00
Zuellni 866b4c12d2 Update readme 2023-09-20 10:45:19 +02:00
Zuellni 4407d4a5e9 Update workflow 2023-09-20 10:35:33 +02:00
Zuellni 66eb516c75 Merge remote-tracking branch 'refs/remotes/origin/main' 2023-09-20 10:16:57 +02:00
Zuellni b39275db7b Reorder imports 2023-09-20 10:16:45 +02:00
Zuellni b735335ef1 Update readme 2023-09-20 10:08:00 +02:00
Zuellni fe1608326b Move lora to generator so it can be loaded/unloaded at any point 2023-09-20 10:03:51 +02:00
Zuellni 52866b444f Fix loras not loading 2023-09-20 09:44:45 +02:00
Zuellni fb0c3bc90d Update readme 2023-09-19 22:20:49 +02:00
Zuellni dbc9cd8f04 Update workflow 2023-09-19 22:14:40 +02:00
Zuellni 443070ebc1 Add a lora loader 2023-09-19 22:13:25 +02:00
Zuellni a000b12812 Update readme 2023-09-19 13:29:09 +02:00
Zuellni 8ba5c9df1b Update readme 2023-09-19 13:25:45 +02:00
Zuellni e0201ed007 Add a note on model downloading 2023-09-19 10:05:02 +02:00
Zuellni 863bb143cc Print the outputs in console just in case 2023-09-18 16:39:52 +02:00
Zuellni 52fca04ecf Merge remote-tracking branch 'refs/remotes/origin/main' 2023-09-17 10:11:41 +02:00
Zuellni 1de6916e0f Remove the resize code, shouldn't be needed with a separate node 2023-09-17 10:11:21 +02:00
Zuellni 6a5314c0cd Update workflow 2023-09-16 22:32:45 +02:00
Zuellni 0ec46fb285 Add a separate preview node to prevent generator from running twice, unique_id is buggy 2023-09-16 22:30:29 +02:00
Zuellni 57bfd8cb13 Add credit to script 2023-09-16 15:31:38 +02:00
Zuellni 3a28731030 Update LICENSE 2023-09-16 15:27:33 +02:00
Zuellni 1266401315 Update workflow 2023-09-16 15:12:44 +02:00
Zuellni 7e41dc9989 Show prompts in UI 2023-09-16 15:01:10 +02:00
Zuellni 9c0c07b092 Update exllama link to point to latest release 2023-09-16 10:11:54 +02:00
Zuellni 51796c0989 Update readme 2023-09-16 09:48:23 +02:00
Zuellni c4de1bd3b3 Fix typo 2023-09-16 09:02:53 +02:00
Zuellni 1528cecb5f Update readme 2023-09-16 09:01:07 +02:00
Zuellni 46a5e31380 Update workflow 2023-09-16 08:58:21 +02:00
Zuellni bd653a7245 Empty cache on model reload 2023-09-15 22:03:31 +02:00
Zuellni 251bff4510 Add sentencepiece to requirements since it's not installed automatically with exllama 2023-09-15 21:41:21 +02:00
Zuellni baa9a01cf7 Update readme 2023-09-15 10:31:49 +02:00
Zuellni 99f98f748f Update readme 2023-09-15 10:27:52 +02:00
Zuellni 41c4dfb268 Remove redundant import 2023-09-14 21:01:26 +02:00
Zuellni f749ba0af2 Merge remote-tracking branch 'refs/remotes/origin/main' 2023-09-14 11:16:33 +02:00
Zuellni 523a881343 Remove redundant callback, improve prompt visibility 2023-09-14 11:15:46 +02:00
Zuellni 9e7a702f8d Update readme 2023-09-13 16:32:02 +02:00
Zuellni 6265771485 Update readme 2023-09-13 16:29:46 +02:00
Zuellni 928d7e15c4 Update readme 2023-09-13 16:24:27 +02:00
Zuellni 5e1fc0de87 Update progress after gen is finished 2023-09-13 16:23:00 +02:00
Zuellni 55bbfd4606 Fix formatting 2023-09-13 10:26:34 +02:00