nodes/Zuellni-ComfyUI-ExLlama-Nodes
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
142 Commits 1 Branch 0 Tags
d2b4d7a796be2c1d80da0385ac2883328f837cba
Commit Graph
142 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Zuellni d2b4d7a796 More sanity checks for model unloading, bump exllama 2024-02-26 13:24:03 +01:00
Zuellni f7a108315e Update readme 2024-02-21 23:06:35 +01:00
Zuellni 217304e0ef Only unload other models if unload is checked 2024-02-17 16:53:00 +01:00
Zuellni 8c4b9d058f Update workflow 2024-02-17 15:14:46 +01:00
Zuellni 861aa6fc51 Update readme 2024-02-17 15:13:53 +01:00
Zuellni 8b7b957b3e Add gc again 2024-02-17 14:53:54 +01:00
Zuellni e1c8e61291 Unload other models first before loading llms, rename some params, update requirements 2024-02-17 14:40:46 +01:00
Zuellni ca41704f38 Update readme 2024-02-14 20:26:46 +01:00
Zuellni bf64bcc0e4 Split requirements to file, neutralize samplers by default 2024-02-14 20:23:27 +01:00
Zuellni 9ffbacf080 Update requirements 2024-02-12 16:38:52 +01:00
Zuellni 6cc728d7cb Update readme 2024-02-09 16:13:30 +01:00
Zuellni ec6443816e Update readme 2024-02-06 14:51:02 +01:00
Zuellni 6831b951c5 Update readme 2024-02-03 15:53:52 +01:00
Zuellni 54bedbed53 Update workflow 2024-02-03 15:52:58 +01:00
Zuellni 88a826fa30 Add top_a sampling 2024-02-03 15:14:38 +01:00
Zuellni 18c7854d76 Add missing import, look for paths recursively 2024-02-03 15:13:30 +01:00
Zuellni 261a73a119 Merge pull request #14 from ScottNealon/patch-1 
Parse all possible folders mapped to "llm"
 2024-02-03 15:11:39 +01:00
Scott Nealon 348aeea258 Parse all possible folders mapped to "llm" 2024-02-02 22:12:50 -05:00
Zuellni 73e6a0b0e4 Bump exllama 2024-01-26 15:39:58 +01:00
Zuellni 331b594f00 Bump flash-attn 2023-12-27 13:13:16 +01:00
Zuellni de401d308d Bump exllama 2023-12-21 19:51:05 +01:00
Zuellni 04f0c87e31 Fix error when model isn't fully unloaded and bump requirements 2023-12-02 23:27:41 +01:00
Zuellni eca815e45a Fix linux requirements 2023-11-25 20:16:56 +01:00
Zuellni 15a224ccbb Even better table 2023-11-25 14:55:51 +01:00
Zuellni 485e2c4c51 Prettify table 2023-11-25 13:48:56 +01:00
Zuellni 98ec700a5c Remove the tensor numel check, should be redundant 2023-11-25 13:21:19 +01:00
Zuellni 69b70b1b41 Clarify gpu split should be in GB, not MB 2023-11-25 13:09:40 +01:00
Zuellni 1b9803ae34 Update wheels 2023-11-25 12:15:44 +01:00
Zuellni 677bc6c388 Update readme 2023-11-25 12:10:53 +01:00
Zuellni 1bfa440ef1 Add progress bar to model loader 2023-11-24 18:49:50 +01:00
Zuellni 09de8351b9 Update flash attention wheel 2023-11-24 18:09:04 +01:00
Zuellni 3e2c6d6759 Update link 2023-11-24 17:42:03 +01:00
Zuellni 125cdf51cb Prettify readme 2023-11-24 14:58:06 +01:00
Zuellni 8ca924691f Update readme 2023-11-23 22:47:49 +01:00
Zuellni 68f563eb4b Add field descriptions 2023-11-23 22:44:15 +01:00
Zuellni d881503d4e Add some info about model downloading 2023-11-23 22:15:10 +01:00
Zuellni 9cbbcb1e72 Update readme 2023-11-23 20:22:45 +01:00
Zuellni 4d65f3c4db Update readme 2023-11-23 20:12:02 +01:00
Zuellni 2f1affecb4 Simplify model loader 
Load from custom 'llm' dir specified in 'extra_model_paths.yaml' or from 'models/llm'
 2023-11-23 20:04:14 +01:00
Zuellni 8b75af13b3 Update workflow 2023-11-22 16:15:23 +01:00
Zuellni 72a44cbcca Fix preview output 2023-11-22 16:14:28 +01:00
Zuellni 51bb1bcf84 Revert autosplit 2023-11-22 16:04:01 +01:00
Zuellni 996fdd012d Update readme 2023-11-22 14:28:23 +01:00
Zuellni 51ff962f14 Add autosplit, temperature_last 2023-11-22 14:15:00 +01:00
Zuellni 957fe3e6a5 Bump exllamav2 2023-11-22 12:38:08 +01:00
Zuellni 05a30fce3f Remove unnecessary line in preview 2023-11-21 01:56:57 +01:00
Zuellni b6cd5f0de8 Update workflow 2023-11-20 23:37:17 +01:00
Zuellni a33a1ac395 Add gpu split, add 8bit cache toggle, 
add min_p, encode specal tokens,
update requirements versions
 2023-11-20 21:44:52 +01:00
Zuellni 9d20724d02 Update readme 2023-11-07 14:04:16 +01:00
Zuellni 47e38dabbc Update workflow 2023-11-07 13:04:37 +01:00