nodes/Zuellni-ComfyUI-ExLlama-Nodes
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
168 Commits 1 Branch 0 Tags
7ae7ef9a246c87060e4395c4e94a5f18903a91e1
Commit Graph
168 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Zuellni 7ae7ef9a24 Split some nodes, added a format node that uses tokenizer config template 2024-07-28 17:33:07 +02:00
Zuellni 8311351697 Cache should be a multiple of 256 for paged attention 2024-06-26 16:01:08 +02:00
Zuellni d5feb5a293 Clean up cache 2024-06-26 13:07:37 +02:00
Zuellni 0bd03f4dae Clean up imports 2024-06-24 12:33:30 +02:00
Zuellni cc6c50e2ff Merge pull request #23 from Zuellni/dev 
Switch to dynamic generator, bump minimum exllamav2 version
 2024-06-14 18:52:24 +02:00
Zuellni 5a90464b6c Update README.md 2024-06-14 18:48:05 +02:00
Zuellni 51728c0102 Update requirements.txt 2024-06-14 13:28:48 +02:00
Zuellni cac9d1fdf4 Update README.md 2024-06-14 13:24:38 +02:00
Zuellni f54093078e Clean up README 2024-06-14 13:21:42 +02:00
Zuellni add411a7c3 Merge remote-tracking branch 'origin/main' into dev 2024-06-14 13:15:47 +02:00
Zuellni 49ace07a0e Update README.md 2024-06-14 12:51:36 +02:00
Zuellni 4754f78c70 Add option to enable/disable flash attention and fast tensors 2024-06-14 11:50:22 +02:00
Zuellni f988703614 Add custom stop conditions 2024-06-14 11:33:10 +02:00
Zuellni e91a1ce2c6 Switch to dynamic generator 2024-06-14 10:57:28 +02:00
Zuellni e5e13c40ed Update README.md 2024-06-05 09:53:12 +02:00
Zuellni d7413b2ebc Fix vram usage with higher context 2024-05-17 22:55:50 +02:00
Zuellni c005e3c637 Update config init 2024-05-04 09:13:01 +02:00
Zuellni 4422f0b0d0 Update readme 2024-04-22 18:30:33 +02:00
Zuellni 4633de563a Update workflow with llama-3 format 2024-04-22 16:18:18 +02:00
Zuellni 87810044ea Change default cache bits to 16, reorganize imports, update readme 2024-04-22 15:50:50 +02:00
Zuellni 8c2f17829a Clarify instructions 2024-04-08 03:03:53 +02:00
Zuellni c5765ffb8c Update with a cascade workflow 2024-04-07 20:19:55 +02:00
Zuellni fb7b7ff683 Update readme 2024-04-07 20:00:44 +02:00
Zuellni fb5b6d95ef Update link 2024-04-07 19:55:34 +02:00
Zuellni d2543cbd59 Simplify instructions 2024-04-07 19:52:53 +02:00
Zuellni baed69aba5 Bump minimum exllamav2 version, add autosplit and q4 cache, some reformatting 2024-04-07 19:35:32 +02:00
Zuellni d2b4d7a796 More sanity checks for model unloading, bump exllama 2024-02-26 13:24:03 +01:00
Zuellni f7a108315e Update readme 2024-02-21 23:06:35 +01:00
Zuellni 217304e0ef Only unload other models if unload is checked 2024-02-17 16:53:00 +01:00
Zuellni 8c4b9d058f Update workflow 2024-02-17 15:14:46 +01:00
Zuellni 861aa6fc51 Update readme 2024-02-17 15:13:53 +01:00
Zuellni 8b7b957b3e Add gc again 2024-02-17 14:53:54 +01:00
Zuellni e1c8e61291 Unload other models first before loading llms, rename some params, update requirements 2024-02-17 14:40:46 +01:00
Zuellni ca41704f38 Update readme 2024-02-14 20:26:46 +01:00
Zuellni bf64bcc0e4 Split requirements to file, neutralize samplers by default 2024-02-14 20:23:27 +01:00
Zuellni 9ffbacf080 Update requirements 2024-02-12 16:38:52 +01:00
Zuellni 6cc728d7cb Update readme 2024-02-09 16:13:30 +01:00
Zuellni ec6443816e Update readme 2024-02-06 14:51:02 +01:00
Zuellni 6831b951c5 Update readme 2024-02-03 15:53:52 +01:00
Zuellni 54bedbed53 Update workflow 2024-02-03 15:52:58 +01:00
Zuellni 88a826fa30 Add top_a sampling 2024-02-03 15:14:38 +01:00
Zuellni 18c7854d76 Add missing import, look for paths recursively 2024-02-03 15:13:30 +01:00
Zuellni 261a73a119 Merge pull request #14 from ScottNealon/patch-1 
Parse all possible folders mapped to "llm"
 2024-02-03 15:11:39 +01:00
Scott Nealon 348aeea258 Parse all possible folders mapped to "llm" 2024-02-02 22:12:50 -05:00
Zuellni 73e6a0b0e4 Bump exllama 2024-01-26 15:39:58 +01:00
Zuellni 331b594f00 Bump flash-attn 2023-12-27 13:13:16 +01:00
Zuellni de401d308d Bump exllama 2023-12-21 19:51:05 +01:00
Zuellni 04f0c87e31 Fix error when model isn't fully unloaded and bump requirements 2023-12-02 23:27:41 +01:00
Zuellni eca815e45a Fix linux requirements 2023-11-25 20:16:56 +01:00
Zuellni 15a224ccbb Even better table 2023-11-25 14:55:51 +01:00