 Zuellni
|
51728c0102
|
Update requirements.txt
|
2024-06-14 13:28:48 +02:00 |
|
|
Zuellni
|
e91a1ce2c6
|
Switch to dynamic generator
|
2024-06-14 10:57:28 +02:00 |
|
|
Zuellni
|
d7413b2ebc
|
Fix vram usage with higher context
|
2024-05-17 22:55:50 +02:00 |
|
|
Zuellni
|
8c2f17829a
|
Clarify instructions
|
2024-04-08 03:03:53 +02:00 |
|
|
Zuellni
|
baed69aba5
|
Bump minimum exllamav2 version, add autosplit and q4 cache, some reformatting
|
2024-04-07 19:35:32 +02:00 |
|
|
Zuellni
|
bf64bcc0e4
|
Split requirements to file, neutralize samplers by default
|
2024-02-14 20:23:27 +01:00 |
|
|
Zuellni
|
9ffbacf080
|
Update requirements
|
2024-02-12 16:38:52 +01:00 |
|
|
Zuellni
|
73e6a0b0e4
|
Bump exllama
|
2024-01-26 15:39:58 +01:00 |
|
|
Zuellni
|
331b594f00
|
Bump flash-attn
|
2023-12-27 13:13:16 +01:00 |
|
|
Zuellni
|
de401d308d
|
Bump exllama
|
2023-12-21 19:51:05 +01:00 |
|
|
Zuellni
|
04f0c87e31
|
Fix error when model isn't fully unloaded and bump requirements
|
2023-12-02 23:27:41 +01:00 |
|
|
Zuellni
|
eca815e45a
|
Fix linux requirements
|
2023-11-25 20:16:56 +01:00 |
|
|
Zuellni
|
1b9803ae34
|
Update wheels
|
2023-11-25 12:15:44 +01:00 |
|
|
Zuellni
|
09de8351b9
|
Update flash attention wheel
|
2023-11-24 18:09:04 +01:00 |
|
|
Zuellni
|
957fe3e6a5
|
Bump exllamav2
|
2023-11-22 12:38:08 +01:00 |
|
|
Zuellni
|
a33a1ac395
|
Add gpu split, add 8bit cache toggle,
add min_p, encode specal tokens,
update requirements versions
|
2023-11-20 21:44:52 +01:00 |
|
|
Zuellni
|
d2c554b69d
|
Add loras, 8bit cache, fix random seed, unloading
|
2023-10-25 19:53:44 +02:00 |
|
|
Zuellni
|
6e78068c1a
|
Split nodes into files, allow loading each separately without cloning the repo, some other minor stuff, install exllamav2 pip package by default
|
2023-10-07 10:56:18 +02:00 |
|
|
Zuellni
|
796a6b8f25
|
Bump exllamav2
|
2023-10-05 18:16:29 +02:00 |
|
|
Zuellni
|
89120f2474
|
Update to ExLlamaV2, loras currently not supported
|
2023-09-27 15:55:24 +02:00 |
|
|
Zuellni
|
3e4428d83c
|
Rename the lora loader node
|
2023-09-24 09:59:08 +02:00 |
|
|
Zuellni
|
5398b1a892
|
Fix output not being saved with metadata
|
2023-09-23 12:00:30 +02:00 |
|
|
Zuellni
|
e069a4d10b
|
Fix and simplify requirements
|
2023-09-21 00:33:40 +02:00 |
|
|
Zuellni
|
b6f3170fc3
|
Simplify the installation process a bit (hopefully)
|
2023-09-20 20:51:30 +02:00 |
|
|
Zuellni
|
251bff4510
|
Add sentencepiece to requirements since it's not installed automatically with exllama
|
2023-09-15 21:41:21 +02:00 |
|