 Zuellni
|
e1c8e61291
|
Unload other models first before loading llms, rename some params, update requirements
|
2024-02-17 14:40:46 +01:00 |
|
|
Zuellni
|
bf64bcc0e4
|
Split requirements to file, neutralize samplers by default
|
2024-02-14 20:23:27 +01:00 |
|
|
Zuellni
|
88a826fa30
|
Add top_a sampling
|
2024-02-03 15:14:38 +01:00 |
|
|
Zuellni
|
18c7854d76
|
Add missing import, look for paths recursively
|
2024-02-03 15:13:30 +01:00 |
|
|
Scott Nealon
|
348aeea258
|
Parse all possible folders mapped to "llm"
|
2024-02-02 22:12:50 -05:00 |
|
|
Zuellni
|
04f0c87e31
|
Fix error when model isn't fully unloaded and bump requirements
|
2023-12-02 23:27:41 +01:00 |
|
|
Zuellni
|
98ec700a5c
|
Remove the tensor numel check, should be redundant
|
2023-11-25 13:21:19 +01:00 |
|
|
Zuellni
|
1bfa440ef1
|
Add progress bar to model loader
|
2023-11-24 18:49:50 +01:00 |
|
|
Zuellni
|
2f1affecb4
|
Simplify model loader
Load from custom 'llm' dir specified in 'extra_model_paths.yaml' or from 'models/llm'
|
2023-11-23 20:04:14 +01:00 |
|
|
Zuellni
|
51bb1bcf84
|
Revert autosplit
|
2023-11-22 16:04:01 +01:00 |
|
|
Zuellni
|
51ff962f14
|
Add autosplit, temperature_last
|
2023-11-22 14:15:00 +01:00 |
|
|
Zuellni
|
a33a1ac395
|
Add gpu split, add 8bit cache toggle,
add min_p, encode specal tokens,
update requirements versions
|
2023-11-20 21:44:52 +01:00 |
|
|
Zuellni
|
f48ebd1c68
|
Some minor changes
|
2023-11-07 12:46:50 +01:00 |
|
|
Zuellni
|
55871388b6
|
Move for clarity
|
2023-10-27 15:54:24 +02:00 |
|
|
Zuellni
|
dcaade09c2
|
Remove loras for now, there seems to be a memory leak and idk how to fix it
Remove allowed strings, they don't seem very useful
|
2023-10-27 15:51:15 +02:00 |
|
|
Zuellni
|
d2c554b69d
|
Add loras, 8bit cache, fix random seed, unloading
|
2023-10-25 19:53:44 +02:00 |
|
|
Zuellni
|
ebb32253a9
|
Allow only some tokens in output, add condition node
save prompt without having to preview, auto set seq len and tokens if 0
and some other stuff I already forgot, it should all work, but likely won't
|
2023-10-10 22:20:39 +02:00 |
|
|
Zuellni
|
ebf8ccab60
|
Garbage collect model before reloading, should fix vram issues
|
2023-10-07 22:59:45 +02:00 |
|
|
Zuellni
|
aa44ddb7b5
|
Change stop_on_newline to boolean
|
2023-10-07 22:39:47 +02:00 |
|
|
Zuellni
|
09bc77ba94
|
Check if the prompt's not empty before loading anything
|
2023-10-07 11:02:33 +02:00 |
|
|
Zuellni
|
6e78068c1a
|
Split nodes into files, allow loading each separately without cloning the repo, some other minor stuff, install exllamav2 pip package by default
|
2023-10-07 10:56:18 +02:00 |
|