City
31dffa061b
Add error message for missing packages
2025-03-14 17:37:14 +01:00
City
296b0c1419
Clean up field logic
2025-03-14 17:11:47 +01:00
City
d99b2d931f
force dequant on umT5 to prevent OOM
...
not the best solution but that tensor alone needs ~3GB of runtime memory to dequant
2025-03-14 16:56:48 +01:00
City
01f6e3ff63
spiece tokenizer from gguf metadata
2025-03-05 04:44:53 +01:00
City
298192ed60
Wan model arch
2025-02-26 07:40:44 +01:00
City
c6ad4f2363
Account for not having quantized weights
...
#188
2024-12-22 19:00:03 +01:00
City
51fa2cbb5c
Account for dequantization VRAM to avoid OOM
...
#187
2024-12-22 18:09:51 +01:00
City
8d1b56c5e2
Loader logic for LLaMA models
...
Tokenizer shape may be mismatched depending which model was used as source (128320 VS 128256) - warning instead of error for now.
k and q attn keys need to be reshaped back to HF format (inverse of convert_hf_to_gguf.py logic)
2024-12-20 13:39:17 +01:00
City
0a1723baae
Split loader into separate file
2024-12-20 13:03:27 +01:00
City