4 Commits

Include renames

Author	SHA1	Message	Date
City	c6ad4f2363	Account for not having quantized weights ... #188	2024-12-22 19:00:03 +01:00
City	51fa2cbb5c	Account for dequantization VRAM to avoid OOM ... #187	2024-12-22 18:09:51 +01:00
City	8d1b56c5e2	Loader logic for LLaMA models ... Tokenizer shape may be mismatched depending which model was used as source (128320 VS 128256) - warning instead of error for now. k and q attn keys need to be reshaped back to HF format (inverse of convert_hf_to_gguf.py logic)	2024-12-20 13:39:17 +01:00
City	0a1723baae	Split loader into separate file	2024-12-20 13:03:27 +01:00