Commit Graph
2 Commits
Author SHA1 Message Date
City 8d1b56c5e2 Loader logic for LLaMA models
Tokenizer shape may be mismatched depending which model was used as source (128320 VS 128256) - warning instead of error for now.
k and q attn keys need to be reshaped back to HF format (inverse of convert_hf_to_gguf.py logic)
2024-12-20 13:39:17 +01:00
City 0a1723baae Split loader into separate file 2024-12-20 13:03:27 +01:00