3 Commits

Include renames

Author	SHA1	Message	Date
City	de5f6e9dcc	mmap loading, lowvram support ... This should fix both types of OOM issues!	2024-08-16 04:29:14 +02:00
City	88fb6fa001	Improve Q8_0 and Q4_0, Add Q4_1 and Q5_1 ... Use FP32 to do the calculations while dequantizing to improve existing Q8_0 quants and to avoid double dtype conversion. Add Q4_1 and Q5_1 dequant kernels	2024-08-15 18:39:24 +02:00
City	a8ce4e8d7c	Initial commit	2024-08-15 05:50:54 +02:00