City
88fb6fa001
Improve Q8_0 and Q4_0, Add Q4_1 and Q5_1
...
Use FP32 to do the calculations while dequantizing to improve existing Q8_0 quants and to avoid double dtype conversion.
Add Q4_1 and Q5_1 dequant kernels
2024-08-15 18:39:24 +02:00
City
303af6ff75
Upload basic quantization code
2024-08-15 08:09:59 +02:00
City
15e3f45ad7
Update README.md
2024-08-15 07:05:43 +02:00
City
6aa75db166
Update README.md
2024-08-15 06:41:47 +02:00
City
8b8416dea1
Update README.md
2024-08-15 06:30:33 +02:00
City
4750e45623
Update README.md
2024-08-15 06:21:19 +02:00
City
a8ce4e8d7c
Initial commit
2024-08-15 05:50:54 +02:00
City
7368f2d391
Initial commit
2024-08-15 05:26:26 +02:00
City