City
7f3ced6c3e
Consider FP8 as source
...
#91
2024-09-01 00:56:30 +02:00
blepping
df6f1ab39c
Sync with upstream
2024-08-25 15:32:45 -06:00
City
bfecd32f8c
Rewrite llama.cpp patch
...
For #63
2024-08-25 22:32:55 +02:00
blepping
c1693d0f55
Use a GGUF array for orig shape metadata
2024-08-25 13:18:35 -06:00
blepping
0aec56ec4c
Split orig shape metadata into individual fields
2024-08-25 12:00:28 -06:00
blepping
f3cf802dd6
Cleanups, refactoring
2024-08-25 07:53:19 -06:00
blepping
c93e622a19
SD1/SDXL fixes
2024-08-23 20:19:48 -06:00
blepping
489aaecf7a
Show the correct type when using fallback quantization
2024-08-23 12:37:31 -06:00
blepping
cea1b47ab3
Add support for SD1x and SDXL models
2024-08-23 11:59:21 -06:00
City
8d1fbbc456
K quant patch / instructions
...
#11
2024-08-21 06:31:40 +02:00
City
d93fbc81f6
Test script
2024-08-18 04:27:17 +02:00
City
a1953693b3
Fix invalid file type in metadata
2024-08-18 02:59:49 +02:00
ddh0
51c95d7d70
fallback to F32 for 1-dimensional or very small tensors ( #20 )
...
* change fallback data type from F16 to F32
* only fallback to F32 for 1D or very small tensors
* change exception fallback type
* blacklist before small tensor check
2024-08-16 06:43:59 +02:00
City
303af6ff75
Upload basic quantization code
2024-08-15 08:09:59 +02:00
City