City
0ba6f64974
Advanced loader with optimizations
...
It may help with speed but it may also increase VRAM usage or degrade image quality.
Fastest would be target/target/true.
2024-08-24 18:39:34 +02:00
City
90a63c0c0e
Fix for Intel Arc
...
Deep dive & fix by @simonlui in #50
2024-08-24 08:17:06 +02:00
City
6b499ec49e
Hotfix to work as normal tensor
...
Fixes [ViT-L-14-BEST...] not working
2024-08-23 02:13:48 +02:00
City
2ca943a1c3
Hotfix for clip
...
I'm sure this won't break a million other things
2024-08-20 02:42:22 +02:00
City
2e5e599b54
CLIP Loaders
2024-08-20 02:23:37 +02:00
City
724b2d8559
LoRA issue workaround
...
Proposed by @ahiser1117 in #37
2024-08-18 04:29:58 +02:00
City
22e2c885f0
Async patch load with GPU support
2024-08-17 07:38:55 +02:00
City
fed8ff1e70
Add LoRA support
...
Initial, will need to change weight function
2024-08-17 05:28:46 +02:00
City
2877c18573
Less fragile logic
2024-08-17 04:42:59 +02:00
City
b5a3646aae
Fix state dict names
2024-08-17 01:57:57 +02:00
City
de5f6e9dcc
mmap loading, lowvram support
...
This should fix both types of OOM issues!
2024-08-16 04:29:14 +02:00
City
88fb6fa001
Improve Q8_0 and Q4_0, Add Q4_1 and Q5_1
...
Use FP32 to do the calculations while dequantizing to improve existing Q8_0 quants and to avoid double dtype conversion.
Add Q4_1 and Q5_1 dequant kernels
2024-08-15 18:39:24 +02:00
City
a8ce4e8d7c
Initial commit
2024-08-15 05:50:54 +02:00
City