Commit Graph
20 Commits
Author SHA1 Message Date
blepping e814fc1264 Revert ggml_tensor_name addition 2024-08-28 12:34:08 -06:00
blepping 6ae0c733b0 Support loading u-net from stable-diffusion.cpp GGUF files
Small cleanups
2024-08-28 10:34:58 -06:00
City 258742c369 Fix Conv2D with bias 2024-08-26 17:49:18 +02:00
blepping 7413de86e6 Revert tensor construction change in dequantize_tensor
Eliminate GGMLOpsLayer, include functionality in GGMLLayer
2024-08-25 10:35:39 -06:00
blepping f3cf802dd6 Cleanups, refactoring 2024-08-25 07:53:19 -06:00
blepping 2832969aea Sync with main 2024-08-25 04:35:52 -06:00
City 0ba6f64974 Advanced loader with optimizations
It may help with speed but it may also increase VRAM usage or degrade image quality.
Fastest would be target/target/true.
2024-08-24 18:39:34 +02:00
City 90a63c0c0e Fix for Intel Arc
Deep dive & fix by @simonlui in #50
2024-08-24 08:17:06 +02:00
blepping c93e622a19 SD1/SDXL fixes 2024-08-23 20:19:48 -06:00
City 6b499ec49e Hotfix to work as normal tensor
Fixes [ViT-L-14-BEST...] not working
2024-08-23 02:13:48 +02:00
City 2ca943a1c3 Hotfix for clip
I'm sure this won't break a million other things
2024-08-20 02:42:22 +02:00
City 2e5e599b54 CLIP Loaders 2024-08-20 02:23:37 +02:00
City 724b2d8559 LoRA issue workaround
Proposed by @ahiser1117 in #37
2024-08-18 04:29:58 +02:00
City 22e2c885f0 Async patch load with GPU support 2024-08-17 07:38:55 +02:00
City fed8ff1e70 Add LoRA support
Initial, will need to change weight function
2024-08-17 05:28:46 +02:00
City 2877c18573 Less fragile logic 2024-08-17 04:42:59 +02:00
City b5a3646aae Fix state dict names 2024-08-17 01:57:57 +02:00
City de5f6e9dcc mmap loading, lowvram support
This should fix both types of OOM issues!
2024-08-16 04:29:14 +02:00
City 88fb6fa001 Improve Q8_0 and Q4_0, Add Q4_1 and Q5_1
Use FP32 to do the calculations while dequantizing to improve existing Q8_0 quants and to avoid double dtype conversion.
Add Q4_1 and Q5_1 dequant kernels
2024-08-15 18:39:24 +02:00
City a8ce4e8d7c Initial commit 2024-08-15 05:50:54 +02:00