City
826bd1804c
Make ops less jank
...
Also possibly faster. Ignore the massively increased system memory usage.
2024-08-30 03:25:57 +02:00
City
abe5c6a6c9
Fix weights not being copied for lowvram patch
...
This can probably be improved since the weights themselves never need to be copied as they cannot be changed anyway.
2024-08-28 20:23:08 +02:00
City
3d9869240b
Always patch weight
...
Should help with #33
2024-08-28 17:12:24 +02:00
City
258742c369
Fix Conv2D with bias
2024-08-26 17:49:18 +02:00
City
a9f6359a23
Merge pull request #63 from blepping/feat_sd1_sdxl
...
Add support for SD1x and SDXL models
2024-08-25 23:46:43 +02:00
blepping
df6f1ab39c
Sync with upstream
2024-08-25 15:32:45 -06:00
City
bfecd32f8c
Rewrite llama.cpp patch
...
For #63
2024-08-25 22:32:55 +02:00
blepping
c1693d0f55
Use a GGUF array for orig shape metadata
2024-08-25 13:18:35 -06:00
blepping
0aec56ec4c
Split orig shape metadata into individual fields
2024-08-25 12:00:28 -06:00
blepping
7413de86e6
Revert tensor construction change in dequantize_tensor
...
Eliminate GGMLOpsLayer, include functionality in GGMLLayer
2024-08-25 10:35:39 -06:00
blepping
f3cf802dd6
Cleanups, refactoring
2024-08-25 07:53:19 -06:00
blepping
2832969aea
Sync with main
2024-08-25 04:35:52 -06:00
City
0ba6f64974
Advanced loader with optimizations
...
It may help with speed but it may also increase VRAM usage or degrade image quality.
Fastest would be target/target/true.
2024-08-24 18:39:34 +02:00
City
90a63c0c0e
Fix for Intel Arc
...
Deep dive & fix by @simonlui in #50
2024-08-24 08:17:06 +02:00
blepping
c93e622a19
SD1/SDXL fixes
2024-08-23 20:19:48 -06:00
blepping
489aaecf7a
Show the correct type when using fallback quantization
2024-08-23 12:37:31 -06:00
blepping
cea1b47ab3
Add support for SD1x and SDXL models
2024-08-23 11:59:21 -06:00
City
377862a06d
Cast to device
...
forgot this
2024-08-23 03:23:49 +02:00
City
3aafaf9133
Fix LoRA loading on new versions
...
Again
2024-08-23 03:20:15 +02:00
City
6b499ec49e
Hotfix to work as normal tensor
...
Fixes [ViT-L-14-BEST...] not working
2024-08-23 02:13:48 +02:00
City
1743f8f1fa
Update README.md
2024-08-22 21:37:13 +02:00
City
8d1fbbc456
K quant patch / instructions
...
#11
2024-08-21 06:31:40 +02:00
City
1ebce77a44
Fix for single CLIP Loader
...
#52
2024-08-20 18:14:07 +02:00
City
65c0ab15a8
Update README.md
2024-08-20 04:22:35 +02:00
City
5d7ffb582c
Merge pull request #49 from city96/gguf_tenc
...
GGUF Text Encoder support
2024-08-20 03:52:09 +02:00
City
e7906b43eb
Hotfix for missing text_projection in clip
...
Also adds the triple text encode node for the 5 people still using SD3
2024-08-20 03:38:59 +02:00
City
2ca943a1c3
Hotfix for clip
...
I'm sure this won't break a million other things
2024-08-20 02:42:22 +02:00
City
2e5e599b54
CLIP Loaders
2024-08-20 02:23:37 +02:00
City
dc8b18d512
Move to top
2024-08-19 21:51:03 +02:00
City
165212919e
Pin numpy version
...
#7
2024-08-19 08:08:12 +02:00
City
a8bfdcfbd2
Fix Q4_0
...
#41
2024-08-18 09:44:46 +02:00
City
a39bb22bf6
Merge pull request #40 from city96/kquants
...
K-quant support
2024-08-18 08:23:29 +02:00
City
4b239d2d75
Fix name change / regular unet list crosstalk
...
#39
2024-08-18 05:02:34 +02:00
City
724b2d8559
LoRA issue workaround
...
Proposed by @ahiser1117 in #37
2024-08-18 04:29:58 +02:00
City
d93fbc81f6
Test script
2024-08-18 04:27:17 +02:00
City
6295603d08
K quants
2024-08-18 04:26:47 +02:00
City
39a45c65d8
Better tensor split
2024-08-18 03:00:44 +02:00
City
a1953693b3
Fix invalid file type in metadata
2024-08-18 02:59:49 +02:00
City
4e848f7c95
Change model patcher logic
...
Janky MethodType -> Inheritance
#31
2024-08-17 11:43:51 +02:00
City
e3f0a4b127
Update README.md
2024-08-17 08:44:55 +02:00
City
c85a8c0db8
Merge pull request #29 from city96/lora
...
Native LoRA support
2024-08-17 08:05:56 +02:00
City
96b0ba1021
Allow using the native LoRA loader node
2024-08-17 07:56:38 +02:00
City
22e2c885f0
Async patch load with GPU support
2024-08-17 07:38:55 +02:00
City
fed8ff1e70
Add LoRA support
...
Initial, will need to change weight function
2024-08-17 05:28:46 +02:00
City
2877c18573
Less fragile logic
2024-08-17 04:42:59 +02:00
City
b5a3646aae
Fix state dict names
2024-08-17 01:57:57 +02:00
City
7e09d35f57
Update README.md
2024-08-16 17:01:12 +02:00
ddh0
51c95d7d70
fallback to F32 for 1-dimensional or very small tensors ( #20 )
...
* change fallback data type from F16 to F32
* only fallback to F32 for 1D or very small tensors
* change exception fallback type
* blacklist before small tensor check
2024-08-16 06:43:59 +02:00
City
de5f6e9dcc
mmap loading, lowvram support
...
This should fix both types of OOM issues!
2024-08-16 04:29:14 +02:00
City
d4c75a69c9
Change dequant logic to FP16
...
Benefit of FP32 for dequantization seems less noticable and feels more like a sidegrade due to differences in numerical precision. Was causing issues with memory not being freed.
#16
2024-08-16 01:26:57 +02:00
City