City
de33c984c1
Merge branch 'main' into convert_refactor_new
2025-04-10 07:12:14 +02:00
City
624687939f
Refactor 5D patch and save loop
2025-04-10 07:12:10 +02:00
Xiangxi Guo (Ryan)
0c3bdf336e
Enable more torch.compile optimization by reducing graph breaks ( #243 )
...
As title, there were 2 fundamental sources of graph breaks:
1. using a pre-existing set in a `torch.compile` region, this is a
[known issue](https://github.com/pytorch/pytorch/issues/145761 ) in
PyTorch and the fix is WIP, but it's a lot easier to change the set
into a tuple here to fix the graph break.
2. using tensor subclass `GGMLTensor`. The full support of tensor
subclass has been gated for `torch.compile`, but with [a recent WIP
stack](https://github.com/pytorch/pytorch/pull/149792 ),
we'll be able to remove the gating and have `torch.compile` fully
support the `GGMLTensor` in this repo. The only required change here
is avoid changing the `__class__` attribute, and instead using
`torch.Tensor` to convert the subclass object back to Tensor.
2025-04-10 02:46:33 +02:00
City
862e4147c4
Make 5D tensor fix less fragile
2025-04-03 00:38:46 +02:00
City
c36b7236e6
Update README.md
2025-03-30 18:46:09 +02:00
City
f3b968e137
Merge branch 'main' into convert_refactor_new
2025-03-30 18:43:44 +02:00
City
bbd89ae547
Update .gitignore
2025-03-30 18:42:17 +02:00
City
65a2bc20bb
wan bf16 fix
2025-03-28 04:21:26 +01:00
City
1c873edeb6
Expose strip prefix as function
...
For external convert/detection logic
2025-03-22 20:40:24 +01:00
City
bc5223b0e3
Fix qtype logging on newer gguf-py
2025-03-16 20:14:33 +01:00
City
4aebf1bf2c
Add compat mode pig
...
closes #230
2025-03-16 19:38:40 +01:00
City
5aa6e98ad7
Merge pull request #224 from city96/tokenizer_convert
...
Sentencepiece tokenizer from gguf metadata for UMT5
2025-03-14 17:53:02 +01:00
City
ad69decc8d
Update requirements.txt
2025-03-14 17:43:05 +01:00
City
31dffa061b
Add error message for missing packages
2025-03-14 17:37:14 +01:00
City
296b0c1419
Clean up field logic
2025-03-14 17:11:47 +01:00
City
d99b2d931f
force dequant on umT5 to prevent OOM
...
not the best solution but that tensor alone needs ~3GB of runtime memory to dequant
2025-03-14 16:56:48 +01:00
City
d40e9bdcfe
Use args for 5d fix
2025-03-14 16:48:01 +01:00
City
9d0a0e317e
ltxv bf16 fix
...
scale shift table loads into nn.parameter, which can't work with BF16
2025-03-07 22:37:17 +01:00
City
c3a6103af5
hyvid subkey load fix
2025-03-07 22:36:51 +01:00
City
01f6e3ff63
spiece tokenizer from gguf metadata
2025-03-05 04:44:53 +01:00
City
929a9e5f0d
Keep img_emb in F32 for wan i2v
2025-02-27 05:58:01 +01:00
City
32a8eab8f9
Merge branch 'main' into convert_refactor_new
2025-02-27 03:19:19 +01:00
City
298192ed60
Wan model arch
2025-02-26 07:40:44 +01:00
City
cd361cf0e3
Update README.md
2025-02-26 07:39:01 +01:00
YarvixPA
8832d37df2
Solution for patch files line endings and update for /tools README.md ( #202 )
...
* Create convert_lines_ending.py
Solution to convert line ending from Windows (CRLF) to Unix (LF)
* Update README.md
* Rename convert_lines_ending.py to fix_lines_ending.py
* Update README.md
2025-02-26 07:35:42 +01:00
City
355b43228c
Wan2.1 convert logic
2025-02-26 07:06:54 +01:00
City
e024aab10d
Torch compile possible workaround
...
Seems to help on torch 2.6.0 with triton 3.2.0, less so on old versions.
Includes workaround for 2.0.X and other really old versions
#118
2025-02-23 18:49:50 +01:00
City
abdfec54c4
Hunyuan Jank
2025-02-20 05:10:27 +01:00
City
2d46bcd61b
Sanity checks in conversion code
2025-01-08 17:45:37 +01:00
City
8d313a677a
Unused/old logic
2025-01-08 17:17:49 +01:00
City
5875c52f59
Unpin numpy version
...
#196 #7
2025-01-08 16:30:17 +01:00
City
8098c7149f
Add PixArt clip type
...
Also makes the map more readable
#195
2025-01-04 21:46:23 +01:00
City
3dc384b233
More robust folder path logic
...
Attempts to override the unet_gguf key with our current one if it exists + print a warning.
Should only be triggered if another custom node edits the expected key in some way.
2024-12-26 21:42:33 +01:00
City
c6ad4f2363
Account for not having quantized weights
...
#188
2024-12-22 19:00:03 +01:00
City
51fa2cbb5c
Account for dequantization VRAM to avoid OOM
...
#187
2024-12-22 18:09:51 +01:00
City
eaffa0a7d3
Change clip workaround for SD3
...
#186
2024-12-22 15:24:14 +01:00
City
8d1b56c5e2
Loader logic for LLaMA models
...
Tokenizer shape may be mismatched depending which model was used as source (128320 VS 128256) - warning instead of error for now.
k and q attn keys need to be reshaped back to HF format (inverse of convert_hf_to_gguf.py logic)
2024-12-20 13:39:17 +01:00
City
0a1723baae
Split loader into separate file
2024-12-20 13:03:27 +01:00
City
0b65261cc4
HunyuanVideo
...
Convert script needs fixing, had to use a second script for the 5D tensor, will clean up and upload it later.
2024-12-17 07:33:42 +01:00
City
65a7c895bb
Better propagation fix
...
#163
2024-12-14 00:38:11 +01:00
City
23b9817081
LTX-Video
...
Whilst we wait for Hunyuan Video.
2024-12-08 00:48:59 +01:00
City
851564739d
Updated Intel Arc fix
...
Provided by @simonlui in #50 as a patch
2024-12-05 03:16:23 +01:00
City
39102df73f
Stop custom tensor class propagating past dequant
...
#163
2024-12-04 16:14:54 +01:00
City
6e4790f903
Unused workaround
2024-12-04 15:54:20 +01:00
City
a8b5f5d892
Less fragile patch logic
...
For new ComfyUI versions. Relatively minimal, hopefully won't break with future updates
#163
2024-12-04 02:09:01 +01:00
City
4a84328841
Add AuraFlow support
2024-11-23 06:51:29 +01:00
City
57562d54a5
Add ltxv clip type
...
#162
2024-11-23 00:10:27 +01:00
City
51c9713400
Fix sd1 not using shape fix
2024-11-21 02:24:40 +01:00
RandomGitUser321
8e898fad4c
Add mochi to CLIPLoaderGGUF options ( #154 )
...
* Add mochi to CLIPLoaderGGUF options
ComfyUI implemented it today, so this should be all that's needed to use the T5 GGUF with it
* Update nodes.py
2024-11-06 14:04:04 +01:00
City
9833348005
Fix for text encoder folder name change
...
#151
2024-11-03 14:03:42 +01:00
City