kijai
e5be3e5263
Use torch custom_ops to avoid graph breaks with torch.compile
...
Hopefully finally fixes the torch.compile VRAM issues...
2025-12-01 00:29:27 +02:00
kijai
8002d8a2f9
This still needed for some reason too
2025-11-04 09:58:40 +02:00
kijai
9fa4140159
Make lora torch.compile optional for unmerged lora application
...
This change has caused issues especially with LoRAs that have dynamic rank. Will now be disabled by default, to allow full graph with unmerged LoRAs the option to allow compile is available in the Torch Compile Settings -node
2025-11-04 01:34:51 +02:00
kijai
ce6e7b501d
Fix unmerged LoRA application for certain LoRAs
2025-10-30 23:28:38 +02:00
kijai
cc9bf1e4f5
Store lora diffs in buffers for GGUF as well
2025-10-30 16:44:03 +02:00
kijai
e69e068b57
Update gguf.py
2025-10-27 21:02:59 +02:00
kijai
282947d93a
GGUF fix
2025-08-18 16:57:07 +03:00
kijai
7fc5ec305d
Refactor model loading
2025-08-16 16:03:15 +03:00
kijai
7c93aea182
rename fp8 optimization in code for clarity as it does more than that with loras
2025-08-11 14:32:57 +03:00
kijai
6ec463288f
Fix LoRA scheduling with multiple LoRAs
2025-08-04 23:47:02 +03:00
kijai
267e86704b
Update gguf.py
2025-08-04 00:49:53 +03:00
kijai
7a00a875e7
LoRA scheduling on GGUFs too
2025-08-04 00:49:29 +03:00
kijai
b89cf970e1
Fix GGUF + LoRA + VACE
...
Always something part two...
2025-07-25 16:44:43 +03:00
kijai
794a38cc7e
Further GGUF+LoRA fixes
2025-07-25 00:40:48 +03:00
kijai
73b7444baa
remove print
2025-07-24 23:54:30 +03:00
kijai
ea36decf07
Fix GGUF + LoRA + torch.compile
...
Always something...
2025-07-24 23:52:18 +03:00
kijai
b3820055d0
Fix GGUF with LoRAs and support GGUF witgh SetLoras -node
2025-07-24 14:59:59 +03:00
kijai
29ce253bb6
Support fp8_scaled models and allow running LoRAs unmerged on other models as well
2025-07-21 01:37:30 +03:00
kijai
b65f161e8b
Fix gguf + lora alpha scaling
2025-07-08 16:47:41 +03:00
kijai
ce0bae1839
revert this
2025-07-08 16:23:29 +03:00
kijai
8500514ef9
gguf + lora application fix
2025-07-08 12:53:29 +03:00
kijai
20e9914645
Update gguf.py
2025-07-08 12:33:50 +03:00
kijai
372e33bd5b
possible fix for some gguf + torch.compile issues
2025-07-08 11:32:27 +03:00
kijai
d16e2aa2ff
Apply possible LoRA alpha with GGUF too
2025-07-08 09:27:22 +03:00
kijai
79ed360009
fix Q5 etc.
2025-07-07 01:31:27 +03:00
kijai
6ae5531bad
Basic GGUF support (yes, really)
2025-07-06 21:37:45 +03:00
kijai