kijai
f86d2b84a0
Update nodes.py
2025-07-27 15:34:57 +03:00
kijai
3567202e75
Fix compile and support radial attn in the DF sampler
2025-07-27 14:19:31 +03:00
Jukka Seppänen
c0a4e8aa87
Update readme.md
2025-07-27 01:43:32 +03:00
kijai
bc68d35e5a
Create wanvideo_1_3B_EchoShot_example.json
2025-07-26 19:25:04 +03:00
kijai
cb36e1013e
Fix
2025-07-26 19:01:58 +03:00
kijai
df1476bf42
Support EchoShot
...
https://github.com/D2I-ai/EchoShot
2025-07-26 18:51:29 +03:00
kijai
9a1ab1c656
only show lora metadata if it actually exists
2025-07-26 14:32:53 +03:00
kijai
5c36a4b111
minor memory tweaks
2025-07-26 14:19:07 +03:00
kijai
3157e0389e
Update nodes.py
2025-07-26 11:50:24 +03:00
kijai
34c2cc23a9
Update nodes_model_loading.py
2025-07-25 20:49:41 +03:00
kijai
a35eb7dfa4
Basic sageattn3 support
...
Probably going to need further timestep scheduling as the quality of sage3 on it's own is pretty bad.
2025-07-25 20:48:34 +03:00
kijai
76750eec05
Allow loading aitoolkit/lycoris format
2025-07-25 17:24:43 +03:00
kijai
b89cf970e1
Fix GGUF + LoRA + VACE
...
Always something part two...
2025-07-25 16:44:43 +03:00
kijai
794a38cc7e
Further GGUF+LoRA fixes
2025-07-25 00:40:48 +03:00
kijai
73b7444baa
remove print
2025-07-24 23:54:30 +03:00
kijai
ea36decf07
Fix GGUF + LoRA + torch.compile
...
Always something...
2025-07-24 23:52:18 +03:00
kijai
b3820055d0
Fix GGUF with LoRAs and support GGUF witgh SetLoras -node
2025-07-24 14:59:59 +03:00
kijai
35e637cbfd
Allow merging LoRA to fp8 scaled models
2025-07-24 11:51:36 +03:00
kijai
d6425cab02
Update nodes_model_loading.py
2025-07-24 00:08:39 +03:00
kijai
59cd0dc272
Update nodes.py
2025-07-23 18:11:15 +03:00
kijai
838803d053
Update nodes_model_loading.py
2025-07-23 17:58:28 +03:00
kijai
bdce322e65
remove loras if SetLora bypassed/disconnected
2025-07-23 17:51:59 +03:00
kijai
66226a8a1b
why was this ever this way...
2025-07-23 17:17:27 +03:00
kijai
3ed58330d9
better
2025-07-23 16:56:33 +03:00
kijai
65ac9fa6d9
cache positive and negative separately, add cache to single encode node as well
2025-07-23 16:33:11 +03:00
kijai
5e56e3649f
fix control lora
2025-07-23 16:20:30 +03:00
kijai
0212ad7a2d
cache only the prompts
...
so we can disconnect T5 completely if text embed exists in cache
2025-07-23 15:33:32 +03:00
kijai
1a1af02912
Allow using different init image for context windows beyond first one
...
This can be useful with models like MAGREF that behave differently when the init image is padded with white, idea is to use full init for first window and padded image for the rest, so that it works more like reference and doesn't force the window to snap back to the init.
2025-07-23 12:51:57 +03:00
kijai
9d9b188b0b
Update fp8_optimization.py
2025-07-23 01:22:42 +03:00
kijai
fa93f5b3c1
Add optional prompt disk caching
...
Caches text embeds to disk with unique hash based on T5 name, dtype and prompts. If found on disk skips encoding, persists after restarts.
2025-07-23 00:52:56 +03:00
kijai
729b6fdf7c
support sparse sageattn2 for radial attn
...
Needs this installed:
https://github.com/Radioheading/Block-Sparse-SageAttention-2.0
2025-07-23 00:27:14 +03:00
kijai
9c45f3a97d
Update nodes_model_loading.py
2025-07-23 00:10:14 +03:00
kijai
eea896dace
Update nodes_model_loading.py
2025-07-22 18:25:03 +03:00
kijai
70fcdff3c5
Update nodes_model_loading.py
2025-07-22 17:36:41 +03:00
kijai
bfd6af8141
Update nodes_model_loading.py
2025-07-22 15:41:32 +03:00
kijai
98fa84bb17
Update nodes_model_loading.py
2025-07-22 13:58:43 +03:00
kijai
3988accdf3
Update nodes_model_loading.py
2025-07-21 23:44:24 +03:00
kijai
9911b5e6f0
oops
2025-07-21 22:49:05 +03:00
kijai
91515717d6
bump version
2025-07-21 22:46:50 +03:00
kijai
296baa30ce
Add WanVideoSetLoRAs
...
Node to set the LoRA weights to use with the unmerged LoRA mode, not able to merge LoRAs but allows instant LoRA switching without any loading times. The effect of unmerged LoRAs is stronger and differs from merged LoRAs.
2025-07-21 22:39:17 +03:00
kijai
41d8bd9ec9
fix for context windows
2025-07-21 20:09:53 +03:00
kijai
4bf78e5316
Possibly reduce LoRA loading memory usage
2025-07-21 15:25:07 +03:00
kijai
6ef9224dfe
Update model.py
2025-07-21 13:51:33 +03:00
kijai
aeac12ed7a
Only convert layers that actually have scaled weights...
2025-07-21 01:57:27 +03:00
kijai
29ce253bb6
Support fp8_scaled models and allow running LoRAs unmerged on other models as well
2025-07-21 01:37:30 +03:00
kijai
59add151eb
Update attention.py
2025-07-20 16:22:27 +03:00
kijai
e5b125cd89
Allow setting any block as dense for Radial attention
...
Also added WanVideoBlockList helper to to create list of ints that can be inserted to the dense_blocks -input.
2025-07-20 16:21:37 +03:00
kijai
0dba876979
Correct radial attn mask size when using context windows
2025-07-20 13:22:56 +03:00
kijai
bb82d63453
Update nodes.py
2025-07-20 13:08:40 +03:00
kijai
768a4b2d90
Fix radial attention cache not resetting on resolution change, add more robust supported dimension check
2025-07-20 12:15:01 +03:00
kijai