kijai
35e637cbfd
Allow merging LoRA to fp8 scaled models
2025-07-24 11:51:36 +03:00
kijai
d6425cab02
Update nodes_model_loading.py
2025-07-24 00:08:39 +03:00
kijai
59cd0dc272
Update nodes.py
2025-07-23 18:11:15 +03:00
kijai
838803d053
Update nodes_model_loading.py
2025-07-23 17:58:28 +03:00
kijai
bdce322e65
remove loras if SetLora bypassed/disconnected
2025-07-23 17:51:59 +03:00
kijai
66226a8a1b
why was this ever this way...
2025-07-23 17:17:27 +03:00
kijai
3ed58330d9
better
2025-07-23 16:56:33 +03:00
kijai
65ac9fa6d9
cache positive and negative separately, add cache to single encode node as well
2025-07-23 16:33:11 +03:00
kijai
5e56e3649f
fix control lora
2025-07-23 16:20:30 +03:00
kijai
0212ad7a2d
cache only the prompts
...
so we can disconnect T5 completely if text embed exists in cache
2025-07-23 15:33:32 +03:00
kijai
1a1af02912
Allow using different init image for context windows beyond first one
...
This can be useful with models like MAGREF that behave differently when the init image is padded with white, idea is to use full init for first window and padded image for the rest, so that it works more like reference and doesn't force the window to snap back to the init.
2025-07-23 12:51:57 +03:00
kijai
9d9b188b0b
Update fp8_optimization.py
2025-07-23 01:22:42 +03:00
kijai
fa93f5b3c1
Add optional prompt disk caching
...
Caches text embeds to disk with unique hash based on T5 name, dtype and prompts. If found on disk skips encoding, persists after restarts.
2025-07-23 00:52:56 +03:00
kijai
729b6fdf7c
support sparse sageattn2 for radial attn
...
Needs this installed:
https://github.com/Radioheading/Block-Sparse-SageAttention-2.0
2025-07-23 00:27:14 +03:00
kijai
9c45f3a97d
Update nodes_model_loading.py
2025-07-23 00:10:14 +03:00
kijai
eea896dace
Update nodes_model_loading.py
2025-07-22 18:25:03 +03:00
kijai
70fcdff3c5
Update nodes_model_loading.py
2025-07-22 17:36:41 +03:00
kijai
bfd6af8141
Update nodes_model_loading.py
2025-07-22 15:41:32 +03:00
kijai
98fa84bb17
Update nodes_model_loading.py
2025-07-22 13:58:43 +03:00
kijai
3988accdf3
Update nodes_model_loading.py
2025-07-21 23:44:24 +03:00
kijai
9911b5e6f0
oops
2025-07-21 22:49:05 +03:00
kijai
91515717d6
bump version
2025-07-21 22:46:50 +03:00
kijai
296baa30ce
Add WanVideoSetLoRAs
...
Node to set the LoRA weights to use with the unmerged LoRA mode, not able to merge LoRAs but allows instant LoRA switching without any loading times. The effect of unmerged LoRAs is stronger and differs from merged LoRAs.
2025-07-21 22:39:17 +03:00
kijai
41d8bd9ec9
fix for context windows
2025-07-21 20:09:53 +03:00
kijai
4bf78e5316
Possibly reduce LoRA loading memory usage
2025-07-21 15:25:07 +03:00
kijai
6ef9224dfe
Update model.py
2025-07-21 13:51:33 +03:00
kijai
aeac12ed7a
Only convert layers that actually have scaled weights...
2025-07-21 01:57:27 +03:00
kijai
29ce253bb6
Support fp8_scaled models and allow running LoRAs unmerged on other models as well
2025-07-21 01:37:30 +03:00
kijai
59add151eb
Update attention.py
2025-07-20 16:22:27 +03:00
kijai
e5b125cd89
Allow setting any block as dense for Radial attention
...
Also added WanVideoBlockList helper to to create list of ints that can be inserted to the dense_blocks -input.
2025-07-20 16:21:37 +03:00
kijai
0dba876979
Correct radial attn mask size when using context windows
2025-07-20 13:22:56 +03:00
kijai
bb82d63453
Update nodes.py
2025-07-20 13:08:40 +03:00
kijai
768a4b2d90
Fix radial attention cache not resetting on resolution change, add more robust supported dimension check
2025-07-20 12:15:01 +03:00
kijai
9f75b7e051
Fix tiled_vae + endframe
2025-07-20 02:33:24 +03:00
kijai
1f25bba463
Merge branch 'pr/828'
2025-07-20 02:13:26 +03:00
kijai
47978275bb
Update nodes.py
2025-07-20 02:13:07 +03:00
kijai
edd9b20691
Add res_multistep
2025-07-20 01:41:17 +03:00
komikndr
d3aba90119
adding 64 block_size
2025-07-19 20:05:19 +07:00
kijai
0f6fe96626
Update __init__.py
2025-07-18 23:01:03 +03:00
kijai
feddafcea2
Update model.py
2025-07-18 18:52:32 +03:00
kijai
5a305a7f9f
include sparse_sage_API code
...
https://github.com/jt-zhang/Sparse_SageAttention_API
2025-07-18 17:16:43 +03:00
kijai
cf18ecc2da
update i2v basic example
2025-07-18 16:42:02 +03:00
kijai
c68f5f7439
move node
2025-07-18 16:41:49 +03:00
kijai
c08296747f
more refactoring
2025-07-18 16:31:34 +03:00
kijai
6b9565ed63
Code refactoring
2025-07-18 16:15:50 +03:00
kijai
8b8da7d8fe
Update nodes.py
2025-07-18 14:41:38 +03:00
kijai
8538c517e6
Merge branch 'radial_attn'
2025-07-18 14:40:10 +03:00
kijai
ed11e2bb3e
Update nodes.py
2025-07-18 14:37:11 +03:00
kijai
a1cc320c36
force using the set node
2025-07-18 14:26:45 +03:00
kijai
0e920e5b18
support VACE
2025-07-18 14:04:04 +03:00
kijai