Commit Graph
614 Commits
Author SHA1 Message Date
kijai fa93f5b3c1 Add optional prompt disk caching
Caches text embeds to disk with unique hash based on T5 name, dtype and prompts. If found on disk skips encoding, persists after restarts.
2025-07-23 00:52:56 +03:00
kijai 729b6fdf7c support sparse sageattn2 for radial attn
Needs this installed:
https://github.com/Radioheading/Block-Sparse-SageAttention-2.0
2025-07-23 00:27:14 +03:00
kijai 9c45f3a97d Update nodes_model_loading.py 2025-07-23 00:10:14 +03:00
kijai eea896dace Update nodes_model_loading.py 2025-07-22 18:25:03 +03:00
kijai 70fcdff3c5 Update nodes_model_loading.py 2025-07-22 17:36:41 +03:00
kijai bfd6af8141 Update nodes_model_loading.py 2025-07-22 15:41:32 +03:00
kijai 98fa84bb17 Update nodes_model_loading.py 2025-07-22 13:58:43 +03:00
kijai 3988accdf3 Update nodes_model_loading.py 2025-07-21 23:44:24 +03:00
kijai 9911b5e6f0 oops 2025-07-21 22:49:05 +03:00
kijai 91515717d6 bump version 2025-07-21 22:46:50 +03:00
kijai 296baa30ce Add WanVideoSetLoRAs
Node to set the LoRA weights to use with the unmerged LoRA mode, not able to merge LoRAs but allows instant LoRA switching without any loading times. The effect of unmerged LoRAs is stronger and differs from merged LoRAs.
2025-07-21 22:39:17 +03:00
kijai 41d8bd9ec9 fix for context windows 2025-07-21 20:09:53 +03:00
kijai 4bf78e5316 Possibly reduce LoRA loading memory usage 2025-07-21 15:25:07 +03:00
kijai 6ef9224dfe Update model.py 2025-07-21 13:51:33 +03:00
kijai aeac12ed7a Only convert layers that actually have scaled weights... 2025-07-21 01:57:27 +03:00
kijai 29ce253bb6 Support fp8_scaled models and allow running LoRAs unmerged on other models as well 2025-07-21 01:37:30 +03:00
kijai 59add151eb Update attention.py 2025-07-20 16:22:27 +03:00
kijai e5b125cd89 Allow setting any block as dense for Radial attention
Also added WanVideoBlockList helper to to create list of ints that can be inserted to the dense_blocks -input.
2025-07-20 16:21:37 +03:00
kijai 0dba876979 Correct radial attn mask size when using context windows 2025-07-20 13:22:56 +03:00
kijai bb82d63453 Update nodes.py 2025-07-20 13:08:40 +03:00
kijai 768a4b2d90 Fix radial attention cache not resetting on resolution change, add more robust supported dimension check 2025-07-20 12:15:01 +03:00
kijai 9f75b7e051 Fix tiled_vae + endframe 2025-07-20 02:33:24 +03:00
kijai 1f25bba463 Merge branch 'pr/828' 2025-07-20 02:13:26 +03:00
kijai 47978275bb Update nodes.py 2025-07-20 02:13:07 +03:00
kijai edd9b20691 Add res_multistep 2025-07-20 01:41:17 +03:00
komikndr d3aba90119 adding 64 block_size 2025-07-19 20:05:19 +07:00
kijai 0f6fe96626 Update __init__.py 2025-07-18 23:01:03 +03:00
kijai feddafcea2 Update model.py 2025-07-18 18:52:32 +03:00
kijai 5a305a7f9f include sparse_sage_API code
https://github.com/jt-zhang/Sparse_SageAttention_API
2025-07-18 17:16:43 +03:00
kijai cf18ecc2da update i2v basic example 2025-07-18 16:42:02 +03:00
kijai c68f5f7439 move node 2025-07-18 16:41:49 +03:00
kijai c08296747f more refactoring 2025-07-18 16:31:34 +03:00
kijai 6b9565ed63 Code refactoring 2025-07-18 16:15:50 +03:00
kijai 8b8da7d8fe Update nodes.py 2025-07-18 14:41:38 +03:00
kijai 8538c517e6 Merge branch 'radial_attn' 2025-07-18 14:40:10 +03:00
kijai ed11e2bb3e Update nodes.py 2025-07-18 14:37:11 +03:00
kijai a1cc320c36 force using the set node 2025-07-18 14:26:45 +03:00
kijai 0e920e5b18 support VACE 2025-07-18 14:04:04 +03:00
kijai 55fc8a13e0 better mask cache, optimize 2025-07-18 13:55:06 +03:00
kijai 8919e65bab cache the mask 2025-07-18 01:43:45 +03:00
kijai a7166fc1a4 fix and rename args to be clearer 2025-07-18 01:28:01 +03:00
kijai 712eecf64b more compile friendly 2025-07-18 00:53:12 +03:00
kijai 605011a237 allow setting dense attention mode 2025-07-17 23:47:08 +03:00
kijai 9039d95721 cleanup and optimize 2025-07-17 22:40:26 +03:00
kijai 7c8020f8e8 works but slow 2025-07-17 21:49:14 +03:00
kijai 0417c8ea00 Update nodes.py 2025-07-17 20:48:16 +03:00
kijai 6ee7ad508e init (not working) 2025-07-17 20:47:02 +03:00
Jukka Seppänen 31b2c686cf Merge pull request #768 from Eikwang/fixunianimate
fix unianimate erro : OverflowError: cannot convert float infinity to…
2025-07-17 19:33:37 +03:00
kijai e011d031a8 Merge branch 'pr/799' 2025-07-17 19:33:10 +03:00
kijai 6e5b493b28 Create wanvideo_14B_pusa_I2V_example_01.json 2025-07-17 19:27:32 +03:00