Commit Graph
100 Commits
Author SHA1 Message Date
kijai 83bb0e7f35 fp8 text encoder fixes 2025-08-01 17:42:32 +03:00
kijai 8321e19009 Fix single text encoder after previous change 2025-08-01 14:45:29 +03:00
kijai 5406a72f62 Improve text encoder cache and add alternative node which leaves nothing to memory after encoding
WanVideoTextEncodeCached -node will load T5 when the prompt is not found in the cache, then unload it completely.
2025-08-01 12:36:19 +03:00
kijai 9edab74562 Default non_blocking to False
too many RAM issues
2025-08-01 02:29:07 +03:00
kijai 7eebde487f typo 2025-08-01 00:54:54 +03:00
kijai 945700d56e 5B fixes 2025-07-31 22:41:56 +03:00
kijai 5bacc50088 Add safety check for context windows to avoid crash on tensor slicing 2025-07-31 17:09:05 +03:00
kijai b60814fb6b Fix split prompting, get rid of diffusers on model class 2025-07-31 15:11:47 +03:00
kijai 10b67de349 Fix loading TAEW from extra paths 2025-07-31 13:47:59 +03:00
kijai 4cf2ffc979 Merge branch 'main' of https://github.com/kijai/ComfyUI-WanVideoWrapper 2025-07-31 12:50:17 +03:00
kijai ef23a6213d return denoised samples as well for previewing unfinished latents 2025-07-31 12:50:10 +03:00
Jukka Seppänen ee1e762a7f Update readme.md 2025-07-31 12:37:16 +03:00
kijai 0cc4583653 flowedit fix 2025-07-31 12:21:40 +03:00
kijai e545b18627 vid2vid fix
Need to use add_noise_to_samples = True now for vid2vid, defaulting to False to not break 2.2 dual sampler workflows, but hardcode to always be True if denoise is used to not break old workflows
2025-07-30 19:41:51 +03:00
kijai 4eabdcce78 wrong way around 2025-07-30 18:45:19 +03:00
kijai 138b377d1d Fix loading fp8 models where everything is fp8... 2025-07-30 17:34:56 +03:00
kijai 9a5d752ba1 Support custom sigmas on more schedulers 2025-07-30 16:20:48 +03:00
kijai ec066008a8 Make start/end step work with vid2vid 2025-07-30 15:59:22 +03:00
kijai 406643f8ee Create wanvideo_2_2_5B_I2V_example_WIP.json 2025-07-30 00:46:46 +03:00
kijai 6ef3ee83ef Update nodes.py 2025-07-30 00:40:42 +03:00
kijai 3f4e8433bd Add node to allow getting BasicScheduler sigmas 2025-07-29 23:06:01 +03:00
kijai 1570287db1 Update nodes_model_loading.py 2025-07-29 18:10:02 +03:00
kijai 15a57d22f7 fix slightly increased memory use 2025-07-29 18:08:32 +03:00
kijai f835baa3d3 fix riflex 2025-07-29 10:52:39 +03:00
kijai 01e452c0d1 Update wanvideo2_2_I2V_A14B_example_WIP.json 2025-07-29 09:14:45 +03:00
kijai 234cffbf24 Fix comfy org scaled models giving black output 2025-07-29 08:05:48 +03:00
kijai de11d52348 Update wanvideo2_2_I2V_A14B_example_WIP.json 2025-07-29 02:46:01 +03:00
kijai 6875b99611 remove this for now 2025-07-29 02:33:20 +03:00
kijai e4fb931878 Update wanvideo2_2_I2V_A14B_example_WIP.json 2025-07-29 02:33:12 +03:00
kijai 5238f40fe3 Update nodes.py 2025-07-29 02:20:20 +03:00
kijai a49936b645 Create wanvideo2_2_I2V_A14B_example_WIP.json 2025-07-29 02:20:17 +03:00
kijai a3032e4363 clear lora patches first 2025-07-29 01:45:25 +03:00
kijai 7e290c67bf Fix comfy progress bar when not doing full steps 2025-07-28 23:16:06 +03:00
kijai fb7073259f detect 2.2 I2V
untested
2025-07-28 22:43:37 +03:00
kijai 498c6859fe Merge branch 'pr/883' 2025-07-28 22:16:48 +03:00
kijai 08d4569794 Update nodes.py 2025-07-28 21:42:35 +03:00
kijai d6e9af7090 2.2 stuff 2025-07-28 21:38:40 +03:00
kijai 998a69cc0a Update utils.py 2025-07-28 10:46:46 +03:00
kijai 3659c3f6e6 Progress bar for text encoding 2025-07-28 10:00:17 +03:00
kijai ee6e790d80 Update nodes.py 2025-07-28 09:50:50 +03:00
kijai 5e725ff8fb Allow running T5 no cpu
This is actually surprisingly fast, on AMD Ryzen 9 9900X it's faster to not move the T5 to GPU than to keep it on CPU all the way.
2025-07-28 09:39:36 +03:00
Jukka Seppänen 925ec31578 Merge pull request #876 from AustinMroz/main
Fix animated latent preview compatibility
2025-07-27 19:33:11 +03:00
kijai f61aae6158 minimax + context windows 2025-07-27 17:10:41 +03:00
kijai f86d2b84a0 Update nodes.py 2025-07-27 15:34:57 +03:00
kijai 3567202e75 Fix compile and support radial attn in the DF sampler 2025-07-27 14:19:31 +03:00
Jukka Seppänen c0a4e8aa87 Update readme.md 2025-07-27 01:43:32 +03:00
kijai bc68d35e5a Create wanvideo_1_3B_EchoShot_example.json 2025-07-26 19:25:04 +03:00
kijai cb36e1013e Fix 2025-07-26 19:01:58 +03:00
kijai df1476bf42 Support EchoShot
https://github.com/D2I-ai/EchoShot
2025-07-26 18:51:29 +03:00
kijai 9a1ab1c656 only show lora metadata if it actually exists 2025-07-26 14:32:53 +03:00
kijai 5c36a4b111 minor memory tweaks 2025-07-26 14:19:07 +03:00
kijai 3157e0389e Update nodes.py 2025-07-26 11:50:24 +03:00
kijai 34c2cc23a9 Update nodes_model_loading.py 2025-07-25 20:49:41 +03:00
kijai a35eb7dfa4 Basic sageattn3 support
Probably going to need further timestep scheduling as the quality of sage3 on it's own is pretty bad.
2025-07-25 20:48:34 +03:00
kijai 76750eec05 Allow loading aitoolkit/lycoris format 2025-07-25 17:24:43 +03:00
kijai b89cf970e1 Fix GGUF + LoRA + VACE
Always something part two...
2025-07-25 16:44:43 +03:00
kijai 794a38cc7e Further GGUF+LoRA fixes 2025-07-25 00:40:48 +03:00
kijai 73b7444baa remove print 2025-07-24 23:54:30 +03:00
kijai ea36decf07 Fix GGUF + LoRA + torch.compile
Always something...
2025-07-24 23:52:18 +03:00
kijai b3820055d0 Fix GGUF with LoRAs and support GGUF witgh SetLoras -node 2025-07-24 14:59:59 +03:00
kijai 35e637cbfd Allow merging LoRA to fp8 scaled models 2025-07-24 11:51:36 +03:00
kijai d6425cab02 Update nodes_model_loading.py 2025-07-24 00:08:39 +03:00
kijai 59cd0dc272 Update nodes.py 2025-07-23 18:11:15 +03:00
kijai 838803d053 Update nodes_model_loading.py 2025-07-23 17:58:28 +03:00
kijai bdce322e65 remove loras if SetLora bypassed/disconnected 2025-07-23 17:51:59 +03:00
kijai 66226a8a1b why was this ever this way... 2025-07-23 17:17:27 +03:00
kijai 3ed58330d9 better 2025-07-23 16:56:33 +03:00
kijai 65ac9fa6d9 cache positive and negative separately, add cache to single encode node as well 2025-07-23 16:33:11 +03:00
kijai 5e56e3649f fix control lora 2025-07-23 16:20:30 +03:00
kijai 0212ad7a2d cache only the prompts
so we can disconnect T5 completely if text embed exists in cache
2025-07-23 15:33:32 +03:00
kijai 1a1af02912 Allow using different init image for context windows beyond first one
This can be useful with models like MAGREF that behave differently when the init image is padded with white, idea is to use full init for first window and padded image for the rest, so that it works more like reference and doesn't force the window to snap back to the init.
2025-07-23 12:51:57 +03:00
kijai 9d9b188b0b Update fp8_optimization.py 2025-07-23 01:22:42 +03:00
kijai fa93f5b3c1 Add optional prompt disk caching
Caches text embeds to disk with unique hash based on T5 name, dtype and prompts. If found on disk skips encoding, persists after restarts.
2025-07-23 00:52:56 +03:00
kijai 729b6fdf7c support sparse sageattn2 for radial attn
Needs this installed:
https://github.com/Radioheading/Block-Sparse-SageAttention-2.0
2025-07-23 00:27:14 +03:00
kijai 9c45f3a97d Update nodes_model_loading.py 2025-07-23 00:10:14 +03:00
kijai eea896dace Update nodes_model_loading.py 2025-07-22 18:25:03 +03:00
kijai 70fcdff3c5 Update nodes_model_loading.py 2025-07-22 17:36:41 +03:00
kijai bfd6af8141 Update nodes_model_loading.py 2025-07-22 15:41:32 +03:00
kijai 98fa84bb17 Update nodes_model_loading.py 2025-07-22 13:58:43 +03:00
kijai 3988accdf3 Update nodes_model_loading.py 2025-07-21 23:44:24 +03:00
kijai 9911b5e6f0 oops 2025-07-21 22:49:05 +03:00
kijai 91515717d6 bump version 2025-07-21 22:46:50 +03:00
kijai 296baa30ce Add WanVideoSetLoRAs
Node to set the LoRA weights to use with the unmerged LoRA mode, not able to merge LoRAs but allows instant LoRA switching without any loading times. The effect of unmerged LoRAs is stronger and differs from merged LoRAs.
2025-07-21 22:39:17 +03:00
kijai 41d8bd9ec9 fix for context windows 2025-07-21 20:09:53 +03:00
kijai 4bf78e5316 Possibly reduce LoRA loading memory usage 2025-07-21 15:25:07 +03:00
kijai 6ef9224dfe Update model.py 2025-07-21 13:51:33 +03:00
kijai aeac12ed7a Only convert layers that actually have scaled weights... 2025-07-21 01:57:27 +03:00
kijai 29ce253bb6 Support fp8_scaled models and allow running LoRAs unmerged on other models as well 2025-07-21 01:37:30 +03:00
kijai 59add151eb Update attention.py 2025-07-20 16:22:27 +03:00
kijai e5b125cd89 Allow setting any block as dense for Radial attention
Also added WanVideoBlockList helper to to create list of ints that can be inserted to the dense_blocks -input.
2025-07-20 16:21:37 +03:00
kijai 0dba876979 Correct radial attn mask size when using context windows 2025-07-20 13:22:56 +03:00
kijai bb82d63453 Update nodes.py 2025-07-20 13:08:40 +03:00
kijai 768a4b2d90 Fix radial attention cache not resetting on resolution change, add more robust supported dimension check 2025-07-20 12:15:01 +03:00
kijai 9f75b7e051 Fix tiled_vae + endframe 2025-07-20 02:33:24 +03:00
kijai 1f25bba463 Merge branch 'pr/828' 2025-07-20 02:13:26 +03:00
kijai 47978275bb Update nodes.py 2025-07-20 02:13:07 +03:00
kijai edd9b20691 Add res_multistep 2025-07-20 01:41:17 +03:00
kijai 0f6fe96626 Update __init__.py 2025-07-18 23:01:03 +03:00
kijai feddafcea2 Update model.py 2025-07-18 18:52:32 +03:00
kijai 5a305a7f9f include sparse_sage_API code
https://github.com/jt-zhang/Sparse_SageAttention_API
2025-07-18 17:16:43 +03:00