nodes/kijai-ComfyUI-WanVideoWrapper
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
778 Commits 8 Branches 0 Tags
c9daa36ef7dcd8fc6def791e800e6d9a9be1b623
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
kijai c9daa36ef7 Update wanvideo_Stand-In_reference_example_01.json 2025-08-14 13:31:53 +03:00
kijai 5691ae5314 Refactor Fun control input 
Allows using reference only
 2025-08-14 13:03:51 +03:00
kijai 64a0c03673 Fix Fun 2.2 reference image input 
Turns out the reference image doesn't work in the initial fp8_scaled models I shared due to the ref_conv layer ending up scaled as well, I've fixed the models and added error indicating the issue when trying to use reference image on such bugged model.

No change in behaviour when using start image instead.
 2025-08-14 11:13:03 +03:00
kijai e1c052ff43 Update attention.py 2025-08-14 00:11:02 +03:00
kijai 8db5521463 Possible bandaid for q k v dtype mismatch 
Still no clue where or why it happens, but clearly is happening for some when using sage with Stand-In
 2025-08-14 00:10:38 +03:00
kijai 54dbcacd57 Fix fun control 2025-08-13 21:20:05 +03:00
kijai 4805b70d3b Fix end_image only for 2.2 I2V 2025-08-13 21:04:08 +03:00
kijai 68e18eabb2 Create wanvideo_Fun2_2_control_camera_example_01.json 2025-08-13 19:33:25 +03:00
kijai db86a1b838 Update nodes.py 2025-08-13 19:26:48 +03:00
kijai 00bcd1ce8b Support Fun 2.2 Control-Camera 
https://huggingface.co/alibaba-pai/Wan2.2-Fun-A14B-Control-Camera

https://huggingface.co/Kijai/WanVideo_comfy_fp8_scaled/upload/main/Fun
 2025-08-13 18:20:00 +03:00
kijai b08f10ffd8 Re-implement Stand-in kv_cache 2025-08-13 11:58:22 +03:00
kijai d596901055 Allow stand-in with VACE 
Don't know how well it can actually work, has some effect
 2025-08-13 10:00:37 +03:00
kijai f933ad0840 Fix stand-in with GGUF 2025-08-13 01:05:22 +03:00
kijai 083237051f I suppose kv_cache isn't actually used for this... 2025-08-13 00:07:14 +03:00
kijai 8319c961c0 Update model.py 2025-08-12 22:10:57 +03:00
kijai 5420c5aad9 Update nodes.py 2025-08-12 22:10:50 +03:00
kijai 987e92cc43 Create wanvideo_Stand-In_reference_example_01.json 2025-08-12 22:10:46 +03:00
kijai a5ae70624d Support Stand-In LoRA 
https://github.com/WeChatCV/Stand-In
 2025-08-12 21:51:38 +03:00
kijai 2c854c53ee version 2025-08-12 21:48:15 +03:00
kijai 06863fe2d2 Allow doing T2V with the I2V encode node when no images are connected and allow using native set latent noise mask -node 
Latent masking still doesn't work properly
 2025-08-12 11:47:33 +03:00
kijai 97da701379 Fix DF sampler 2025-08-11 18:46:46 +03:00
Jukka Seppänen bf84e99dec Merge pull request #1019 from UaRuairc/patch-1 
Fix res_multistep.step to set sigma_next correctly when ending early
 2025-08-11 16:24:38 +03:00
kijai 057ee642f6 Add async prefetch as option for block swapping 
Can speed up block swapping on some systems, added debug option as well so you can see if enabling the option gives you any benefit.
 2025-08-11 16:17:16 +03:00
kijai 7c93aea182 rename fp8 optimization in code for clarity as it does more than that with loras 2025-08-11 14:32:57 +03:00
kijai 341932b58f Fix unmerged lora application on unquantized models 2025-08-11 01:34:25 +03:00
kijai d6270ace0a Merge branch 'pr/1013' 2025-08-10 21:35:41 +03:00
kijai abd350bbf4 Actually catch interrupt to free memory 2025-08-10 21:07:13 +03:00
kijai 7e474b6b16 Fix pusa extension 2025-08-10 01:34:16 +03:00
kijai 53e740a1e6 Update nodes.py 2025-08-09 16:24:30 +03:00
kijai 8185e9b3cb Better fp8 linear layer patching with torch.compile 2025-08-09 16:18:33 +03:00
kijai cf8e403f88 Fix gguf 2025-08-09 13:28:20 +03:00
kijai 0da602f8e9 silence the img key error spam when using 2.1 I2V loras on 2.2 or T2V 2025-08-09 12:17:55 +03:00
kijai 99c946ae43 Fix lora not always working with compile 2025-08-09 11:20:30 +03:00
kijai f0e81d01c9 prints 2025-08-09 10:52:27 +03:00
kijai b57e245beb Update wanvideo_Fun_2_2_control_example_01.json 2025-08-09 10:49:52 +03:00
kijai ceedc9e493 Update nodes_model_loading.py 2025-08-09 10:49:42 +03:00
kijai 48fa904ad8 fp8 matmul for scaled models 
Fp8 matmul (fp8_fast) doesn't seem feasible with unmerged LoRAs as you'd need to first upcast, then apply LoRA, then downcast back to fp8 and that is too slow. Direct adding in fp8 is also not possible since that's just not something fp8 dtypes support.
 2025-08-09 10:17:11 +03:00
kijai 1757847e5f bump version 2025-08-09 10:13:05 +03:00
kijai a64d8bb0df Fix fun control 2.2 timestep scheduling 2025-08-08 17:03:01 +03:00
kijai f82d47273c Update wanvideo_Fun_2_2_control_example_01.json 2025-08-08 16:26:26 +03:00
kijai 9be0eb133c Fix lora scheduling in multilora loader 2025-08-08 13:47:08 +03:00
kijai db93edb665 Create wanvideo_Fun_2_2_control_example_01.json 2025-08-08 13:42:07 +03:00
kijai e1acc2c4e7 Support Fun 2.2 2025-08-08 11:49:04 +03:00
kijai d446e97309 Experimental RAAG (Ratio Aware Adaptive Guidance) implementation 
https://arxiv.org/abs/2508.03442

Available in experimental_args, alpha > 0 = enabled, default value is 1.0
 2025-08-08 00:17:32 +03:00
kijai ab06ac2f64 Closer to original EchoShot implementation, bugfixes 
Turns out I never had the right way of using EchoShot and was always just accidentally using my existing rope splitting... which just worked with the EchoShot weights, this commit adds proper EchoShot and it's used when their prompt format is used, the previous behaviour can be restored by using my splitting method with " | " between the prompts. EchoShot example has been updated to reflect that.
 2025-08-07 12:08:42 +03:00
kijai 6191451e2c support qwen 2.5 7b 2025-08-06 21:02:39 +03:00
kijai 2a21c4f6ae VAE cleanup and adjustments, add node to allow using native VAE 2025-08-06 17:28:50 +03:00
kijai 69dd4689bf Make prompt extender use sampling and add seed option 2025-08-05 21:17:11 +03:00
kijai 92eac2a9e1 typo 2025-08-05 18:25:42 +03:00
kijai 9129c8cc1d Revert dimension check until I learn how to math 2025-08-05 14:26:45 +03:00
kijai bacb2a2053 Update nodes_model_loading.py 2025-08-05 01:44:42 +03:00
kijai 8e71286b6d Allow torch.compile VAE decoder 
Slight speedup especially for 5B...
 2025-08-05 01:31:31 +03:00
kijai 0e9b1973b0 Add error indicating incompatible input size 
More relevant now with 5B VAE requiring things to be divisible by 32
 2025-08-05 00:35:52 +03:00
kijai 6ec463288f Fix LoRA scheduling with multiple LoRAs 2025-08-04 23:47:02 +03:00
kijai 1b73c10ed5 Update nodes.py 2025-08-04 23:18:50 +03:00
kijai fc7f504e85 Fix empty latents bug from previous commit 2025-08-04 23:16:25 +03:00
kijai fe7e124329 More 5B features 2025-08-04 21:27:36 +03:00
kijai 78a7e20838 Fix lora schedule with multilora node 2025-08-04 16:51:53 +03:00
kijai 7862749cfe Fix single text encode 2025-08-04 01:25:06 +03:00
kijai 267e86704b Update gguf.py 2025-08-04 00:49:53 +03:00
kijai 7a00a875e7 LoRA scheduling on GGUFs too 2025-08-04 00:49:29 +03:00
kijai 3552478d02 Update nodes_model_loading.py 2025-08-04 00:04:21 +03:00
kijai 801f543a7a Allow LoRA timestep scheduling 
LoRA strength can now be a list of floats that represents the strength at any given step
 2025-08-04 00:02:19 +03:00
kijai 88b5feb1ed Fix VRAM management (again) 2025-08-03 22:35:24 +03:00
Jukka Seppänen 1654741cdf Merge pull request #955 from SD-inst/error_propagation 
Propagate errors to frontend
 2025-08-03 22:03:30 +03:00
kijai 5cde6f2216 Fix T5 double RAM use 2025-08-03 12:28:25 +03:00
kijai 26c1911e41 Allow loading 5B controlnet 
inference doesn't work yet
 2025-08-03 12:17:10 +03:00
kijai 309a93c221 Update nodes_model_loading.py 2025-08-02 21:13:29 +03:00
kijai c93e69fb9a Merge branch 'main' of https://github.com/kijai/ComfyUI-WanVideoWrapper 2025-08-02 19:53:26 +03:00
kijai b5199ec7e0 Fix control lora 2025-08-02 19:53:20 +03:00
Jukka Seppänen 158b62dafa Merge pull request #952 from SD-inst/tdqm-fix 
Reduce tdqm spam
 2025-08-02 19:46:40 +03:00
kijai e9b537f23c Update nodes.py 2025-08-02 19:35:02 +03:00
kijai 7074688ced Add prompt extension with local Qwen 2025-08-02 19:27:26 +03:00
kijai ce4ac89659 Add shift to DummyComfyWanModelObject 2025-08-02 10:40:42 +03:00
kijai 8035353cc0 Update pyproject.toml 2025-08-02 02:09:54 +03:00
kijai 99d012230f Catch missing taew2_1.safetensors better 2025-08-02 02:09:42 +03:00
kijai a9925496d5 update some workflows 2025-08-02 02:03:01 +03:00
kijai 907d1b0b0f 5B + context windows 2025-08-02 00:34:10 +03:00
kijai 25fe9ea642 handle cancellation better 2025-08-01 21:57:08 +03:00
kijai 168f3ccbee Update nodes.py 2025-08-01 21:24:35 +03:00
kijai d9be7b9c26 Allow other schedulers for 5B 2025-08-01 21:21:55 +03:00
kijai e05864e751 Update nodes.py 2025-08-01 18:31:40 +03:00
kijai 83bb0e7f35 fp8 text encoder fixes 2025-08-01 17:42:32 +03:00
kijai 8321e19009 Fix single text encoder after previous change 2025-08-01 14:45:29 +03:00
kijai 5406a72f62 Improve text encoder cache and add alternative node which leaves nothing to memory after encoding 
WanVideoTextEncodeCached -node will load T5 when the prompt is not found in the cache, then unload it completely.
 2025-08-01 12:36:19 +03:00
kijai 9edab74562 Default non_blocking to False 
too many RAM issues
 2025-08-01 02:29:07 +03:00
kijai 7eebde487f typo 2025-08-01 00:54:54 +03:00
kijai 945700d56e 5B fixes 2025-07-31 22:41:56 +03:00
kijai 5bacc50088 Add safety check for context windows to avoid crash on tensor slicing 2025-07-31 17:09:05 +03:00
kijai b60814fb6b Fix split prompting, get rid of diffusers on model class 2025-07-31 15:11:47 +03:00
kijai 10b67de349 Fix loading TAEW from extra paths 2025-07-31 13:47:59 +03:00
kijai 4cf2ffc979 Merge branch 'main' of https://github.com/kijai/ComfyUI-WanVideoWrapper 2025-07-31 12:50:17 +03:00
kijai ef23a6213d return denoised samples as well for previewing unfinished latents 2025-07-31 12:50:10 +03:00
Jukka Seppänen ee1e762a7f Update readme.md 2025-07-31 12:37:16 +03:00
kijai 0cc4583653 flowedit fix 2025-07-31 12:21:40 +03:00
kijai e545b18627 vid2vid fix 
Need to use add_noise_to_samples = True now for vid2vid, defaulting to False to not break 2.2 dual sampler workflows, but hardcode to always be True if denoise is used to not break old workflows
 2025-07-30 19:41:51 +03:00
kijai 4eabdcce78 wrong way around 2025-07-30 18:45:19 +03:00
kijai 138b377d1d Fix loading fp8 models where everything is fp8... 2025-07-30 17:34:56 +03:00
kijai 9a5d752ba1 Support custom sigmas on more schedulers 2025-07-30 16:20:48 +03:00
kijai ec066008a8 Make start/end step work with vid2vid 2025-07-30 15:59:22 +03:00