nodes/kijai-ComfyUI-WanVideoWrapper
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
796 Commits 8 Branches 0 Tags
2e9e8c03ea82d74aa0fe8df199f3ba3f4793ee4b
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
kijai 2e9e8c03ea Add trajectory example for Fun 2.2 2025-08-15 10:50:26 +03:00
kijai 03458ee955 Update nodes.py 2025-08-15 10:27:49 +03:00
kijai f51c284354 remove print 2025-08-15 10:18:40 +03:00
kijai f2fd411a7b Add option for manually setting rope offset for Stand-In reference 
Experimental
 2025-08-15 10:18:00 +03:00
kijai ef8c4aba1d Update __init__.py 2025-08-14 20:27:35 +03:00
kijai 5cfc629de5 Update face_utils.py 2025-08-14 20:18:33 +03:00
kijai 5e7c89bd00 Update wan_video_vae.py 2025-08-14 19:01:02 +03:00
kijai 994e6e3afb Create requirements.txt 2025-08-14 19:00:31 +03:00
kijai 0c4426fc2b FantasyPortrait reqs and cleanup 
unsure if I want to add onnx in the requirements at this stage...
 2025-08-14 18:53:08 +03:00
kijai 43447dbaf9 Update utils.py 2025-08-14 16:57:01 +03:00
kijai 2f49c7fcdc Update nodes.py 2025-08-14 16:23:23 +03:00
Jukka Seppänen 7bf10bc800 Merge pull request #1039 from Ordinator0/extract-lora-stem 
correctly extract lora name
 2025-08-14 16:06:33 +03:00
kijai 8d8f388a3c Workaround for Uni3C on latest diffusers 2025-08-14 15:56:58 +03:00
kijai 24683f1dad Squashed commit of the following: 
commit 6a01a8a1d80d36b5b8ac979a36069c8eb0c2f9a7
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Aug 14 15:40:50 2025 +0300

    Update wanvideo_2_1_I2V_FantasyPortrait_example_01.json

commit e3cf4bf5bc13321e6d8f91fcb7ee92210a7adf01
Merge: bbf14ec f3d5f6b
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Aug 14 15:08:53 2025 +0300

    Merge branch 'main' into fantasy_portrait

commit bbf14ec9e9965c1a8582eea02b50913e79a036d0
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Aug 14 02:16:11 2025 +0300

    update

commit 8192f9f4302b3933e48641a8ef313929e3e263aa
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Aug 14 01:46:15 2025 +0300

    progress bar, fix context windows

commit 39fab8ad4d950a974ba49bd177814f30f518b478
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Aug 14 01:29:15 2025 +0300

    Update nodes.py

commit 36f472c0134e6342ab8c2062a7e3f0b0c829003b
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Aug 14 01:14:24 2025 +0300

    Add start/end percent

commit 16f5922c6bc575754412c9b473907377562b956c
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Aug 14 00:58:57 2025 +0300

    init
 2025-08-14 15:41:25 +03:00
kijai f3d5f6b3ab allow stand-in to work with chunked rope 2025-08-14 14:12:06 +03:00
kijai b29756a962 cleanup 2025-08-14 13:35:36 +03:00
kijai 885fc25cb6 Delete wanvideo_480p_I2V_endframe_example_01.json 2025-08-14 13:32:00 +03:00
kijai c9daa36ef7 Update wanvideo_Stand-In_reference_example_01.json 2025-08-14 13:31:53 +03:00
kijai 5691ae5314 Refactor Fun control input 
Allows using reference only
 2025-08-14 13:03:51 +03:00
kijai 64a0c03673 Fix Fun 2.2 reference image input 
Turns out the reference image doesn't work in the initial fp8_scaled models I shared due to the ref_conv layer ending up scaled as well, I've fixed the models and added error indicating the issue when trying to use reference image on such bugged model.

No change in behaviour when using start image instead.
 2025-08-14 11:13:03 +03:00
kijai e1c052ff43 Update attention.py 2025-08-14 00:11:02 +03:00
kijai 8db5521463 Possible bandaid for q k v dtype mismatch 
Still no clue where or why it happens, but clearly is happening for some when using sage with Stand-In
 2025-08-14 00:10:38 +03:00
kijai 54dbcacd57 Fix fun control 2025-08-13 21:20:05 +03:00
kijai 4805b70d3b Fix end_image only for 2.2 I2V 2025-08-13 21:04:08 +03:00
kijai 68e18eabb2 Create wanvideo_Fun2_2_control_camera_example_01.json 2025-08-13 19:33:25 +03:00
kijai db86a1b838 Update nodes.py 2025-08-13 19:26:48 +03:00
kijai 00bcd1ce8b Support Fun 2.2 Control-Camera 
https://huggingface.co/alibaba-pai/Wan2.2-Fun-A14B-Control-Camera

https://huggingface.co/Kijai/WanVideo_comfy_fp8_scaled/upload/main/Fun
 2025-08-13 18:20:00 +03:00
kijai b08f10ffd8 Re-implement Stand-in kv_cache 2025-08-13 11:58:22 +03:00
kijai d596901055 Allow stand-in with VACE 
Don't know how well it can actually work, has some effect
 2025-08-13 10:00:37 +03:00
kijai f933ad0840 Fix stand-in with GGUF 2025-08-13 01:05:22 +03:00
kijai 083237051f I suppose kv_cache isn't actually used for this... 2025-08-13 00:07:14 +03:00
kijai 8319c961c0 Update model.py 2025-08-12 22:10:57 +03:00
kijai 5420c5aad9 Update nodes.py 2025-08-12 22:10:50 +03:00
kijai 987e92cc43 Create wanvideo_Stand-In_reference_example_01.json 2025-08-12 22:10:46 +03:00
kijai a5ae70624d Support Stand-In LoRA 
https://github.com/WeChatCV/Stand-In
 2025-08-12 21:51:38 +03:00
kijai 2c854c53ee version 2025-08-12 21:48:15 +03:00
kijai 06863fe2d2 Allow doing T2V with the I2V encode node when no images are connected and allow using native set latent noise mask -node 
Latent masking still doesn't work properly
 2025-08-12 11:47:33 +03:00
kijai 97da701379 Fix DF sampler 2025-08-11 18:46:46 +03:00
Jukka Seppänen bf84e99dec Merge pull request #1019 from UaRuairc/patch-1 
Fix res_multistep.step to set sigma_next correctly when ending early
 2025-08-11 16:24:38 +03:00
kijai 057ee642f6 Add async prefetch as option for block swapping 
Can speed up block swapping on some systems, added debug option as well so you can see if enabling the option gives you any benefit.
 2025-08-11 16:17:16 +03:00
kijai 7c93aea182 rename fp8 optimization in code for clarity as it does more than that with loras 2025-08-11 14:32:57 +03:00
kijai 341932b58f Fix unmerged lora application on unquantized models 2025-08-11 01:34:25 +03:00
kijai d6270ace0a Merge branch 'pr/1013' 2025-08-10 21:35:41 +03:00
kijai abd350bbf4 Actually catch interrupt to free memory 2025-08-10 21:07:13 +03:00
kijai 7e474b6b16 Fix pusa extension 2025-08-10 01:34:16 +03:00
kijai 53e740a1e6 Update nodes.py 2025-08-09 16:24:30 +03:00
kijai 8185e9b3cb Better fp8 linear layer patching with torch.compile 2025-08-09 16:18:33 +03:00
kijai cf8e403f88 Fix gguf 2025-08-09 13:28:20 +03:00
kijai 0da602f8e9 silence the img key error spam when using 2.1 I2V loras on 2.2 or T2V 2025-08-09 12:17:55 +03:00
kijai 99c946ae43 Fix lora not always working with compile 2025-08-09 11:20:30 +03:00
kijai f0e81d01c9 prints 2025-08-09 10:52:27 +03:00
kijai b57e245beb Update wanvideo_Fun_2_2_control_example_01.json 2025-08-09 10:49:52 +03:00
kijai ceedc9e493 Update nodes_model_loading.py 2025-08-09 10:49:42 +03:00
kijai 48fa904ad8 fp8 matmul for scaled models 
Fp8 matmul (fp8_fast) doesn't seem feasible with unmerged LoRAs as you'd need to first upcast, then apply LoRA, then downcast back to fp8 and that is too slow. Direct adding in fp8 is also not possible since that's just not something fp8 dtypes support.
 2025-08-09 10:17:11 +03:00
kijai 1757847e5f bump version 2025-08-09 10:13:05 +03:00
kijai a64d8bb0df Fix fun control 2.2 timestep scheduling 2025-08-08 17:03:01 +03:00
kijai f82d47273c Update wanvideo_Fun_2_2_control_example_01.json 2025-08-08 16:26:26 +03:00
kijai 9be0eb133c Fix lora scheduling in multilora loader 2025-08-08 13:47:08 +03:00
kijai db93edb665 Create wanvideo_Fun_2_2_control_example_01.json 2025-08-08 13:42:07 +03:00
kijai e1acc2c4e7 Support Fun 2.2 2025-08-08 11:49:04 +03:00
kijai d446e97309 Experimental RAAG (Ratio Aware Adaptive Guidance) implementation 
https://arxiv.org/abs/2508.03442

Available in experimental_args, alpha > 0 = enabled, default value is 1.0
 2025-08-08 00:17:32 +03:00
kijai ab06ac2f64 Closer to original EchoShot implementation, bugfixes 
Turns out I never had the right way of using EchoShot and was always just accidentally using my existing rope splitting... which just worked with the EchoShot weights, this commit adds proper EchoShot and it's used when their prompt format is used, the previous behaviour can be restored by using my splitting method with " | " between the prompts. EchoShot example has been updated to reflect that.
 2025-08-07 12:08:42 +03:00
kijai 6191451e2c support qwen 2.5 7b 2025-08-06 21:02:39 +03:00
kijai 2a21c4f6ae VAE cleanup and adjustments, add node to allow using native VAE 2025-08-06 17:28:50 +03:00
kijai 69dd4689bf Make prompt extender use sampling and add seed option 2025-08-05 21:17:11 +03:00
kijai 92eac2a9e1 typo 2025-08-05 18:25:42 +03:00
kijai 9129c8cc1d Revert dimension check until I learn how to math 2025-08-05 14:26:45 +03:00
kijai bacb2a2053 Update nodes_model_loading.py 2025-08-05 01:44:42 +03:00
kijai 8e71286b6d Allow torch.compile VAE decoder 
Slight speedup especially for 5B...
 2025-08-05 01:31:31 +03:00
kijai 0e9b1973b0 Add error indicating incompatible input size 
More relevant now with 5B VAE requiring things to be divisible by 32
 2025-08-05 00:35:52 +03:00
kijai 6ec463288f Fix LoRA scheduling with multiple LoRAs 2025-08-04 23:47:02 +03:00
kijai 1b73c10ed5 Update nodes.py 2025-08-04 23:18:50 +03:00
kijai fc7f504e85 Fix empty latents bug from previous commit 2025-08-04 23:16:25 +03:00
kijai fe7e124329 More 5B features 2025-08-04 21:27:36 +03:00
kijai 78a7e20838 Fix lora schedule with multilora node 2025-08-04 16:51:53 +03:00
kijai 7862749cfe Fix single text encode 2025-08-04 01:25:06 +03:00
kijai 267e86704b Update gguf.py 2025-08-04 00:49:53 +03:00
kijai 7a00a875e7 LoRA scheduling on GGUFs too 2025-08-04 00:49:29 +03:00
kijai 3552478d02 Update nodes_model_loading.py 2025-08-04 00:04:21 +03:00
kijai 801f543a7a Allow LoRA timestep scheduling 
LoRA strength can now be a list of floats that represents the strength at any given step
 2025-08-04 00:02:19 +03:00
kijai 88b5feb1ed Fix VRAM management (again) 2025-08-03 22:35:24 +03:00
Jukka Seppänen 1654741cdf Merge pull request #955 from SD-inst/error_propagation 
Propagate errors to frontend
 2025-08-03 22:03:30 +03:00
kijai 5cde6f2216 Fix T5 double RAM use 2025-08-03 12:28:25 +03:00
kijai 26c1911e41 Allow loading 5B controlnet 
inference doesn't work yet
 2025-08-03 12:17:10 +03:00
kijai 309a93c221 Update nodes_model_loading.py 2025-08-02 21:13:29 +03:00
kijai c93e69fb9a Merge branch 'main' of https://github.com/kijai/ComfyUI-WanVideoWrapper 2025-08-02 19:53:26 +03:00
kijai b5199ec7e0 Fix control lora 2025-08-02 19:53:20 +03:00
Jukka Seppänen 158b62dafa Merge pull request #952 from SD-inst/tdqm-fix 
Reduce tdqm spam
 2025-08-02 19:46:40 +03:00
kijai e9b537f23c Update nodes.py 2025-08-02 19:35:02 +03:00
kijai 7074688ced Add prompt extension with local Qwen 2025-08-02 19:27:26 +03:00
kijai ce4ac89659 Add shift to DummyComfyWanModelObject 2025-08-02 10:40:42 +03:00
kijai 8035353cc0 Update pyproject.toml 2025-08-02 02:09:54 +03:00
kijai 99d012230f Catch missing taew2_1.safetensors better 2025-08-02 02:09:42 +03:00
kijai a9925496d5 update some workflows 2025-08-02 02:03:01 +03:00
kijai 907d1b0b0f 5B + context windows 2025-08-02 00:34:10 +03:00
kijai 25fe9ea642 handle cancellation better 2025-08-01 21:57:08 +03:00
kijai 168f3ccbee Update nodes.py 2025-08-01 21:24:35 +03:00
kijai d9be7b9c26 Allow other schedulers for 5B 2025-08-01 21:21:55 +03:00
kijai e05864e751 Update nodes.py 2025-08-01 18:31:40 +03:00
kijai 83bb0e7f35 fp8 text encoder fixes 2025-08-01 17:42:32 +03:00