nodes/kijai-ComfyUI-WanVideoWrapper
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
830 Commits 8 Branches 0 Tags
5375a01fb6dae02db244b8848087e87fbd69f44a
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
kijai 5375a01fb6 Add error 2025-08-19 20:30:59 +03:00
kijai 04a99fd4e2 Add tooltips 2025-08-19 20:19:01 +03:00
kijai cae24fc7e0 uni3c adjustment 2025-08-19 20:02:24 +03:00
kijai b6d4c172f0 Allow using GGUF Multi/InfiniteTalk models 2025-08-19 17:48:58 +03:00
kijai 345c286c86 Update utils.py 2025-08-19 16:55:51 +03:00
kijai eec70ff3fb Fix multitalk progress bar 2025-08-19 14:50:31 +03:00
kijai 4f9ef5b7a9 Update nodes.py 2025-08-19 13:34:56 +03:00
kijai 5a8f8730bd Fix for using additional scaled model and merging loras 2025-08-19 13:31:56 +03:00
kijai 3cd6a930c3 Update nodes.py 2025-08-19 11:10:16 +03:00
kijai e0eee40bde Add InfiniteTalk loop method 2025-08-19 10:45:42 +03:00
kijai 427e7be6c2 fix multitalk 2025-08-17 18:24:48 +03:00
kijai 1d7e0848e0 Allow Phantom to work with MultiTalk 2025-08-17 16:46:50 +03:00
kijai 689797bdb7 fix 2025-08-17 15:02:45 +03:00
kijai b748ed8bdd Squashed commit of the following: 
commit f06ce25f6c50174b0e7b12c3517827a6650f33fa
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sun Aug 17 13:10:02 2025 +0300

    redundant

commit 9957f765e48f68b21713c33db334231207107b01
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sun Aug 17 12:57:12 2025 +0300

    Update nodes.py

commit 9797f15ed1e5a9b9b93f777e92cd82ed584c2b57
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sun Aug 17 12:35:46 2025 +0300

    Remove the "FM" scheduler

    This is just dpm++

commit 244fc2b125253a4c7b6e91ca8dd0b4dc8564c2f0
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sun Aug 17 02:05:26 2025 +0300

    just use default rope I guess...

commit 5c3a60d3b189864f8f2f0977a552499b202326ba
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sun Aug 17 01:35:49 2025 +0300

    Update nodes.py

commit ee47ed17c086f8468fd5a256318274c0077f6dfc
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sun Aug 17 01:35:36 2025 +0300

    Update model.py

commit 8a17ee7d41ae5789b8d7ed01eb8b48c0c3b52ce7
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sat Aug 16 23:20:10 2025 +0300

    init
 2025-08-17 13:51:23 +03:00
kijai 4b4a3b4f8f Update nodes.py 2025-08-17 10:55:06 +03:00
kijai d6ac1842fa remove print 2025-08-17 01:41:49 +03:00
kijai e5b0b53265 Update wanvideo_2_1_I2V_FantasyPortrait_example_01.json 2025-08-16 15:46:10 +03:00
kijai e3ef4dd27b bump version 2025-08-16 12:57:32 +03:00
kijai 8bf010a835 onnx device selector 2025-08-16 00:11:11 +03:00
kijai 0ced709f1b Fix multitalk scheduler 
Don't know if it's of any relevance, but working again
 2025-08-15 18:06:45 +03:00
kijai 9659589d67 Update nodes.py 2025-08-15 17:59:09 +03:00
kijai b60ab34db6 Update nodes_model_loading.py 2025-08-15 15:08:43 +03:00
kijai 9f3a5962e6 Update nodes_model_loading.py 2025-08-15 14:56:09 +03:00
kijai 2df76f3363 Update nodes_model_loading.py 2025-08-15 14:45:53 +03:00
kijai 0beb5a8911 Update nodes.py 2025-08-15 13:47:46 +03:00
kijai c05109ff82 expose adapter projection scaling for FantasyPortrait 
Not sure how useful but seemingly can at least separate the effect on mouth and rest of the head
 2025-08-15 13:45:41 +03:00
kijai 3de816004d Update readme.md 2025-08-15 13:34:53 +03:00
kijai 8d487f99b4 Add face det code license 2025-08-15 13:34:01 +03:00
kijai 7d2c0b58e2 Update wanvideo_2_1_I2V_FantasyPortrait_example_01.json 2025-08-15 13:17:44 +03:00
kijai d6da0f17bb Add landmark visualization 2025-08-15 13:08:45 +03:00
kijai 656f5b1132 Update nodes.py 2025-08-15 12:45:37 +03:00
kijai 8c4f2bb95e Update pdf.py 2025-08-15 12:31:50 +03:00
kijai d6bee68845 Update multitalk.py 2025-08-15 12:24:37 +03:00
kijai 4641665393 Update nodes.py 2025-08-15 12:24:33 +03:00
kijai 2e9e8c03ea Add trajectory example for Fun 2.2 2025-08-15 10:50:26 +03:00
kijai 03458ee955 Update nodes.py 2025-08-15 10:27:49 +03:00
kijai f51c284354 remove print 2025-08-15 10:18:40 +03:00
kijai f2fd411a7b Add option for manually setting rope offset for Stand-In reference 
Experimental
 2025-08-15 10:18:00 +03:00
kijai ef8c4aba1d Update __init__.py 2025-08-14 20:27:35 +03:00
kijai 5cfc629de5 Update face_utils.py 2025-08-14 20:18:33 +03:00
kijai 5e7c89bd00 Update wan_video_vae.py 2025-08-14 19:01:02 +03:00
kijai 994e6e3afb Create requirements.txt 2025-08-14 19:00:31 +03:00
kijai 0c4426fc2b FantasyPortrait reqs and cleanup 
unsure if I want to add onnx in the requirements at this stage...
 2025-08-14 18:53:08 +03:00
kijai 43447dbaf9 Update utils.py 2025-08-14 16:57:01 +03:00
kijai 2f49c7fcdc Update nodes.py 2025-08-14 16:23:23 +03:00
Jukka Seppänen 7bf10bc800 Merge pull request #1039 from Ordinator0/extract-lora-stem 
correctly extract lora name
 2025-08-14 16:06:33 +03:00
kijai 8d8f388a3c Workaround for Uni3C on latest diffusers 2025-08-14 15:56:58 +03:00
kijai 24683f1dad Squashed commit of the following: 
commit 6a01a8a1d80d36b5b8ac979a36069c8eb0c2f9a7
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Aug 14 15:40:50 2025 +0300

    Update wanvideo_2_1_I2V_FantasyPortrait_example_01.json

commit e3cf4bf5bc13321e6d8f91fcb7ee92210a7adf01
Merge: bbf14ec f3d5f6b
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Aug 14 15:08:53 2025 +0300

    Merge branch 'main' into fantasy_portrait

commit bbf14ec9e9965c1a8582eea02b50913e79a036d0
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Aug 14 02:16:11 2025 +0300

    update

commit 8192f9f4302b3933e48641a8ef313929e3e263aa
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Aug 14 01:46:15 2025 +0300

    progress bar, fix context windows

commit 39fab8ad4d950a974ba49bd177814f30f518b478
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Aug 14 01:29:15 2025 +0300

    Update nodes.py

commit 36f472c0134e6342ab8c2062a7e3f0b0c829003b
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Aug 14 01:14:24 2025 +0300

    Add start/end percent

commit 16f5922c6bc575754412c9b473907377562b956c
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Aug 14 00:58:57 2025 +0300

    init
 2025-08-14 15:41:25 +03:00
kijai f3d5f6b3ab allow stand-in to work with chunked rope 2025-08-14 14:12:06 +03:00
kijai b29756a962 cleanup 2025-08-14 13:35:36 +03:00
kijai 885fc25cb6 Delete wanvideo_480p_I2V_endframe_example_01.json 2025-08-14 13:32:00 +03:00
kijai c9daa36ef7 Update wanvideo_Stand-In_reference_example_01.json 2025-08-14 13:31:53 +03:00
kijai 5691ae5314 Refactor Fun control input 
Allows using reference only
 2025-08-14 13:03:51 +03:00
kijai 64a0c03673 Fix Fun 2.2 reference image input 
Turns out the reference image doesn't work in the initial fp8_scaled models I shared due to the ref_conv layer ending up scaled as well, I've fixed the models and added error indicating the issue when trying to use reference image on such bugged model.

No change in behaviour when using start image instead.
 2025-08-14 11:13:03 +03:00
kijai e1c052ff43 Update attention.py 2025-08-14 00:11:02 +03:00
kijai 8db5521463 Possible bandaid for q k v dtype mismatch 
Still no clue where or why it happens, but clearly is happening for some when using sage with Stand-In
 2025-08-14 00:10:38 +03:00
kijai 54dbcacd57 Fix fun control 2025-08-13 21:20:05 +03:00
kijai 4805b70d3b Fix end_image only for 2.2 I2V 2025-08-13 21:04:08 +03:00
kijai 68e18eabb2 Create wanvideo_Fun2_2_control_camera_example_01.json 2025-08-13 19:33:25 +03:00
kijai db86a1b838 Update nodes.py 2025-08-13 19:26:48 +03:00
kijai 00bcd1ce8b Support Fun 2.2 Control-Camera 
https://huggingface.co/alibaba-pai/Wan2.2-Fun-A14B-Control-Camera

https://huggingface.co/Kijai/WanVideo_comfy_fp8_scaled/upload/main/Fun
 2025-08-13 18:20:00 +03:00
kijai b08f10ffd8 Re-implement Stand-in kv_cache 2025-08-13 11:58:22 +03:00
kijai d596901055 Allow stand-in with VACE 
Don't know how well it can actually work, has some effect
 2025-08-13 10:00:37 +03:00
kijai f933ad0840 Fix stand-in with GGUF 2025-08-13 01:05:22 +03:00
kijai 083237051f I suppose kv_cache isn't actually used for this... 2025-08-13 00:07:14 +03:00
kijai 8319c961c0 Update model.py 2025-08-12 22:10:57 +03:00
kijai 5420c5aad9 Update nodes.py 2025-08-12 22:10:50 +03:00
kijai 987e92cc43 Create wanvideo_Stand-In_reference_example_01.json 2025-08-12 22:10:46 +03:00
kijai a5ae70624d Support Stand-In LoRA 
https://github.com/WeChatCV/Stand-In
 2025-08-12 21:51:38 +03:00
kijai 2c854c53ee version 2025-08-12 21:48:15 +03:00
kijai 06863fe2d2 Allow doing T2V with the I2V encode node when no images are connected and allow using native set latent noise mask -node 
Latent masking still doesn't work properly
 2025-08-12 11:47:33 +03:00
kijai 97da701379 Fix DF sampler 2025-08-11 18:46:46 +03:00
Jukka Seppänen bf84e99dec Merge pull request #1019 from UaRuairc/patch-1 
Fix res_multistep.step to set sigma_next correctly when ending early
 2025-08-11 16:24:38 +03:00
kijai 057ee642f6 Add async prefetch as option for block swapping 
Can speed up block swapping on some systems, added debug option as well so you can see if enabling the option gives you any benefit.
 2025-08-11 16:17:16 +03:00
kijai 7c93aea182 rename fp8 optimization in code for clarity as it does more than that with loras 2025-08-11 14:32:57 +03:00
kijai 341932b58f Fix unmerged lora application on unquantized models 2025-08-11 01:34:25 +03:00
kijai d6270ace0a Merge branch 'pr/1013' 2025-08-10 21:35:41 +03:00
kijai abd350bbf4 Actually catch interrupt to free memory 2025-08-10 21:07:13 +03:00
kijai 7e474b6b16 Fix pusa extension 2025-08-10 01:34:16 +03:00
kijai 53e740a1e6 Update nodes.py 2025-08-09 16:24:30 +03:00
kijai 8185e9b3cb Better fp8 linear layer patching with torch.compile 2025-08-09 16:18:33 +03:00
kijai cf8e403f88 Fix gguf 2025-08-09 13:28:20 +03:00
kijai 0da602f8e9 silence the img key error spam when using 2.1 I2V loras on 2.2 or T2V 2025-08-09 12:17:55 +03:00
kijai 99c946ae43 Fix lora not always working with compile 2025-08-09 11:20:30 +03:00
kijai f0e81d01c9 prints 2025-08-09 10:52:27 +03:00
kijai b57e245beb Update wanvideo_Fun_2_2_control_example_01.json 2025-08-09 10:49:52 +03:00
kijai ceedc9e493 Update nodes_model_loading.py 2025-08-09 10:49:42 +03:00
kijai 48fa904ad8 fp8 matmul for scaled models 
Fp8 matmul (fp8_fast) doesn't seem feasible with unmerged LoRAs as you'd need to first upcast, then apply LoRA, then downcast back to fp8 and that is too slow. Direct adding in fp8 is also not possible since that's just not something fp8 dtypes support.
 2025-08-09 10:17:11 +03:00
kijai 1757847e5f bump version 2025-08-09 10:13:05 +03:00
kijai a64d8bb0df Fix fun control 2.2 timestep scheduling 2025-08-08 17:03:01 +03:00
kijai f82d47273c Update wanvideo_Fun_2_2_control_example_01.json 2025-08-08 16:26:26 +03:00
kijai 9be0eb133c Fix lora scheduling in multilora loader 2025-08-08 13:47:08 +03:00
kijai db93edb665 Create wanvideo_Fun_2_2_control_example_01.json 2025-08-08 13:42:07 +03:00
kijai e1acc2c4e7 Support Fun 2.2 2025-08-08 11:49:04 +03:00
kijai d446e97309 Experimental RAAG (Ratio Aware Adaptive Guidance) implementation 
https://arxiv.org/abs/2508.03442

Available in experimental_args, alpha > 0 = enabled, default value is 1.0
 2025-08-08 00:17:32 +03:00
kijai ab06ac2f64 Closer to original EchoShot implementation, bugfixes 
Turns out I never had the right way of using EchoShot and was always just accidentally using my existing rope splitting... which just worked with the EchoShot weights, this commit adds proper EchoShot and it's used when their prompt format is used, the previous behaviour can be restored by using my splitting method with " | " between the prompts. EchoShot example has been updated to reflect that.
 2025-08-07 12:08:42 +03:00
kijai 6191451e2c support qwen 2.5 7b 2025-08-06 21:02:39 +03:00
kijai 2a21c4f6ae VAE cleanup and adjustments, add node to allow using native VAE 2025-08-06 17:28:50 +03:00
kijai 69dd4689bf Make prompt extender use sampling and add seed option 2025-08-05 21:17:11 +03:00
kijai 92eac2a9e1 typo 2025-08-05 18:25:42 +03:00