Commit Graph
100 Commits
Author SHA1 Message Date
kijai 61aa0e2ffd Drastically reduce VRAM usage on I2V encode node. 2025-08-24 11:39:56 +03:00
kijai 8a151b5402 Multi/InfiniteTalk sampling loop cleanup and optimizations, support FantasyPortrait within the loop 2025-08-24 11:39:18 +03:00
Jukka Seppänen 54f745bb63 Update nodes.py 2025-08-24 02:03:32 +03:00
kijai d39155213e This can be float for compatibility 2025-08-24 01:06:53 +03:00
kijai 9076a3aae8 bump version 2025-08-23 20:57:41 +03:00
kijai b7d7f9afe5 cleanup unianimate stuff 2025-08-23 18:59:21 +03:00
kijai 77d79f6878 This is redundant 2025-08-23 17:55:12 +03:00
kijai 9a2a13498a Cleanup MultiTalk model code 2025-08-23 17:49:04 +03:00
kijai 73cff6ebab Cleanup Multi/InfiniteTalk sampling loop some 2025-08-23 16:27:10 +03:00
kijai 5f521dc169 Add generic CreateScheduleFloatList to assist with LoRA scheduling 2025-08-23 13:04:19 +03:00
kijai 4eeaf1ea19 Update nodes.py 2025-08-23 01:06:57 +03:00
kijai d0b9f2c907 Allow UniAnimate to work with unmerged LoRAs 2025-08-23 01:06:22 +03:00
kijai 948fdd369d cleanup 2025-08-23 01:05:41 +03:00
kijai b1ceaaeb2e Support Wan22 VAE in WanVideoLatentReScale 2025-08-22 15:04:29 +03:00
kijai bb5503c9bb remove prints 2025-08-22 12:57:57 +03:00
kijai ff1fe75919 RoPE ntk scaling 2025-08-22 12:48:12 +03:00
kijai 49951a85b6 Update nodes.py 2025-08-22 01:51:16 +03:00
kijai bfee623d77 Pass original image to 2nd sampler for 2.2 diff diff 2025-08-22 01:48:35 +03:00
kijai c2923068e6 Differential diffusion for Multi/InfiniteTalk long I2V as well 2025-08-22 01:24:16 +03:00
kijai 644f9aeaa3 Fix in multitalk sampling 2025-08-21 22:14:37 +03:00
kijai bd0a634ec0 Update nodes.py 2025-08-21 18:26:06 +03:00
kijai bd5f76a3c8 Fix differential diffusion, VACE tweaks 2025-08-21 12:26:29 +03:00
kijai bcdd6dc664 Support loading VACE GGUF modules 2025-08-21 02:36:52 +03:00
kijai fd6404bb2f Update nodes.py 2025-08-21 01:45:31 +03:00
kijai 8bd7a6318c Allow multiple prompts for Multi/InfiniteTalk loop 2025-08-21 01:39:34 +03:00
kijai 6d51934ae8 Update wanvideo_I2V_InfiniteTalk_example_01.json 2025-08-20 22:05:25 +03:00
kijai ad008d369b Create wanvideo_InfiniteTalk_V2V_example_01.json 2025-08-20 22:03:04 +03:00
kijai 1edc6ddb32 Create wanvideo_I2V_InfiniteTalk_example_01.json 2025-08-20 21:31:25 +03:00
kijai 655e6557eb Update nodes_model_loading.py 2025-08-20 21:13:49 +03:00
kijai 70bced06f4 Return exact audio frame count if num_frames above it 2025-08-20 21:08:25 +03:00
kijai 68ef3ac468 Fix 2.2VAE progressbar issue 2025-08-20 18:58:55 +03:00
kijai 6db2d113ba Update nodes.py 2025-08-20 17:12:04 +03:00
kijai b39d6abc1b Fix bug 2025-08-20 17:11:46 +03:00
kijai a0cf985bc3 Update nodes.py 2025-08-20 16:51:23 +03:00
kijai 053f26ce82 Multi/InfiniteTalk v2v 2025-08-20 16:40:13 +03:00
kijai edf2a24519 Fix encode progress bar 2025-08-20 13:58:14 +03:00
kijai 8b4546896e Update nodes.py 2025-08-20 13:39:46 +03:00
kijai a1220f7f36 Handle InfiniteTalk first frame when not using the looping sampling 2025-08-20 13:33:44 +03:00
kijai ff779c9171 Update nodes.py 2025-08-20 12:18:53 +03:00
kijai b9f32539fd This should never have been here... 2025-08-20 12:11:45 +03:00
kijai 35adf24d97 Support Fun 5B control 2025-08-20 12:11:34 +03:00
kijai 5375a01fb6 Add error 2025-08-19 20:30:59 +03:00
kijai 04a99fd4e2 Add tooltips 2025-08-19 20:19:01 +03:00
kijai cae24fc7e0 uni3c adjustment 2025-08-19 20:02:24 +03:00
kijai b6d4c172f0 Allow using GGUF Multi/InfiniteTalk models 2025-08-19 17:48:58 +03:00
kijai 345c286c86 Update utils.py 2025-08-19 16:55:51 +03:00
kijai eec70ff3fb Fix multitalk progress bar 2025-08-19 14:50:31 +03:00
kijai 4f9ef5b7a9 Update nodes.py 2025-08-19 13:34:56 +03:00
kijai 5a8f8730bd Fix for using additional scaled model and merging loras 2025-08-19 13:31:56 +03:00
kijai 3cd6a930c3 Update nodes.py 2025-08-19 11:10:16 +03:00
kijai e0eee40bde Add InfiniteTalk loop method 2025-08-19 10:45:42 +03:00
kijai 427e7be6c2 fix multitalk 2025-08-17 18:24:48 +03:00
kijai 1d7e0848e0 Allow Phantom to work with MultiTalk 2025-08-17 16:46:50 +03:00
kijai 689797bdb7 fix 2025-08-17 15:02:45 +03:00
kijai b748ed8bdd Squashed commit of the following:
commit f06ce25f6c50174b0e7b12c3517827a6650f33fa
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sun Aug 17 13:10:02 2025 +0300

    redundant

commit 9957f765e48f68b21713c33db334231207107b01
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sun Aug 17 12:57:12 2025 +0300

    Update nodes.py

commit 9797f15ed1e5a9b9b93f777e92cd82ed584c2b57
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sun Aug 17 12:35:46 2025 +0300

    Remove the "FM" scheduler

    This is just dpm++

commit 244fc2b125253a4c7b6e91ca8dd0b4dc8564c2f0
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sun Aug 17 02:05:26 2025 +0300

    just use default rope I guess...

commit 5c3a60d3b189864f8f2f0977a552499b202326ba
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sun Aug 17 01:35:49 2025 +0300

    Update nodes.py

commit ee47ed17c086f8468fd5a256318274c0077f6dfc
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sun Aug 17 01:35:36 2025 +0300

    Update model.py

commit 8a17ee7d41ae5789b8d7ed01eb8b48c0c3b52ce7
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sat Aug 16 23:20:10 2025 +0300

    init
2025-08-17 13:51:23 +03:00
kijai 4b4a3b4f8f Update nodes.py 2025-08-17 10:55:06 +03:00
kijai d6ac1842fa remove print 2025-08-17 01:41:49 +03:00
kijai e5b0b53265 Update wanvideo_2_1_I2V_FantasyPortrait_example_01.json 2025-08-16 15:46:10 +03:00
kijai e3ef4dd27b bump version 2025-08-16 12:57:32 +03:00
kijai 8bf010a835 onnx device selector 2025-08-16 00:11:11 +03:00
kijai 0ced709f1b Fix multitalk scheduler
Don't know if it's of any relevance, but working again
2025-08-15 18:06:45 +03:00
kijai 9659589d67 Update nodes.py 2025-08-15 17:59:09 +03:00
kijai b60ab34db6 Update nodes_model_loading.py 2025-08-15 15:08:43 +03:00
kijai 9f3a5962e6 Update nodes_model_loading.py 2025-08-15 14:56:09 +03:00
kijai 2df76f3363 Update nodes_model_loading.py 2025-08-15 14:45:53 +03:00
kijai 0beb5a8911 Update nodes.py 2025-08-15 13:47:46 +03:00
kijai c05109ff82 expose adapter projection scaling for FantasyPortrait
Not sure how useful but seemingly can at least separate the effect on mouth and rest of the head
2025-08-15 13:45:41 +03:00
kijai 3de816004d Update readme.md 2025-08-15 13:34:53 +03:00
kijai 8d487f99b4 Add face det code license 2025-08-15 13:34:01 +03:00
kijai 7d2c0b58e2 Update wanvideo_2_1_I2V_FantasyPortrait_example_01.json 2025-08-15 13:17:44 +03:00
kijai d6da0f17bb Add landmark visualization 2025-08-15 13:08:45 +03:00
kijai 656f5b1132 Update nodes.py 2025-08-15 12:45:37 +03:00
kijai 8c4f2bb95e Update pdf.py 2025-08-15 12:31:50 +03:00
kijai d6bee68845 Update multitalk.py 2025-08-15 12:24:37 +03:00
kijai 4641665393 Update nodes.py 2025-08-15 12:24:33 +03:00
kijai 2e9e8c03ea Add trajectory example for Fun 2.2 2025-08-15 10:50:26 +03:00
kijai 03458ee955 Update nodes.py 2025-08-15 10:27:49 +03:00
kijai f51c284354 remove print 2025-08-15 10:18:40 +03:00
kijai f2fd411a7b Add option for manually setting rope offset for Stand-In reference
Experimental
2025-08-15 10:18:00 +03:00
kijai ef8c4aba1d Update __init__.py 2025-08-14 20:27:35 +03:00
kijai 5cfc629de5 Update face_utils.py 2025-08-14 20:18:33 +03:00
kijai 5e7c89bd00 Update wan_video_vae.py 2025-08-14 19:01:02 +03:00
kijai 994e6e3afb Create requirements.txt 2025-08-14 19:00:31 +03:00
kijai 0c4426fc2b FantasyPortrait reqs and cleanup
unsure if I want to add onnx in the requirements at this stage...
2025-08-14 18:53:08 +03:00
kijai 43447dbaf9 Update utils.py 2025-08-14 16:57:01 +03:00
kijai 2f49c7fcdc Update nodes.py 2025-08-14 16:23:23 +03:00
Jukka Seppänen 7bf10bc800 Merge pull request #1039 from Ordinator0/extract-lora-stem
correctly extract lora name
2025-08-14 16:06:33 +03:00
kijai 8d8f388a3c Workaround for Uni3C on latest diffusers 2025-08-14 15:56:58 +03:00
kijai 24683f1dad Squashed commit of the following:
commit 6a01a8a1d80d36b5b8ac979a36069c8eb0c2f9a7
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Aug 14 15:40:50 2025 +0300

    Update wanvideo_2_1_I2V_FantasyPortrait_example_01.json

commit e3cf4bf5bc13321e6d8f91fcb7ee92210a7adf01
Merge: bbf14ec f3d5f6b
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Aug 14 15:08:53 2025 +0300

    Merge branch 'main' into fantasy_portrait

commit bbf14ec9e9965c1a8582eea02b50913e79a036d0
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Aug 14 02:16:11 2025 +0300

    update

commit 8192f9f4302b3933e48641a8ef313929e3e263aa
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Aug 14 01:46:15 2025 +0300

    progress bar, fix context windows

commit 39fab8ad4d950a974ba49bd177814f30f518b478
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Aug 14 01:29:15 2025 +0300

    Update nodes.py

commit 36f472c0134e6342ab8c2062a7e3f0b0c829003b
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Aug 14 01:14:24 2025 +0300

    Add start/end percent

commit 16f5922c6bc575754412c9b473907377562b956c
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Aug 14 00:58:57 2025 +0300

    init
2025-08-14 15:41:25 +03:00
kijai f3d5f6b3ab allow stand-in to work with chunked rope 2025-08-14 14:12:06 +03:00
kijai b29756a962 cleanup 2025-08-14 13:35:36 +03:00
kijai 885fc25cb6 Delete wanvideo_480p_I2V_endframe_example_01.json 2025-08-14 13:32:00 +03:00
kijai c9daa36ef7 Update wanvideo_Stand-In_reference_example_01.json 2025-08-14 13:31:53 +03:00
kijai 5691ae5314 Refactor Fun control input
Allows using reference only
2025-08-14 13:03:51 +03:00
kijai 64a0c03673 Fix Fun 2.2 reference image input
Turns out the reference image doesn't work in the initial fp8_scaled models I shared due to the ref_conv layer ending up scaled as well, I've fixed the models and added error indicating the issue when trying to use reference image on such bugged model.

No change in behaviour when using start image instead.
2025-08-14 11:13:03 +03:00
kijai e1c052ff43 Update attention.py 2025-08-14 00:11:02 +03:00
kijai 8db5521463 Possible bandaid for q k v dtype mismatch
Still no clue where or why it happens, but clearly is happening for some when using sage with Stand-In
2025-08-14 00:10:38 +03:00
kijai 54dbcacd57 Fix fun control 2025-08-13 21:20:05 +03:00
kijai 4805b70d3b Fix end_image only for 2.2 I2V 2025-08-13 21:04:08 +03:00
kijai 68e18eabb2 Create wanvideo_Fun2_2_control_camera_example_01.json 2025-08-13 19:33:25 +03:00