nodes/kijai-ComfyUI-WanVideoWrapper
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,209 Commits 8 Branches 0 Tags
c59e52ca4403a76ec73a374ef1d64f9c97c8ab9b
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
kijai c59e52ca44 Precision adjustments 2025-10-27 00:23:32 +02:00
kijai a0bdf20817 Some cleanup and allow full block swap 2025-10-26 23:05:17 +02:00
kijai 8ad7e50f33 Fix cross attention split point 2025-10-26 22:07:19 +02:00
kijai d504c96174 Separate attention for input images like in original 2025-10-26 19:14:47 +02:00
kijai 43acf83adb Update model.py 2025-10-26 16:57:25 +02:00
kijai fb00932cad Init 
https://huggingface.co/Kijai/LongCat-Video_comfy/tree/main
 2025-10-26 16:36:20 +02:00
kijai d74cfc54e8 Don't zero the extra frames 
Possible fix for SVI "shot" method
 2025-10-24 15:28:35 +03:00
kijai cfa883767f Update utils.py 2025-10-24 12:50:49 +03:00
kijai 88a60d71ab Fix 2025-10-23 23:25:20 +03:00
kijai b3ad381a65 not all torch versions have this 2025-10-23 21:12:45 +03:00
kijai 41168b1e82 Support light VAE 
https://huggingface.co/lightx2v/Autoencoders/tree/main
 2025-10-23 12:31:55 +03:00
kijai 7251c996d2 Load these LoRA keys too 
Even though doesn't seem to do anything? At least silences the errors
 2025-10-22 20:43:45 +03:00
kijai 67fcf0ba52 Reduce needless torch.compile recompiles 2025-10-22 13:29:13 +03:00
kijai aa610cde2b VACE: Support per context window reference images 2025-10-22 11:24:30 +03:00
kijai 6b286552b7 MocHa: remove possibly alpha channel from inputs 2025-10-21 23:26:17 +03:00
kijai 2ea824b9ab Mocha: Fix context window slicing 2025-10-21 20:33:03 +03:00
kijai 001040abc7 Update nodes.py 2025-10-21 20:27:37 +03:00
kijai 746d46e137 WanVideoScheduler: Always show split step sigma 2025-10-21 20:14:54 +03:00
kijai 089329ef2e MoCha: revert some RoPE changes 2025-10-21 20:12:40 +03:00
kijai 5c1f64197e Check for actual scale_weights even if the model for some reason doesn't have the scaled_fp8 key 2025-10-21 19:40:50 +03:00
kijai 54e938cd70 MoCha: Fix context window mask 2025-10-21 19:40:01 +03:00
kijai 7495db7669 Update nodes_sampler.py 2025-10-21 19:15:57 +03:00
kijai 4e36aee658 MoCha: experimental context windows support 2025-10-21 18:32:40 +03:00
kijai 56120d633e Update nodes.py 2025-10-21 17:59:37 +03:00
kijai 1f0861b649 MoCha: modify RoPE function to be more torch.compile friendly 2025-10-21 17:54:25 +03:00
kijai 7916f89c33 Add updated MoCha example for lower VRAM 2025-10-21 17:27:41 +03:00
Jukka Seppänen e294f417c0 Merge pull request #1501 from unrealMJ/mocha 
[Feature] Request to add MoCha: End-to-End Video Character Replacement without Structural Guidance
 2025-10-21 17:17:21 +03:00
Jukka Seppänen 74f33df658 Merge pull request #1493 from HM-RunningHub/fix-uni3c-context-options 
Fix Uni3C + Context Options compatibility (Issue #1491)
 2025-10-20 22:33:38 +03:00
kijai 200f6943e3 Add sageattn mode that allows torch.compile 
Latest wheel from woct0rdho includes the torch.compile fix:

https://github.com/woct0rdho/SageAttention/releases

Based on my quick testing this reduces peak VRAM usage a bit when running sageattn + torch.compile
 2025-10-20 15:16:43 +03:00
kijai 8081e1337c Fix downcasting for fp8_fast and add error to indicate you can't do scaled downcast currently 2025-10-20 13:46:05 +03:00
kijai 9ecb80a58b Support loading VACE LoRAs (for ditto) 2025-10-20 11:49:49 +03:00
kijai 967d15321d fix rcm scheduler check 2025-10-19 19:49:24 +03:00
kijai 9cd79d3d4a Add experimental rCM scheduler 
Based on the original code, works but doesn't feel better than dpm++_sde so far
 2025-10-19 19:34:17 +03:00
kijai 7ecd55e92a bump version 2025-10-19 18:13:09 +03:00
kijai 99c0efdb45 Expose force_parameter_static_shapes in torch.compile options 2025-10-19 18:01:03 +03:00
kijai a721fe3d0f Better (hopefully) FlashVSR frame selection 
First frame was completely discarded before
 2025-10-19 13:49:40 +03:00
kijai e8ecda7240 Update wanvideo_1_3B_FlashVSR_upscale_example.json 2025-10-18 16:16:25 +03:00
kijai 7d88316bf8 Fix for the case of applying unmerged lora to already compiled model 2025-10-18 14:00:18 +03:00
kijai 6bcbfc54cf Fix diffusion forcing 2025-10-17 18:20:45 +03:00
kijai 55463a6290 Fix audio_cfg_scale 2025-10-17 18:12:54 +03:00
kijai 6aa0446706 Ovi: fix decoded output audio shape 
I don't know how it ever worked with any nodes... but now it should work with all audio nodes.
 2025-10-16 18:03:42 +03:00
kijai 848ceb2beb Don't require whole facexlib for lynx 2025-10-16 17:51:21 +03:00
kijai cc06d71ca0 Workaround for bug in pytorch 2.9.0 that makes the VAE use crazy amounts of VRAM 
This is probably caused by:

https://github.com/pytorch/pytorch/pull/164027/files

That disables cudnn when using half precision VAE, this workaround simply uses fp32 for the Conv3D operations.
 2025-10-16 17:10:05 +03:00
kijai e221fdd7ac Fix normal tiny vae 2025-10-16 14:54:00 +03:00
kijai c876108059 Update fp8_e4m3fn compile warning on older arch to indicate it should now work with latest Triton 
https://github.com/woct0rdho/triton-windows/releases/tag/v3.5.0-windows.post21
 2025-10-16 13:08:42 +03:00
kijai 9cae986648 Fix for HuMo/Phantom when using cfg 2025-10-16 13:01:21 +03:00
kijai d2ce150490 Update nodes_sampler.py 2025-10-16 10:49:54 +03:00
kijai 50483a3b54 FlashVSR tweaks 2025-10-16 00:42:33 +03:00
kijai 367c612ddb FlashVSR: Better input frame handling 2025-10-15 23:58:32 +03:00
kijai 9a88b9e40a FlashVSR: Add strength setting 2025-10-15 19:11:41 +03:00
kijai 2fd5bb6ffa Basic context window support for FlashVSR 2025-10-15 18:45:42 +03:00
kijai bb75cddd60 Add minimal FlashVSR upscale support 
https://zhuang2002.github.io/FlashVSR/

This only implements the projection model and the VAE, which seems to be enough for upscaling. This does NOT implement any of the streaming and sparse attention code.
 2025-10-15 18:24:28 +03:00
kijai 3d42bf62ce Relocate Ovi example 2025-10-14 00:17:47 +03:00
kijai da43a51683 Unmerged lora application tweak 
Should resolve some issues when using same model with multiple sampler and different loras
 2025-10-13 20:18:43 +03:00
kijai 139bdf827f Squashed commit of the following: 
commit 73dd1a06d33953912f5dd684f168028b14e42a36
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Mon Oct 13 19:47:38 2025 +0300

    cleanup

commit 39bc2cecf493e2eb176b55e8841d933f0da1ec39
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Mon Oct 13 19:24:20 2025 +0300

    Allow scheduling ovi cfg

commit 2c153c5f324dbd59670ad9c51a7995459504a3cd
Merge: dba7667 32eb6b4
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Mon Oct 13 17:48:20 2025 +0300

    Merge branch 'main' into ovi

commit dba76674c71af7bf94c82834a0b0e40d94043c99
Merge: 0f11a43 5a0456e
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sun Oct 12 22:45:43 2025 +0300

    Merge branch 'main' into ovi

commit 0f11a439622799ad8070f8a2b8cc8e6a041b761d
Merge: 0999f50 e2d8c9b
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sat Oct 11 07:48:06 2025 +0300

    Merge branch 'main' into ovi

commit 0999f50cfe025290cd7ce88a8dd1acff0b38d9bd
Merge: d45df1f f1d1c83
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Fri Oct 10 22:16:09 2025 +0300

    Merge branch 'main' into ovi

commit d45df1fb5b7c629b15eabc197357d62bdc232aaf
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Oct 9 20:21:37 2025 +0300

    Remove dependency for librosa

commit d8e7533fdf7eab1d2489c3e025a908c02d997444
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Oct 9 19:57:28 2025 +0300

    Remove omegaconf dependency

commit f4e27ff018e98cb5b09655dceda399baea36b240
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Oct 9 19:31:06 2025 +0300

    Fix VACE

commit 35d3df39294831e5e7568b6f7e16d2ecf2d790a0
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Oct 9 00:26:40 2025 +0300

    small update

commit 96f8ea1d26869ab7e49e12a07f19d5d5a2023253
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Wed Oct 8 22:32:57 2025 +0300

    Create wanvideo_2_2_5B_ovi_testing.json

commit a2511be73b9da7019fd21aeb0b521af941c09150
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Wed Oct 8 22:32:54 2025 +0300

    Update nodes_sampler.py

commit d3688b8db71452ea1f7c9a2bc0216441d524e56c
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Wed Oct 8 21:43:02 2025 +0300

    Allow EasyCache to work with ovi

commit 586d9148a0306ef5d30e9a971a9c3be4cd3ecc97
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Wed Oct 8 19:09:06 2025 +0300

    Update model.py

commit 61eedd2839decdb7d4c2ddd5f1310fdaf49d36ad
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Wed Oct 8 19:09:02 2025 +0300

    I2V fix

commit a97fcb1b9ae9fb7bbfdf668c24816e014a1b58d1
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Wed Oct 8 17:57:28 2025 +0300

    Add nodes to set audio latent size

commit d41e42a697f3d561dabbc22566f633b5f1bbd952
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Wed Oct 8 16:42:04 2025 +0300

    Support loading mmaudio vae from .safetensors

commit 1b0e28ec41e3c97fe1f2f057fef9b9bbcb87bca7
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Wed Oct 8 16:19:53 2025 +0300

    Update nodes_sampler.py

commit fbd18f45fe85ede8edcb5aebaea7ceb5b6eab5a2
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Wed Oct 8 10:16:44 2025 +0300

    Fixes for other workflows

commit b06993b637198f7fad92208f3b3dc9a7d7f57c7f
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Wed Oct 8 09:46:27 2025 +0300

    initial commit

    T2V works
 2025-10-13 20:16:53 +03:00
kijai 32eb6b480d Allow canceling mid step 2025-10-13 17:47:28 +03:00
kijai 6c38f8cb24 WanAnimate: Force dimensions to be divisible by 16 2025-10-13 17:31:54 +03:00
kijai 64ed8c4183 WanAnimate: Actually use clip embeds when provided 
Kinda forgot this model even has those layers...
 2025-10-13 16:44:49 +03:00
kijai 5a0456ed9e Merge branch 'pr/1321' 2025-10-12 22:45:33 +03:00
kijai e2d8c9bef5 Allow using tiny vae in other precisions 
The model is available in fp16 only though
 2025-10-11 07:47:52 +03:00
kijai f1d1c83713 Support 2.2 tiny VAE 2025-10-10 22:13:12 +03:00
kijai 6d2ff33466 Fix double encode 2025-10-10 09:36:37 +03:00
kijai 4c4e7defc2 Fix for 2.2 Fun-camera 2025-10-08 10:14:50 +03:00
kijai 7c09f1e171 Fix some variable names 2025-10-08 00:05:51 +03:00
kijai d6864ec46e Fix for S2V 2025-10-07 23:48:26 +03:00
kijai 260c181e0e Allow lynx reference adapter to run with I2V models 2025-10-07 15:07:31 +03:00
kijai 6075807e03 Fix for some fp8_scaled models 2025-10-07 13:30:41 +03:00
kijai 76ea2aa6a6 Update wan_video_vae.py 2025-10-07 11:41:54 +03:00
kijai 1e56fd1114 Fix weight loading when not using lora or patched linear 2025-10-07 10:56:30 +03:00
kijai 1d94082563 Add lynx requirements.txt 2025-10-06 22:11:00 +03:00
kijai dd888f7a8d GGUF dtype fix 2025-10-06 22:09:58 +03:00
kijai b27c1e5fcd Fix VACE 2025-10-06 21:29:16 +03:00
kijai 269a14f413 Merge branch 'lynx' 2025-10-06 19:39:06 +03:00
kijai 5c74e5c99a bumb version 2025-10-06 19:38:56 +03:00
kijai a088425268 Create wanvideo_T2V_14B_lynx_example_01.json 2025-10-06 19:38:20 +03:00
kijai bb23263f78 Separate full model's ip and ref layer loading 
Allows using full ref with lite ip adapter, or full ref alone without loading the ip weights
 2025-10-06 18:42:14 +03:00
kijai 174cba5759 Fix some precision issues with some models 2025-10-06 13:20:20 +03:00
kijai c517cfbc17 Merge branch 'main' into lynx 2025-10-06 13:02:23 +03:00
kijai d3010e37ab Fix some torch compile + fp8_fast issues 2025-10-05 12:31:45 +03:00
kijai 3167e088ed Update fp8_optimization.py 2025-10-05 12:26:44 +03:00
kijai d20d271a24 Update nodes_model_loading.py 2025-10-05 12:19:43 +03:00
kijai 05232fb966 Update nodes.py 2025-10-05 01:37:12 +03:00
kijai 00a5cb8e5c Update nodes.py 2025-10-05 01:27:32 +03:00
kijai d380c7d219 Add TSR (Temporal Score Rescaling) to experimental args 
https://github.com/temporalscorerescaling/TSR
 2025-10-05 01:14:25 +03:00
kijai 71c8a4961b Merge branch 'pr/1240' 2025-10-03 19:24:40 +03:00
kijai dd7c55f5d2 Merge branch 'main' of https://github.com/kijai/ComfyUI-WanVideoWrapper 2025-10-03 19:23:41 +03:00
kijai 300e8a4786 Update readme.md 2025-10-03 19:23:39 +03:00
Jukka Seppänen f66c5df07d Update readme with example links 
Added links to WanAnimate and ReCamMaster examples.
 2025-10-02 14:39:18 +03:00
kijai 700aae60af Add example for WanAnimate with the new preprocessor 2025-10-02 13:31:31 +03:00
kijai 1ad36cc5f9 Merge branch 'main' into lynx 2025-10-02 00:55:48 +03:00
kijai 697fff7442 Add FlowMatchSAODEStableScheduler 
source: https://github.com/eddyhhlure1Eddy/ode-ComfyUI-WanVideoWrapper
 2025-10-02 00:53:49 +03:00
kijai 8360666470 Update model.py 2025-10-01 19:34:17 +03:00
kijai 4b079bdf5a Update nodes_sampler.py 2025-10-01 19:30:44 +03:00
kijai 1316f57390 Update model.py 2025-10-01 19:29:05 +03:00
kijai 0730929558 Allow selecting which blocks to use for lynx ref 2025-10-01 19:04:56 +03:00
kijai 1e88104558 compile fixes and cleanup 2025-10-01 18:44:56 +03:00
kijai 28ae01e11b fixes 2025-10-01 10:05:29 +03:00
kijai 5d3c4223a8 Update model.py 2025-09-30 18:59:14 +03:00
kijai ed167a0135 dtype fixes 2025-09-30 18:33:05 +03:00
kijai 1ba1a1662b cleanup and use fp32 text/time embed if available 2025-09-30 18:10:18 +03:00