Commit Graph
259 Commits
Author SHA1 Message Date
kijai e560366600 Update model.py 2025-10-27 18:55:30 +02:00
kijai c59e52ca44 Precision adjustments 2025-10-27 00:23:32 +02:00
kijai a0bdf20817 Some cleanup and allow full block swap 2025-10-26 23:05:17 +02:00
kijai 8ad7e50f33 Fix cross attention split point 2025-10-26 22:07:19 +02:00
kijai d504c96174 Separate attention for input images like in original 2025-10-26 19:14:47 +02:00
kijai 43acf83adb Update model.py 2025-10-26 16:57:25 +02:00
kijai fb00932cad Init
https://huggingface.co/Kijai/LongCat-Video_comfy/tree/main
2025-10-26 16:36:20 +02:00
kijai 67fcf0ba52 Reduce needless torch.compile recompiles 2025-10-22 13:29:13 +03:00
kijai 1f0861b649 MoCha: modify RoPE function to be more torch.compile friendly 2025-10-21 17:54:25 +03:00
unrealMJ 88defbfdd1 add MoCha 2025-10-21 09:40:54 +08:00
kijai 9a88b9e40a FlashVSR: Add strength setting 2025-10-15 19:11:41 +03:00
kijai bb75cddd60 Add minimal FlashVSR upscale support
https://zhuang2002.github.io/FlashVSR/

This only implements the projection model and the VAE, which seems to be enough for upscaling. This does NOT implement any of the streaming and sparse attention code.
2025-10-15 18:24:28 +03:00
kijai 139bdf827f Squashed commit of the following:
commit 73dd1a06d33953912f5dd684f168028b14e42a36
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Mon Oct 13 19:47:38 2025 +0300

    cleanup

commit 39bc2cecf493e2eb176b55e8841d933f0da1ec39
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Mon Oct 13 19:24:20 2025 +0300

    Allow scheduling ovi cfg

commit 2c153c5f324dbd59670ad9c51a7995459504a3cd
Merge: dba7667 32eb6b4
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Mon Oct 13 17:48:20 2025 +0300

    Merge branch 'main' into ovi

commit dba76674c71af7bf94c82834a0b0e40d94043c99
Merge: 0f11a43 5a0456e
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sun Oct 12 22:45:43 2025 +0300

    Merge branch 'main' into ovi

commit 0f11a439622799ad8070f8a2b8cc8e6a041b761d
Merge: 0999f50 e2d8c9b
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sat Oct 11 07:48:06 2025 +0300

    Merge branch 'main' into ovi

commit 0999f50cfe025290cd7ce88a8dd1acff0b38d9bd
Merge: d45df1f f1d1c83
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Fri Oct 10 22:16:09 2025 +0300

    Merge branch 'main' into ovi

commit d45df1fb5b7c629b15eabc197357d62bdc232aaf
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Oct 9 20:21:37 2025 +0300

    Remove dependency for librosa

commit d8e7533fdf7eab1d2489c3e025a908c02d997444
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Oct 9 19:57:28 2025 +0300

    Remove omegaconf dependency

commit f4e27ff018e98cb5b09655dceda399baea36b240
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Oct 9 19:31:06 2025 +0300

    Fix VACE

commit 35d3df39294831e5e7568b6f7e16d2ecf2d790a0
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Oct 9 00:26:40 2025 +0300

    small update

commit 96f8ea1d26869ab7e49e12a07f19d5d5a2023253
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Wed Oct 8 22:32:57 2025 +0300

    Create wanvideo_2_2_5B_ovi_testing.json

commit a2511be73b9da7019fd21aeb0b521af941c09150
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Wed Oct 8 22:32:54 2025 +0300

    Update nodes_sampler.py

commit d3688b8db71452ea1f7c9a2bc0216441d524e56c
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Wed Oct 8 21:43:02 2025 +0300

    Allow EasyCache to work with ovi

commit 586d9148a0306ef5d30e9a971a9c3be4cd3ecc97
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Wed Oct 8 19:09:06 2025 +0300

    Update model.py

commit 61eedd2839decdb7d4c2ddd5f1310fdaf49d36ad
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Wed Oct 8 19:09:02 2025 +0300

    I2V fix

commit a97fcb1b9ae9fb7bbfdf668c24816e014a1b58d1
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Wed Oct 8 17:57:28 2025 +0300

    Add nodes to set audio latent size

commit d41e42a697f3d561dabbc22566f633b5f1bbd952
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Wed Oct 8 16:42:04 2025 +0300

    Support loading mmaudio vae from .safetensors

commit 1b0e28ec41e3c97fe1f2f057fef9b9bbcb87bca7
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Wed Oct 8 16:19:53 2025 +0300

    Update nodes_sampler.py

commit fbd18f45fe85ede8edcb5aebaea7ceb5b6eab5a2
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Wed Oct 8 10:16:44 2025 +0300

    Fixes for other workflows

commit b06993b637198f7fad92208f3b3dc9a7d7f57c7f
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Wed Oct 8 09:46:27 2025 +0300

    initial commit

    T2V works
2025-10-13 20:16:53 +03:00
kijai 32eb6b480d Allow canceling mid step 2025-10-13 17:47:28 +03:00
kijai d6864ec46e Fix for S2V 2025-10-07 23:48:26 +03:00
kijai dd888f7a8d GGUF dtype fix 2025-10-06 22:09:58 +03:00
kijai b27c1e5fcd Fix VACE 2025-10-06 21:29:16 +03:00
kijai bb23263f78 Separate full model's ip and ref layer loading
Allows using full ref with lite ip adapter, or full ref alone without loading the ip weights
2025-10-06 18:42:14 +03:00
kijai 174cba5759 Fix some precision issues with some models 2025-10-06 13:20:20 +03:00
kijai 8360666470 Update model.py 2025-10-01 19:34:17 +03:00
kijai 1316f57390 Update model.py 2025-10-01 19:29:05 +03:00
kijai 0730929558 Allow selecting which blocks to use for lynx ref 2025-10-01 19:04:56 +03:00
kijai 1e88104558 compile fixes and cleanup 2025-10-01 18:44:56 +03:00
kijai 28ae01e11b fixes 2025-10-01 10:05:29 +03:00
kijai 5d3c4223a8 Update model.py 2025-09-30 18:59:14 +03:00
kijai ed167a0135 dtype fixes 2025-09-30 18:33:05 +03:00
kijai 1ba1a1662b cleanup and use fp32 text/time embed if available 2025-09-30 18:10:18 +03:00
kijai aefff3796e uncond 2025-09-28 11:21:05 +03:00
kijai 0ed0f54d11 initial lynx full support 2025-09-28 02:01:01 +03:00
kijai 358baa2c2a Lynx + VACE 2025-09-27 02:05:17 +03:00
kijai ab31158673 init: support lite model 2025-09-27 00:49:02 +03:00
kijai f05865de63 Fix VACE 2025-09-23 19:06:15 +03:00
kijai 840553b261 Update model.py 2025-09-23 19:04:37 +03:00
kijai b8c2bb0a93 Add torch native RMSNorm as a choice 2025-09-23 17:41:24 +03:00
kijai 0ba45a1645 Fix flash attention 2025-09-23 00:10:41 +03:00
kijai 718946ef13 Revert using torch RMSNorm as there are quality concerns 2025-09-21 18:19:27 +03:00
kijai fc3a684b0b WanAnimate: Move face adapter blocks to corresponding main blocks to include them in block swap 2025-09-21 16:34:17 +03:00
kijai 0482667c78 Use torch native (fused) RMSNorm if available 2025-09-21 15:29:33 +03:00
kijai e4627466f5 WanAnimate block swap fix 2025-09-19 16:59:57 +03:00
kijai 72f5423d6a Allow uni3c with WanAnimate 2025-09-19 15:28:01 +03:00
kijai de304b10d1 face adapter offloading 2025-09-19 12:45:08 +03:00
kijai b06562823b Fix GGUF with WanAnimate 2025-09-19 11:35:14 +03:00
kijai 79583d4be3 Support WanAnimate 2025-09-19 10:14:08 +03:00
kijai 076c4a5c7e Experimental: Allow HuMo to work with InfiniteTalk
Doesn't work that great, but pushing this anyway for possible future usecases
2025-09-15 19:07:34 +03:00
kijai 38fd791a77 Squashed commit of the following:
commit fda0fe6e0c21eb10276ae302cd88b6cbcf5b36b5
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sat Sep 13 16:55:00 2025 +0300

    Create wanvideo_HuMo_example_01.json

commit cffe3039c3d2fbacd4803329bf31b5fdc45215ba
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sat Sep 13 16:30:49 2025 +0300

    Update model.py

commit ddce018a5a6ffeb926860342889b12efb7343ec0
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sat Sep 13 16:29:27 2025 +0300

    cleanup

commit 8c021b8b3f66144804e500e74aa6f2be52f9f9fc
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sat Sep 13 16:23:27 2025 +0300

    avoid compile graph break

commit ef9c7732042261581b4bba6d980def78633f56dc
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sat Sep 13 16:16:13 2025 +0300

    Allow using whisper model without decoder layers

commit 8d0ba29ee84d14be6084ecbcee1cbc9414128fb3
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sat Sep 13 15:55:26 2025 +0300

    start/end percent for HuMo audio

commit bfe0d358a8820240f262351e61cfb979cb9a47ff
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sat Sep 13 15:37:11 2025 +0300

    cleanup

commit e563ae317f24a7f5751b43cdef4bffbaeaea5114
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sat Sep 13 14:02:21 2025 +0300

    Make audio work

commit 95855196c51b1124a19079b746c5d12ec70d9026
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Fri Sep 12 18:10:04 2025 +0300

    cfg

commit d5a18b090fe719b7f0b00a0f68e6824685598313
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Fri Sep 12 03:10:15 2025 +0300

    wrong way around

commit 34c8c4842c14002fe4694dfa23c24a65b7ea39d0
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Fri Sep 12 03:01:45 2025 +0300

    Update nodes.py

commit 47d1e2ab5f3e1483782d0739f5b51cdd33707c36
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Fri Sep 12 02:47:03 2025 +0300

    update

    image inputs are working but audio still doesn't do anything

commit 67890d816a64459944091cb01478c1e0ec4c4a82
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Sep 11 21:13:12 2025 +0300

    update

commit dbcef53405bb78feae4c5d2c6b310b76e4ef9949
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Sep 11 17:09:37 2025 +0300

    Update model.py

commit 92c9aac51f4d37988757510a4e57179834cc5de2
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Sep 11 16:15:39 2025 +0300

    init

    untested as no weights released as of yet
2025-09-13 16:55:28 +03:00
kijai b9e49af4d1 Just resize any dimension mismatch on uni3c input 2025-09-10 17:18:02 +03:00
kijai c254ae4235 Rather interpolate any Uni3C input frame count differences 2025-09-10 16:47:13 +03:00
kijai dd36ab46c6 Pad Uni3c input when using VACE ref 2025-09-10 16:26:20 +03:00
kijai 7cb46ca8c3 Allow Uni3C to work with T2V 2025-09-10 16:09:44 +03:00
kijai edea93286c Small potential tweaks to Pusa vram use 2025-09-05 16:00:18 +03:00