Commit Graph
383 Commits
Author SHA1 Message Date
kijai 3611341339 Fix uni3c reloading 2025-12-14 16:48:55 +02:00
kijai 78e3e1857c Add v2 sampling nodes for cleaner workflows
No functional changes, just cleaner nodes
2025-12-13 15:42:35 +02:00
kijai 164a6bbebd Restore LoRA step scheduling functionality 2025-12-13 00:54:22 +02:00
kijai 91413b33f5 One-to-all pose cfg 2025-12-12 15:23:56 +02:00
kijai 2790c532cc Handle OneToAll extra layer devices 2025-12-10 19:46:02 +02:00
kijai 369043c5d8 Add comfy core attention as option
For edge cases that may benefit from the older attention types
2025-12-10 19:39:05 +02:00
wangxin68 38a48c670a [bugfix] Fixed the logic for processing return values after computing attention in flashAttention3 2025-12-10 17:27:37 +08:00
kijai 4c97d27583 Fix LongCat error 2025-12-09 21:09:44 +02:00
kijai 8b037bce2e Squashed commit of the following:
commit c3eb0f49faf68ab953f1b08b7e00225e041e5d0b
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Tue Dec 9 12:55:49 2025 +0200

    move workflow

commit e129e25c26f9b55b527dd3e9f15c6e3f215af11f
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Tue Dec 9 11:17:17 2025 +0200

    Fix padding

commit f252f34eff5cc15ec6fc475f929cafa3e5b7f46c
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Tue Dec 9 01:38:17 2025 +0200

    Add long video example

commit 09ceab808b67a3b2fb7d1ee5fc0a1ad667739e2a
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Tue Dec 9 01:31:48 2025 +0200

    Support extension

commit 7ca221874e8a2cabfc766c51bb63774fde3c851b
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Mon Dec 8 12:28:29 2025 +0200

    Might as well not even do control pass on uncond...

commit b55caf299e4d89148f5885e8e56bf8e411472dc3
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Mon Dec 8 12:15:59 2025 +0200

    Cfg fixes

commit fd54ba23e6746acb33a8bf124e5bc7de9d947ff1
Merge: 2f97b1b e867e64
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Mon Dec 8 10:39:55 2025 +0200

    Merge branch 'main' into onetoall

commit 2f97b1bd887367962542b9a6058f9f6e3c4ad4d7
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Mon Dec 8 09:32:09 2025 +0200

    Add ref_mask input

commit 74cad232fd35347c50f2ed7465ff13e179ef8402
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Mon Dec 8 03:44:42 2025 +0200

    Update nodes_model_loading.py

commit 01a038eb4a30f29d868fbaef190e6e90da1a058d
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Mon Dec 8 03:11:08 2025 +0200

    Fix indentation

commit a95f4d6eaa4468e818910fec7ba11e1f92423d9b
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Mon Dec 8 02:54:47 2025 +0200

    Update model.py

commit ad006985a1bafdf5941c0fa85a47852eb20a818a
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Mon Dec 8 02:54:19 2025 +0200

    Fix token replace

commit b5f0f44f1720586950756ad142a538e04814270f
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Mon Dec 8 02:50:52 2025 +0200

    Don't use token replace by default

commit 874174ec2921c528a4373097fd0bebbbb5257606
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Mon Dec 8 02:24:47 2025 +0200

    Create WanToAllAnimation_test.json

commit 9e6175855618c94c1bcb89c4b89879219410ce53
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Mon Dec 8 02:23:15 2025 +0200

    Add token replacement

commit 41fd76dfcbf0e70a3a7308a6fa0652fb492ed1f6
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Mon Dec 8 00:45:33 2025 +0200

    Use correct norm for reference attn

commit 705f5dcc8b6cd5fa6fe453f9bd01ffdf43a23078
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Mon Dec 8 00:11:17 2025 +0200

    cleanup

commit 4f095d97f80da807417d49d9aa7e9ee47145c85f
Merge: 3e4e4db 2369cdb
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sun Dec 7 18:44:01 2025 +0200

    Merge branch 'main' into onetoall

commit 3e4e4db35d3e266c39d48cd683f60384a737eca5
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sun Dec 7 00:27:23 2025 +0200

    handle controlnet better

commit c5742552a9af4a3ae208f9c2ead6e1105cc2c348
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sat Dec 6 17:24:45 2025 +0200

    cleanup

commit c06ff9c06651c32953236802bd7fb385b9cf93ab
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sat Dec 6 03:41:02 2025 +0200

    3D rope for controlnet

commit 948ea6b783f54892515cbc9cfe66484913904ee7
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sat Dec 6 03:08:04 2025 +0200

    pose input scaling

commit 90c2eff3b2d30d3a92ff5c27e4327a0ac80b642c
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sat Dec 6 02:37:48 2025 +0200

    Cleanup

commit 9f7683422c1aa8ebe4d3380a86be98d6c589b270
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Fri Dec 5 23:29:05 2025 +0200

    pose control

commit 0f217be4d8742741b0f89db50138214302a58dc3
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Fri Dec 5 20:55:10 2025 +0200

    Support reference input
2025-12-09 12:56:11 +02:00
kijai e867e642d4 Fix longcat scheduler 2025-12-08 10:26:38 +02:00
kijai 7f9560eb33 Fix mistake in sageattn_ultravico 2025-12-07 19:56:03 +02:00
kijai 2369cdbbe9 Fix prompt splitting 2025-12-07 18:34:21 +02:00
kijai 123c9ca312 Allow HuMo to work with start_image 2025-12-07 18:18:16 +02:00
kijai 4e7b8dd92c Clearer error on attention mode imports 2025-12-05 02:00:31 +02:00
kijai 001bc0e24a Merge branch 'main' of https://github.com/kijai/ComfyUI-WanVideoWrapper 2025-12-04 16:44:29 +02:00
kijai 7189922f36 Update __init__.py 2025-12-04 16:44:18 +02:00
kijai faf9c5927d Merge branch 'pr/1510' 2025-12-04 16:44:02 +02:00
Jukka Seppänen 6c5dc0ba2a Merge pull request #1546 from wzxysf/main
Enable vae tiling with end frame
2025-12-04 16:40:29 +02:00
kijai b06c7d2d6d Add UltraViCo -sage attention mode and refactor some attention code
https://github.com/thu-ml/DiT-Extrapolation/
2025-12-03 13:32:45 +02:00
kijai 014e711972 cleanup 2025-12-03 11:09:09 +02:00
kijai b9f6c9aa50 Update __init__.py 2025-12-02 00:45:22 +02:00
kijai c1fbc93521 Add ViBTScheduler to use ViBT models
https://github.com/Yuanshi9815/ViBT/tree/main
2025-12-02 00:26:50 +02:00
kijai c4db00609a Use torch.chunk for chunking 2025-12-01 17:39:50 +02:00
kijai 5a52d6b92f Add VAE feat_cache offloading, VAE tqdm progress bar and memory usage report 2025-12-01 15:05:20 +02:00
kijai 196d39695f Fix sageattn_varlen 2025-12-01 01:11:06 +02:00
kijai e5be3e5263 Use torch custom_ops to avoid graph breaks with torch.compile
Hopefully finally fixes the torch.compile VRAM issues...
2025-12-01 00:29:27 +02:00
kijai a6071c7be5 Merge branch 'main' into steadydancer 2025-11-30 17:56:50 +02:00
kijai a9cd073f29 Remove unnecessary recompile when using cfg 2025-11-30 17:52:56 +02:00
kijai 1e9e2be622 Avoid recompile here 2025-11-30 17:32:24 +02:00
kijai 99c3978da4 Reduce peak VRAM usage when not using torch.compile (and some even with it)
Found some intermediates that weren't freed which should reduce VRAM usage overall, and modified RoPE application outside torch compile for similar gains than when using torch.compile.
2025-11-30 17:14:53 +02:00
kijai 66d44ec8db This doesn't really do anything useful 2025-11-28 21:15:25 +02:00
kijai 394c7c13d2 Add strength controls 2025-11-28 21:11:20 +02:00
kijai e54fa5d059 Init 2025-11-28 20:32:16 +02:00
kijai fa7a967ee7 Fix stand-in 2025-11-17 11:56:02 +02:00
kijai f872460285 Fix TTM for dual sampler setups 2025-11-16 19:23:19 +02:00
kijai e3c2a1431b Squashed commit of the following:
commit f685ee33ac
Merge: bb5707f 4e31081
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Nov 13 16:37:38 2025 +0200

    Merge branch 'main' into bindweave

commit bb5707f601
Merge: acb662b ff26836
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Tue Nov 11 18:53:19 2025 +0200

    Merge branch 'main' into bindweave

commit acb662b5af
Merge: 907c9e1 e926f7a
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Tue Nov 11 11:44:26 2025 +0200

    Merge branch 'main' into bindweave

commit 907c9e1cdd
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Mon Nov 10 21:02:58 2025 +0200

    Update nodes.py

commit e4a4d22537
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sat Nov 8 16:04:55 2025 +0200

    Update nodes_sampler.py

commit a3b2f67337
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sat Nov 8 16:03:00 2025 +0200

    Pad clip vision embeds like in original code

commit 1e00c8fb28
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Sat Nov 8 12:21:11 2025 +0200

    Update nodes.py

commit ff16dce5c0
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Fri Nov 7 01:15:13 2025 +0200

    Update nodes_sampler.py

commit f972b31bf2
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Fri Nov 7 01:09:22 2025 +0200

    Update nodes.py

commit 3dacd6a719
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Fri Nov 7 00:45:06 2025 +0200

    Update nodes_sampler.py

commit 7bf99791ad
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Fri Nov 7 00:44:13 2025 +0200

    Update nodes.py

commit 7a5587b5af
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Fri Nov 7 00:39:10 2025 +0200

    Let the user resize for QwenVL

    Seems to need smaller resolutions

commit d6cf172846
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Nov 6 23:41:24 2025 +0200

    Update nodes.py

commit cf86f4f0a4
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Nov 6 21:01:03 2025 +0200

    Update model.py

commit b1f8309a20
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Nov 6 19:55:54 2025 +0200

    Update nodes_model_loading.py

commit 8992c6af64
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Nov 6 19:22:56 2025 +0200

    Don't include padding for scheduler

commit e4084a961b
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Nov 6 18:32:53 2025 +0200

    Update nodes.py

commit 3ec1edefbe
Author: kijai <40791699+kijai@users.noreply.github.com>
Date:   Thu Nov 6 17:35:48 2025 +0200

    init

    For testing, no idea if it works yet
2025-11-13 17:10:57 +02:00
kijai 1d0516a2a9 Avoid graph break for LongCat 2025-11-04 10:26:37 +02:00
kijai 8ce6916d72 Fix for some cases of using comfy_chunked rope 2025-11-03 10:36:55 +02:00
kijai 0d0d28569a Fix cases where text encoder isn't used (eg. Minimax remover) 2025-11-03 10:29:10 +02:00
kijai 75109fdb79 Fix custom sigmas with euler 2025-11-03 10:12:05 +02:00
kijai 5eae7087fa Fix for S2V 2025-11-02 01:24:50 +02:00
kijai 393fe78ec2 Update model.py 2025-10-31 23:39:55 +02:00
kijai cc9bf1e4f5 Store lora diffs in buffers for GGUF as well 2025-10-30 16:44:03 +02:00
kijai d2614a9a49 Merge branch 'main' into longcat 2025-10-29 02:33:37 +02:00
kijai 9d45b9f0de Use comfy core Conv3D workaround for VAE rather than the fp32 cast 2025-10-29 02:23:49 +02:00
chengzeyiandClaude d15cf3001f Fix dtype mismatch in ref_conv forward pass
This commit fixes a RuntimeError that occurs when using Fun-Control
reference images: "Input type (float) and bias type (c10::Half)
should be the same"

Root cause:
- Commit 1ba1a16 changed the dtype handling strategy to convert
  the main latent `x` to `base_dtype` instead of converting
  embeddings to match `x.dtype`
- This caused `fun_ref` input to be in a different dtype than
  the `ref_conv` layer's weights and bias
- Line 2324 already handles this correctly for `attn_cond` by
  converting to `self.attn_conv_in.weight.dtype`

Solution:
- Convert `fun_ref` to match `self.ref_conv.weight.dtype` before
  passing through the convolution layer
- This follows the same pattern used for `attn_cond` on line 2324

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-28 12:08:23 +00:00
kijai eebbcd5ee0 Update model.py 2025-10-28 02:04:50 +02:00
kijai 90908df260 Update model.py 2025-10-28 01:54:42 +02:00
kijai c80a488f70 Use fp32 norms for other models too and other fixes 2025-10-28 01:52:48 +02:00
kijai e560366600 Update model.py 2025-10-27 18:55:30 +02:00