Commit Graph
100 Commits
Author SHA1 Message Date
kijai 666f7832f9 latent preview tests 2024-11-07 11:26:19 +02:00
kijai 0e8f8140e4 clear FasterCache after done 2024-10-31 02:03:59 +02:00
kijai 57262d9762 Update model_loading.py 2024-10-31 01:04:43 +02:00
kijai d314ddbe05 check that Tora trajectory length matches 2024-10-30 23:11:49 +02:00
kijai 133b42eb4f Add CogVideoXFunResizeToClosestBucket 2024-10-30 22:19:26 +02:00
kijai 5ba9b1d634 code cleanup 2024-10-30 21:30:03 +02:00
kijai dccc8bdcb7 Tora for fun context scheduling 2024-10-29 19:51:36 +02:00
kijai 3f97f07275 Deprecate CogVideoXFunVid2VidSampler and move it's functionality to CogVideoXFunSampler
too many nodes
2024-10-29 19:18:19 +02:00
kijai 5b4819ba65 support Tora for Fun -models 2024-10-29 10:44:09 +02:00
kijai 5fd4f67b14 bugfix update Tora workflows 2024-10-29 05:57:50 +02:00
kijai c813b5a199 typos 2024-10-29 05:50:50 +02:00
kijai 66ba4e1ee7 fix fastercache start step 2024-10-28 22:52:30 +02:00
kijai 4c5807397a Update nodes.py 2024-10-28 21:02:56 +02:00
kijai e9fc26b5e3 initial experimental FasterCache support for 2b models 2024-10-28 21:02:10 +02:00
kijai 21025c4742 Merge branch 'main' of https://github.com/kijai/ComfyUI-CogVideoXWrapper 2024-10-28 18:24:42 +02:00
kijai dec1f8ba0f Update nodes.py 2024-10-28 18:24:38 +02:00
Jukka Seppänen 750deb3918 Merge pull request #193 from Nim-Video/main
Add 2b img2vid cogvideox
2024-10-28 22:38:40 +09:00
kijai c17750ea0a remove print 2024-10-26 02:35:29 +03:00
kijai dcca095743 make torch compile work better 2024-10-26 02:33:29 +03:00
kijai 25f16462aa torch compile maybe 2024-10-25 22:50:13 +03:00
kijai 249e8d54d1 Add cogvideox-5b-controlnet-canny-v1 2024-10-25 22:46:37 +03:00
kijai f9c1e11851 diffusers backwards compatibility on tiled encode
for some reason it's tuple in 0.31.0
2024-10-25 21:49:48 +03:00
kijai 7fe4716f2d tile encode fix 2024-10-25 03:16:33 +03:00
kijai 9e488568b2 Support 5b controlnet 2024-10-23 19:23:50 +03:00
kijai ccddf0b271 Update nodes.py 2024-10-23 18:30:28 +03:00
Jukka Seppänen 5a024a0973 possibly fix for diffusers 0.31.0 2024-10-22 22:12:49 +03:00
kijai 2cc521062f correct Tora fuser dtype
I think...
2024-10-22 18:40:31 +03:00
kijai 15bf8f51ab Update nodes.py 2024-10-22 15:34:42 +03:00
kijai 45c3f06d0a Update nodes.py 2024-10-22 13:52:27 +03:00
kijai d3a753e8e5 Update pyproject.toml 2024-10-22 02:14:16 +03:00
kijai 7141ab23a5 Update pipeline_cogvideox.py 2024-10-22 01:58:34 +03:00
kijai 35cb4fde94 bugfixes 2024-10-22 00:52:58 +03:00
kijai c2299a6c79 Update cogvideox_5_tora_trajectory_example_01.json 2024-10-21 22:56:40 +03:00
kijai a654821515 testing Tora for I2V 2024-10-21 22:53:36 +03:00
kijai 81f8ca676e Update cogvideo_5b_vid2vid_example_01.json 2024-10-21 19:46:20 +03:00
kijai adfc560ad6 Add ToraEncodeOpticalFlow -node
For using custom optical flows as input for the Tora model
2024-10-21 18:19:15 +03:00
kijai 4c3fcd7b01 Support multiple LoRAs 2024-10-21 13:24:21 +03:00
kijai dc4bb73d3f fix logger 2024-10-21 09:45:23 +03:00
kijai 01bce7dfff Add Tora GGUF 2024-10-21 03:49:29 +03:00
kijai 8ed031417f Merge branch 'main' of https://github.com/kijai/ComfyUI-CogVideoXWrapper 2024-10-21 03:24:55 +03:00
kijai 256a638ee4 cleanup, bugfixes 2024-10-21 03:24:53 +03:00
Jukka Seppänen a614b24353 Update readme.md 2024-10-21 01:32:51 +03:00
kijai 7e8a3e4f2a Update nodes.py 2024-10-21 00:50:04 +03:00
kijai b33a127dc7 Update nodes.py 2024-10-21 00:49:07 +03:00
kijai 4d437dae66 Add Tora example workflow 2024-10-21 00:44:10 +03:00
kijai 47f028e0bd Update nodes.py 2024-10-21 00:29:44 +03:00
kijai e8bc2fd052 Initial Tora implementation
https://github.com/alibaba/Tora
2024-10-21 00:11:39 +03:00
kijai 8f9fa07455 Add GGUF for the interpolation model 2024-10-19 13:17:11 +03:00
Jukka Seppänen bdcfb1c9a8 Update readme.md 2024-10-18 13:10:27 +03:00
kijai 4f8f3aa74f Support CogVideoX-Interpolation -model
https://github.com/feizc/CogvideX-Interpolation
2024-10-17 13:41:23 +03:00
kijai 09ed641575 fix LoRA for I2V model when using fp8 2024-10-14 01:05:35 +03:00
kijai 0f5d67a9a9 Update nodes.py 2024-10-13 23:05:50 +03:00
kijai 42c46b76e1 Error on too long prompts. 2024-10-13 15:38:06 +03:00
kijai a995247624 possibly fix LoRA scaling 2024-10-12 22:23:54 +03:00
kijai 276b3b86d9 possible fix for NaNs when using LoRA and fp8 2024-10-12 02:24:53 +03:00
kijai ac5daa7148 fixes 2024-10-08 22:47:12 +03:00
kijai 032a849bc6 fp8 controlnet fixes 2024-10-08 20:53:43 +03:00
kijai ba694115c6 Update cogvideox_2b_controlnet_example_01.json 2024-10-08 20:29:41 +03:00
kijai 34475221d1 cast controlnet in fp8 if fp8 is enabled 2024-10-08 20:17:46 +03:00
kijai bf0f6888c2 fix fp8 with controlnet 2024-10-08 18:05:28 +03:00
kijai e047e6f07f controlnet with context windowing 2024-10-08 17:56:30 +03:00
kijai d76229c49b controlnet support
https://huggingface.co/TheDenk/cogvideox-2b-controlnet-hed-v1
https://huggingface.co/TheDenk/cogvideox-2b-controlnet-canny-v1
2024-10-08 16:22:07 +03:00
kijai d83f64aa3e don't break MZ loader for no reason 2024-10-08 14:53:19 +03:00
kijai e1a784d92b error out if trying to use I2V model with other frame counts than 49 2024-10-07 22:15:06 +03:00
kijai 3dcf92fe52 Merge branch 'main' of https://github.com/kijai/ComfyUI-CogVideoXWrapper 2024-10-07 13:05:21 +03:00
kijai 1ca1d0e006 Update cogvideox_5b_example_01.json 2024-10-07 13:05:14 +03:00
Jukka Seppänen a2200c47ba Update readme.md 2024-10-07 02:36:21 +03:00
Jukka Seppänen f657e0d56e allow tiny resolutions (it actually works with fun models) 2024-10-07 01:06:22 +03:00
Jukka Seppänen 49451c4a22 support sageattn
https://github.com/thu-ml/SageAttention
2024-10-06 20:26:03 +03:00
kijai 5e2e11dd0a Update pipeline_cogvideox_inpaint.py 2024-10-06 12:58:07 +03:00
kijai 502ebab83f support extra_model_paths 2024-10-06 12:39:57 +03:00
kijai af2a568c8e Update nodes.py 2024-10-06 11:54:47 +03:00
kijai fc7e7d7c62 peft 2024-10-06 11:53:38 +03:00
kijai d8a9f31de9 lora loading 2024-10-06 02:48:39 +03:00
kijai 5fde34468e update workflows 2024-10-06 02:22:35 +03:00
kijai 668ba792db Update pipeline_cogvideox.py 2024-10-06 01:50:31 +03:00
kijai 00d38f9a22 context schedule and all samplers for the non-Fun sampler as well 2024-10-06 01:28:20 +03:00
kijai 2be8f694b0 use proper length RoPE embeds with context windowing 2024-10-05 22:04:51 +03:00
kijai 1801c65e97 FreeNoise noise shuffling for context windows 2024-10-05 19:29:09 +03:00
kijai 6e82eb1618 Update nodes.py 2024-10-05 16:16:44 +03:00
kijai 453ee1606e Add context schedules for the control pipeline 2024-10-05 16:15:34 +03:00
kijai 033ec61d86 Update nodes.py 2024-10-04 13:19:13 +03:00
kijai 7af6666c67 latent input for the control sampler, allows vid2vid along with pose input 2024-10-04 13:14:54 +03:00
kijai 3c8183ac65 Support lora loading with fp8, noise augment for control input 2024-10-04 12:48:32 +03:00
kijai 3efe90ba35 Support CogVideoX-Fun lora loading 2024-10-04 01:53:40 +03:00
kijai 4fb602cad5 remove prints 2024-10-02 20:27:38 +03:00
kijai f9f06d595e temporal tiling for the control pipe 2024-10-02 20:14:45 +03:00
kijai bb6ea6b3a4 Update nodes.py 2024-10-02 18:39:15 +03:00
kijai a1f3ac4729 Update cogvideox_fun_pose_example_01.json 2024-10-02 18:11:16 +03:00
kijai 627af9341c separate control image encoder and add tiled encode support for it
tiled encoding code thanks to MinusZoneML:
https://github.com/MinusZoneAI/ComfyUI-CogVideoX-MZ/blob/main/mz_enable_vae_encode_tiling.py
2024-10-02 18:08:11 +03:00
kijai 3de0113927 Separate CogVideoX-Fun vid2vid and control samplers, add automatic tile size for decode 2024-10-01 17:09:44 +03:00
kijai 11554d70fb Update cogvideox_fun_pose_example_01.json 2024-10-01 16:23:29 +03:00
kijai 49ccc8eae8 Create cogvideox_fun_pose_example_01.json 2024-10-01 01:29:31 +03:00
kijai 03f237f925 fun pose GGUF 2024-10-01 00:07:32 +03:00
Jukka Seppänen f3a1ff933e Add control strenght, start and end percent adjustments 2024-09-30 17:50:48 +03:00
Jukka Seppänen dbeea9bfb8 Update nodes.py 2024-09-30 16:12:15 +03:00
kijai 55325f97a7 initial CogVideoX-Fun 1.1 support
every possible model/workflow combination not tested yet
2024-09-30 13:57:37 +03:00
kijai 513a2ab090 remove timm as unnecessary dependency 2024-09-24 19:29:39 +03:00
kijai 81adb0220b remove prints 2024-09-23 14:40:41 +03:00
kijai d0d7308da5 Experimenting with block removal 2024-09-23 14:17:34 +03:00