Commit Graph
100 Commits
Author SHA1 Message Date
kijai f16d38a5d2 Add Enhance-A-Video
https://github.com/NUS-HPC-AI-Lab/Enhance-A-Video
2024-12-22 01:26:18 +02:00
kijai fcc0f3e65a Update pipeline_cogvideox.py 2024-12-20 17:00:42 +02:00
kijai 0758d2d016 fix 2024-12-17 09:10:03 +02:00
kijai b5eefbf4d4 Initial support for Fun 1.5
I2V works, interpolation doesn't seem to (not sure if it should)
2024-12-17 01:16:11 +02:00
Jukka Seppänen 795f8b0565 Merge pull request #311 from glide-the/fix_pos_embedding
Add cogvideox-2b-img2vid CogVideoXModelLoader support
2024-12-08 11:52:12 +02:00
kijai 729a6485ea expose sageattn 2.0.0 functions
_cuda versions seem to be required on RTX 30xx -series GPUs for sageattn + CogVideoX 1.5
2024-12-01 18:45:10 +02:00
kijai 411791c748 Update model_loading.py 2024-11-27 20:36:21 +02:00
kijai 7a10e732bb update cogvideox_Fun_180_orbit -example 2024-11-27 12:14:15 +02:00
Jukka Seppänen 1ade29084e Merge branch 'main' of https://github.com/kijai/ComfyUI-CogVideoXWrapper 2024-11-24 22:27:27 +02:00
Jukka Seppänen f1b3bc0abf error earlier if sageattention fails to import 2024-11-24 22:27:26 +02:00
kijai c71bca9350 Update pipeline_cogvideox.py 2024-11-24 18:34:00 +02:00
Jukka Seppänen 8d6e53b556 Allow compiling VAE as well 2024-11-23 17:08:57 +02:00
kijai 9baf100366 fix 2b image2vid 2024-11-22 23:13:14 +02:00
Jukka Seppänen 6c7068b5bc Update nodes.py 2024-11-22 22:38:51 +02:00
kijai 895d3b83a4 Update model_loading.py 2024-11-21 03:05:51 +02:00
kijai 276a045a57 use selected load device as LoRA load device too 2024-11-21 02:46:07 +02:00
kijai e52dc36bc5 Update model_loading.py 2024-11-20 21:28:53 +02:00
kijai e5fc7c1bf3 Allow mixing Fun and not fun loras 2024-11-20 21:24:51 +02:00
kijai e187cfe22f Allow loading the "Rewards" LoRAs into 1.5 as well (for what it's worth) 2024-11-20 19:18:40 +02:00
kijai 573150de28 fix Tora when no autocast 2024-11-20 16:41:34 +02:00
kijai b74aa75026 Don't use autocast with fp/bf16 2024-11-20 14:22:10 +02:00
Jukka Seppänen b9f7b6e338 Merge pull request #261 from Dango233/Dango233-patch-1
Fix fused sdpa
2024-11-20 12:37:26 +02:00
kijai ce329e0dce fix T2V 2024-11-20 10:17:11 +02:00
kijai de7e069286 fix noise augment 2024-11-20 02:12:56 +02:00
kijai 5cc570a467 Add start/end percent to image_conds 2024-11-20 02:07:29 +02:00
kijai b9688f3cd2 Add strength parameter for image encode 2024-11-20 01:32:05 +02:00
kijai ecd067260c Add CogVideoX-Fun-V1.1-5b-Control
https://huggingface.co/alibaba-pai/CogVideoX-Fun-V1.1-5b-Control
2024-11-20 01:23:54 +02:00
kijai c9efefe736 Update cogvideox_1_5_5b_I2V_01.json 2024-11-19 20:33:58 +02:00
kijai f7afa7d3be Update cogvideox_1_5_5b_I2V_01.json 2024-11-19 20:33:15 +02:00
kijai ebd6a3a4e8 update workflows to save_output enabled by default 2024-11-19 20:32:30 +02:00
kijai 41a0f33381 Update model_loading.py 2024-11-19 20:27:31 +02:00
kijai 1cfe0835f5 fix GGUF loader 2024-11-19 20:23:47 +02:00
kijai b0eabeba24 fix comfy attention output shape 2024-11-19 20:18:13 +02:00
kijai 822cb4ee1c Update cogvideox_1_5_5b_I2V_01.json 2024-11-19 20:02:22 +02:00
kijai 882faa6dea add comfyui attention mode 2024-11-19 19:55:51 +02:00
kijai cac1f81c51 Update pipeline_cogvideox.py 2024-11-19 19:42:09 +02:00
Jukka Seppänen fc647862b8 Merge pull request #194 from eltociear/patch-1
docs: update readme.md
2024-11-19 19:25:19 +02:00
kijai 516655b689 Update model_loading.py 2024-11-19 19:17:42 +02:00
kijai 67f2f6abb1 Merge branch 'refactor' 2024-11-19 19:16:39 +02:00
kijai feeff366b5 update 2024-11-19 19:06:15 +02:00
kijai 6302e4b668 Allow orbit LoRAs with Fun models as well 2024-11-19 15:49:43 +02:00
kijai f606d745e9 more examples 2024-11-19 15:34:14 +02:00
kijai 128f89c4d2 Update workflows, fix controlnet 2024-11-19 15:23:38 +02:00
kijai a7646c0d6f refactor
- unify all pipelines into one
- unify transformer model into one
- separate VAE
- add single file model loading
2024-11-19 03:04:22 +02:00
kijai 6f9e4ff647 Update custom_cogvideox_transformer_3d.py 2024-11-17 22:23:40 +02:00
kijai e70da23ac2 exclude sageattn from compile 2024-11-17 22:11:32 +02:00
kijai eebdc412f9 fix sageattention 2024-11-17 21:43:53 +02:00
kijai 15aa68c95d update 2024-11-17 00:48:01 +02:00
kijai 4374273138 possible compile fixes 2024-11-16 22:18:12 +02:00
kijai f21432bea1 tile decode by default 2024-11-16 19:36:13 +02:00
kijai bececf0189 some experimental optimizations 2024-11-16 17:32:31 +02:00
kijai 75e98906a3 rotary embed fix
https://github.com/huggingface/diffusers/pull/9877/commits/25a9e1c567f86bf6de538891d9f07c7f155e70af
2024-11-15 02:37:44 +02:00
kijai 832dad94bc flip width/height inputs to the sampler node (finally) 2024-11-14 19:57:38 +02:00
kijai 0bd3da569e code cleanup
codebase getting too bloated:
drop PAB support in favor of FasterCache
drop temporal tilling in favor of FreeNoise
2024-11-14 19:54:52 +02:00
kijai e8a289112f fix VAE scaling (again) 2024-11-13 15:37:45 +02:00
kijai 34b650c785 fun fixes 2024-11-12 19:29:55 +02:00
kijai 7ac2224ec2 Update nodes.py 2024-11-12 11:30:03 +02:00
kijai ba2dbfbeb4 fixes 2024-11-12 11:29:50 +02:00
kijai dac6a2a3ac allow limiting blocks to cache 2024-11-12 08:42:01 +02:00
kijai 0a121dba53 fix FasterCache 2024-11-12 07:39:00 +02:00
kijai 9681c83c1d Update nodes.py 2024-11-12 00:58:00 +02:00
kijai c8772c3aa0 Update nodes.py 2024-11-12 00:53:55 +02:00
kijai db697fea11 Update model_loading.py 2024-11-12 00:22:26 +02:00
kijai 00fde5ebce allow fused loras with fp8 2024-11-11 23:36:48 +02:00
kijai ea0273c8ec VAE fix, allow using fp32 VAE 2024-11-11 22:34:43 +02:00
kijai 6d4c99e77d Update model_loading.py 2024-11-11 19:58:17 +02:00
kijai 6931576916 update from upstream, ofs embeds 2024-11-11 18:53:12 +02:00
kijai 5f1a917b93 padding fix 2024-11-11 17:29:57 +02:00
kijai 43bc7fb4fc fix progress bars for vid2vid 2024-11-11 01:31:13 +02:00
kijai ca63f5dade update 2024-11-11 01:19:11 +02:00
kijai 184097e78e Update pipeline_cogvideox.py 2024-11-10 19:31:37 +02:00
kijai ed167ecfff allow scheduling cfg 2024-11-10 19:27:40 +02:00
kijai 87ed4a56cf Update model_loading.py 2024-11-10 18:19:35 +02:00
kijai ea5ee0b017 GGUF Q4 works 2024-11-10 18:13:44 +02:00
kijai fb246f95ef attention compile works with higher cache_size_limit 2024-11-09 22:56:50 +02:00
kijai a630bb3314 update 2024-11-09 22:17:10 +02:00
Jukka Seppänen 909d7026f3 Update model_loading.py 2024-11-09 20:20:15 +02:00
kijai 7162d1040d Update model_loading.py 2024-11-09 18:14:48 +02:00
kijai 75aa19b4e1 Update model_loading.py 2024-11-09 18:12:03 +02:00
kijai 634c22db50 sageattn 2024-11-09 17:05:55 +02:00
kijai 9a797229f2 check 2024-11-09 15:41:57 +02:00
kijai 1c3aff9000 some cleanup 2024-11-09 15:15:10 +02:00
kijai 643bbc18c1 i2v 2024-11-09 12:13:52 +02:00
Jukka Seppänen 2eb9b81d27 fp8 2024-11-09 04:41:07 +02:00
Jukka Seppänen 9a64e1ae5e Update model_loading.py 2024-11-09 04:16:46 +02:00
Jukka Seppänen b563994afc finally
works
2024-11-09 04:02:36 +02:00
Jukka Seppänen 9aab678a9e test 2024-11-09 03:15:21 +02:00
kijai e783951dad maybe 2024-11-09 02:24:18 +02:00
kijai 806a0fa1d6 Update model_loading.py 2024-11-08 21:31:31 +02:00
kijai 2074ba578e doesn't work yet 2024-11-08 21:24:20 +02:00
kijai f7a88cbd56 Update model_loading.py 2024-11-08 21:23:29 +02:00
kijai 4c2ce52f57 Update model_loading.py 2024-11-08 17:30:51 +02:00
Jukka Seppänen 4a597f1955 Update requirements.txt 2024-11-08 16:43:32 +02:00
kijai 1cc6e1f070 use diffusers LoRA loading to support fusing for DimensionX LoRAs
https://github.com/wenqsun/DimensionX
2024-11-08 14:24:32 +02:00
kijai 07defb52b6 Add compile_args node 2024-11-07 23:17:37 +02:00
kijai 9cce8015d3 Update model_loading.py 2024-11-07 23:02:52 +02:00
kijai f52c45800c allow 2nd GPU as FasterCache device
experimental
2024-11-07 19:42:59 +02:00
kijai f7f999adbc Update pipeline_cogvideox_inpaint.py 2024-11-07 14:19:25 +02:00
kijai 3eeadd52ea Update readme.md 2024-11-07 13:10:46 +02:00
kijai 9202921920 Refactor Fun sampler to be easier to use with Tora (breaks old workflows!)
The FunSampler node in old workflows needs to be remade. I moved the forced bucket resize to it's own node if anyone still wants to use that.
2024-11-07 13:01:34 +02:00