Commit Graph
430 Commits
Author SHA1 Message Date
kijai 801f543a7a Allow LoRA timestep scheduling
LoRA strength can now be a list of floats that represents the strength at any given step
2025-08-04 00:02:19 +03:00
kijai 88b5feb1ed Fix VRAM management (again) 2025-08-03 22:35:24 +03:00
Jukka Seppänen 1654741cdf Merge pull request #955 from SD-inst/error_propagation
Propagate errors to frontend
2025-08-03 22:03:30 +03:00
kijai 5cde6f2216 Fix T5 double RAM use 2025-08-03 12:28:25 +03:00
rkfg 00875a65a6 Propagate errors to frontend 2025-08-02 20:29:55 +03:00
kijai e9b537f23c Update nodes.py 2025-08-02 19:35:02 +03:00
kijai 7074688ced Add prompt extension with local Qwen 2025-08-02 19:27:26 +03:00
kijai 907d1b0b0f 5B + context windows 2025-08-02 00:34:10 +03:00
kijai 25fe9ea642 handle cancellation better 2025-08-01 21:57:08 +03:00
kijai 168f3ccbee Update nodes.py 2025-08-01 21:24:35 +03:00
kijai d9be7b9c26 Allow other schedulers for 5B 2025-08-01 21:21:55 +03:00
kijai e05864e751 Update nodes.py 2025-08-01 18:31:40 +03:00
kijai 83bb0e7f35 fp8 text encoder fixes 2025-08-01 17:42:32 +03:00
kijai 8321e19009 Fix single text encoder after previous change 2025-08-01 14:45:29 +03:00
kijai 5406a72f62 Improve text encoder cache and add alternative node which leaves nothing to memory after encoding
WanVideoTextEncodeCached -node will load T5 when the prompt is not found in the cache, then unload it completely.
2025-08-01 12:36:19 +03:00
kijai 9edab74562 Default non_blocking to False
too many RAM issues
2025-08-01 02:29:07 +03:00
kijai 5bacc50088 Add safety check for context windows to avoid crash on tensor slicing 2025-07-31 17:09:05 +03:00
kijai b60814fb6b Fix split prompting, get rid of diffusers on model class 2025-07-31 15:11:47 +03:00
kijai ef23a6213d return denoised samples as well for previewing unfinished latents 2025-07-31 12:50:10 +03:00
kijai 0cc4583653 flowedit fix 2025-07-31 12:21:40 +03:00
kijai e545b18627 vid2vid fix
Need to use add_noise_to_samples = True now for vid2vid, defaulting to False to not break 2.2 dual sampler workflows, but hardcode to always be True if denoise is used to not break old workflows
2025-07-30 19:41:51 +03:00
kijai ec066008a8 Make start/end step work with vid2vid 2025-07-30 15:59:22 +03:00
kijai 6ef3ee83ef Update nodes.py 2025-07-30 00:40:42 +03:00
kijai 6875b99611 remove this for now 2025-07-29 02:33:20 +03:00
kijai 5238f40fe3 Update nodes.py 2025-07-29 02:20:20 +03:00
kijai a3032e4363 clear lora patches first 2025-07-29 01:45:25 +03:00
kijai 7e290c67bf Fix comfy progress bar when not doing full steps 2025-07-28 23:16:06 +03:00
kijai 498c6859fe Merge branch 'pr/883' 2025-07-28 22:16:48 +03:00
kijai 08d4569794 Update nodes.py 2025-07-28 21:42:35 +03:00
kijai d6e9af7090 2.2 stuff 2025-07-28 21:38:40 +03:00
kabachuha fd285a7e7d implement tangential guidance 2025-07-28 21:08:10 +03:00
kijai ee6e790d80 Update nodes.py 2025-07-28 09:50:50 +03:00
kijai 5e725ff8fb Allow running T5 no cpu
This is actually surprisingly fast, on AMD Ryzen 9 9900X it's faster to not move the T5 to GPU than to keep it on CPU all the way.
2025-07-28 09:39:36 +03:00
kijai f61aae6158 minimax + context windows 2025-07-27 17:10:41 +03:00
kijai f86d2b84a0 Update nodes.py 2025-07-27 15:34:57 +03:00
kijai 3567202e75 Fix compile and support radial attn in the DF sampler 2025-07-27 14:19:31 +03:00
kijai df1476bf42 Support EchoShot
https://github.com/D2I-ai/EchoShot
2025-07-26 18:51:29 +03:00
kijai 5c36a4b111 minor memory tweaks 2025-07-26 14:19:07 +03:00
kijai 3157e0389e Update nodes.py 2025-07-26 11:50:24 +03:00
kijai a35eb7dfa4 Basic sageattn3 support
Probably going to need further timestep scheduling as the quality of sage3 on it's own is pretty bad.
2025-07-25 20:48:34 +03:00
kijai b3820055d0 Fix GGUF with LoRAs and support GGUF witgh SetLoras -node 2025-07-24 14:59:59 +03:00
kijai 35e637cbfd Allow merging LoRA to fp8 scaled models 2025-07-24 11:51:36 +03:00
kijai 59cd0dc272 Update nodes.py 2025-07-23 18:11:15 +03:00
kijai bdce322e65 remove loras if SetLora bypassed/disconnected 2025-07-23 17:51:59 +03:00
kijai 3ed58330d9 better 2025-07-23 16:56:33 +03:00
kijai 65ac9fa6d9 cache positive and negative separately, add cache to single encode node as well 2025-07-23 16:33:11 +03:00
kijai 5e56e3649f fix control lora 2025-07-23 16:20:30 +03:00
kijai 0212ad7a2d cache only the prompts
so we can disconnect T5 completely if text embed exists in cache
2025-07-23 15:33:32 +03:00
kijai 1a1af02912 Allow using different init image for context windows beyond first one
This can be useful with models like MAGREF that behave differently when the init image is padded with white, idea is to use full init for first window and padded image for the rest, so that it works more like reference and doesn't force the window to snap back to the init.
2025-07-23 12:51:57 +03:00
kijai fa93f5b3c1 Add optional prompt disk caching
Caches text embeds to disk with unique hash based on T5 name, dtype and prompts. If found on disk skips encoding, persists after restarts.
2025-07-23 00:52:56 +03:00