5 Commits
Author SHA1 Message Date
CoreyCorza 8b48379d2d Clarify gate_strength wording (1 = full effect, 0 = strip from gates) 2026-07-05 07:32:30 +10:00
CoreyCorza 3c67b84f31 Add gate_strength: scale LoRA effect on gated-attention/SwiGLU gate layers
Krea 2 (and other gated DiTs) put multiplicative sigmoid gate projections
(attn.gate / mlp.gate) in every block - ~25% of a Krea 2 LoRA. Their edits
have outsized, compounding effect (stacked LoRAs fighting -> deformities)
but are modest in norm, so tame_layers misses them. gate_strength targets
them by name and scales just those layers. Wired into both nodes; non-gate
layers left untouched. Bump 1.2.0.
2026-07-05 07:20:01 +10:00
Ethanfel bb8688ca8c Add inline applied LoRA cleaner 2026-07-04 22:11:53 +02:00
CoreyCorza 3e9e1d19cd Add STAR rescale option (arXiv:2502.10339)
After keep_energy truncates a layer, optionally rescale the kept singular
values so the layer's nuclear norm matches the original — removes the
conflict-prone tail without weakening the LoRA's effect. Off by default.
2026-07-05 05:52:02 +10:00
CoreyCorza 50d9649dfa Corza LoRA Loader (Clean): spectral cleanup LoRA loader
Drop-in LoRA loader with optional per-layer SVD energy trimming (kohya
resize math) and hot-layer taming to reduce artifacts from stacked LoRAs
and turbo/distilled models. Passes through DoRA/tucker/unknown keys and
hands the cleaned state dict to ComfyUI's standard load_lora_for_models.
2026-07-05 01:27:42 +10:00