7 Commits
Author SHA1 Message Date
CoreyCorza 8b48379d2d Clarify gate_strength wording (1 = full effect, 0 = strip from gates) 2026-07-05 07:32:30 +10:00
CoreyCorza 3c67b84f31 Add gate_strength: scale LoRA effect on gated-attention/SwiGLU gate layers
Krea 2 (and other gated DiTs) put multiplicative sigmoid gate projections
(attn.gate / mlp.gate) in every block - ~25% of a Krea 2 LoRA. Their edits
have outsized, compounding effect (stacked LoRAs fighting -> deformities)
but are modest in norm, so tame_layers misses them. gate_strength targets
them by name and scales just those layers. Wired into both nodes; non-gate
layers left untouched. Bump 1.2.0.
2026-07-05 07:20:01 +10:00
Corza 0a251b14c2 Merge pull request #1 from ethanfel/main
Add inline applied LoRA cleaner
2026-07-05 06:30:22 +10:00
Ethanfel bb8688ca8c Add inline applied LoRA cleaner 2026-07-04 22:11:53 +02:00
CoreyCorza 3e9e1d19cd Add STAR rescale option (arXiv:2502.10339)
After keep_energy truncates a layer, optionally rescale the kept singular
values so the layer's nuclear norm matches the original — removes the
conflict-prone tail without weakening the LoRA's effect. Off by default.
2026-07-05 05:52:02 +10:00
Corza 4690722913 Refine README description for LoRA loader
Simplified the description of the LoRA loader and removed unnecessary details about cleaning artifacts.
2026-07-05 01:33:30 +10:00
CoreyCorza 50d9649dfa Corza LoRA Loader (Clean): spectral cleanup LoRA loader
Drop-in LoRA loader with optional per-layer SVD energy trimming (kohya
resize math) and hot-layer taming to reduce artifacts from stacked LoRAs
and turbo/distilled models. Passes through DoRA/tucker/unknown keys and
hands the cleaned state dict to ComfyUI's standard load_lora_for_models.
2026-07-05 01:27:42 +10:00