5 Commits
Author SHA1 Message Date
PozzettiAndrea aa09b4aae0 Add auto attention backend: sage > flash_attn > sdpa
Auto-detect best available attention backend by default.
Priority: sage (v3 Blackwell, v2 Ampere+) > flash_attn > sdpa.
Users can still force a specific backend from the dropdown.
2026-02-15 18:42:56 +01:00
PozzettiAndrea 71bb3f86bb Add configurable attention backends and memory management
- Add attention_dispatch module with sdpa, flash_attn (Tri Dao FA2/FA3),
  and sage (auto-detects v3 Blackwell/v2 Ampere+) backends
- Add attention and memory_mode options to loader node INPUT_TYPES
- Replace dual-path model init with meta device + assign=True loading
- Add handle_post_inference_memory with cache_gpu/cpu_offload/unload modes
- Update all inference nodes to use centralized memory handler
- Set flash_attn + cpu_offload as defaults in all workflow JSONs
2026-02-15 18:27:06 +01:00
Andrea Pozzetti 050237d38e updated node logic, normalisation logic, 3d logic. Co-Authored-By: Ltamann <ltamann@users.noreply.github.com> 2025-11-18 21:20:19 +01:00
Andrea Pozzetti 103b4f1fee updated docs/workflows 2025-11-18 19:04:47 +01:00
Andrea Pozzetti 8de03845c1 first draft 2025-11-18 18:58:47 +01:00