13 Commits
Author SHA1 Message Date
PozzettiAndrea 1e29002780 env bump 2026-02-17 19:16:47 +01:00
PozzettiAndrea dc9c59b347 proper attn backend integration 2026-02-16 19:27:33 +01:00
PozzettiAndrea aa09b4aae0 Add auto attention backend: sage > flash_attn > sdpa
Auto-detect best available attention backend by default.
Priority: sage (v3 Blackwell, v2 Ampere+) > flash_attn > sdpa.
Users can still force a specific backend from the dropdown.
2026-02-15 18:42:56 +01:00
PozzettiAndrea 71bb3f86bb Add configurable attention backends and memory management
- Add attention_dispatch module with sdpa, flash_attn (Tri Dao FA2/FA3),
  and sage (auto-detects v3 Blackwell/v2 Ampere+) backends
- Add attention and memory_mode options to loader node INPUT_TYPES
- Replace dual-path model init with meta device + assign=True loading
- Add handle_post_inference_memory with cache_gpu/cpu_offload/unload modes
- Update all inference nodes to use centralized memory handler
- Set flash_attn + cpu_offload as defaults in all workflow JSONs
2026-02-15 18:27:06 +01:00
Andrea Pozzetti cf90dddb0b corrected workflow inputs 2026-02-13 01:16:45 +01:00
Andrea Pozzetti c1fedda17d fixed preview 2025-11-19 22:10:25 +01:00
Andrea Pozzetti 713d7e6374 fixed width height handling, started 3d point cloud 2025-11-19 20:07:26 +01:00
Andrea Pozzetti 9383844ff3 added mesh creation, fixed height/width warping 2025-11-19 00:49:10 +01:00
Andrea Pozzetti 050237d38e updated node logic, normalisation logic, 3d logic. Co-Authored-By: Ltamann <ltamann@users.noreply.github.com> 2025-11-18 21:20:19 +01:00
Andrea Pozzetti 4025226a44 updated tutorials 2025-11-18 19:16:47 +01:00
Andrea Pozzetti 2024ff38d7 updates 2025-11-18 19:15:47 +01:00
Andrea Pozzetti 103b4f1fee updated docs/workflows 2025-11-18 19:04:47 +01:00
Andrea Pozzetti 8de03845c1 first draft 2025-11-18 18:58:47 +01:00