6 Commits
Author SHA1 Message Date
PozzettiAndrea dc9c59b347 proper attn backend integration 2026-02-16 19:27:33 +01:00
PozzettiAndrea aa09b4aae0 Add auto attention backend: sage > flash_attn > sdpa
Auto-detect best available attention backend by default.
Priority: sage (v3 Blackwell, v2 Ampere+) > flash_attn > sdpa.
Users can still force a specific backend from the dropdown.
2026-02-15 18:42:56 +01:00
PozzettiAndrea 71bb3f86bb Add configurable attention backends and memory management
- Add attention_dispatch module with sdpa, flash_attn (Tri Dao FA2/FA3),
  and sage (auto-detects v3 Blackwell/v2 Ampere+) backends
- Add attention and memory_mode options to loader node INPUT_TYPES
- Replace dual-path model init with meta device + assign=True loading
- Add handle_post_inference_memory with cache_gpu/cpu_offload/unload modes
- Update all inference nodes to use centralized memory handler
- Set flash_attn + cpu_offload as defaults in all workflow JSONs
2026-02-15 18:27:06 +01:00
Andrea Pozzetti cf90dddb0b corrected workflow inputs 2026-02-13 01:16:45 +01:00
Andrea Pozzetti 713d7e6374 fixed width height handling, started 3d point cloud 2025-11-19 20:07:26 +01:00
Andrea Pozzetti 9383844ff3 added mesh creation, fixed height/width warping 2025-11-19 00:49:10 +01:00