Add sageattn mode that allows torch.compile
Latest wheel from woct0rdho includes the torch.compile fix: https://github.com/woct0rdho/SageAttention/releases Based on my quick testing this reduces peak VRAM usage a bit when running sageattn + torch.compile
This commit is contained in:
@@ -1002,6 +1002,7 @@ class WanVideoModelLoader:
|
||||
"sageattn",
|
||||
"sageattn_3",
|
||||
"radial_sage_attention",
|
||||
"sageattn_compiled",
|
||||
], {"default": "sdpa"}),
|
||||
"compile_args": ("WANCOMPILEARGS", ),
|
||||
"block_swap_args": ("BLOCKSWAPARGS", ),
|
||||
|
||||
Reference in New Issue
Block a user