Basic sageattn3 support
Probably going to need further timestep scheduling as the quality of sage3 on it's own is pretty bad.
This commit is contained in:
@@ -717,6 +717,7 @@ class WanVideoModelLoader:
|
||||
"flash_attn_2",
|
||||
"flash_attn_3",
|
||||
"sageattn",
|
||||
"sageattn_3",
|
||||
"flex_attention",
|
||||
"radial_sage_attention",
|
||||
], {"default": "sdpa"}),
|
||||
|
||||
Reference in New Issue
Block a user