[bugfix]: keep kandinsky5 example text encoders on GPU

text_encoder_cpu_offload=True makes the Qwen encoder compute on CPU, where
flash-attn has no kernels; with flash_attn installed both examples crash in
the first text-encoding forward. The offloaded path only worked in envs
without flash_attn via the silent SDPA fallback.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
Will Lin
2026-07-07 14:35:48 -07:00
committed by SolitaryThinker
co-authored by Claude Fable 5
parent b0dd449e5d
commit 539884b9ba
2 changed files with 2 additions and 2 deletions
@@ -14,7 +14,7 @@ def main():
use_fsdp_inference=False,
dit_cpu_offload=False,
vae_cpu_offload=False,
text_encoder_cpu_offload=True,
text_encoder_cpu_offload=False,
pin_cpu_memory=True,
# image_encoder_cpu_offload=False,
)
@@ -12,7 +12,7 @@ def main():
use_fsdp_inference=False,
dit_cpu_offload=False,
vae_cpu_offload=False,
text_encoder_cpu_offload=True,
text_encoder_cpu_offload=False,
pin_cpu_memory=True,
# image_encoder_cpu_offload=False,
)