Files
hao-ai-lab-FastVideo/fastvideo
Raghav 70bd4bb756 [bugfix]: don't let a stale HF-passthrough marker override a moved encoder (#1339)
_fastvideo_input_device is stamped at load time with the loader's target
device, which is "cpu" when text_encoder_cpu_offload is on. encode_text then
moves such an encoder to the compute device for the forward, after which the
marker is stale. Honouring it fed cpu token ids to cuda weights:

  RuntimeError: Expected all tensors to be on the same device, but got index
  is on cpu, different from other tensors on cuda:0

Seen on FLUX.2 Klein, whose Qwen3 text encoder takes the HF-passthrough path.
Once the encoder has been moved, its param device is authoritative; the marker
only speaks when nothing moved and the module has no parameters of its own.
2026-07-13 17:26:46 -07:00
..
2026-06-09 14:55:55 -07:00
2026-06-04 14:22:49 -07:00