Commit Graph
5 Commits
Author SHA1 Message Date
li-lizhe 43681aebea fix(offload): resolve the group offloading transfer stream from the onload device (#528)
The vendored group-offloading helper (see the "Modified from .../diffusers/v0.36.0"
header) resolved its data-transfer stream by probing for CUDA/XPU only, so
`gpu_memory_mode="model_group_offload"`, which calls `apply_group_offloading(..., use_stream=True)`,
raised on a host whose accelerator is neither of those:

    ValueError: Using streams for data transfer requires a CUDA device, or an Intel XPU device.

even when the accelerator's backend implements streams (for example Ascend NPU, where
`torch.cuda.is_available()` is False while `torch.npu` is available and provides `Stream`).

Resolve the stream from the onload device's own backend instead, and keep rejecting devices
whose backend cannot stream, with a message that names the device type. This is the same
policy upstream diffusers applies in the function this file is derived from.

Signed-off-by: li-lizhe <147392333@qq.com>
2026-10-27 23:15:38 +08:00
Bubbliiiing 4b7b6402a1 Upgrade GPU Memory Mode architecture (#521) 2026-09-29 19:18:17 +08:00
Bubbliiiing b0acf916c2 Update Lingbot Worl, Lingbot Video, Minimax-H3 and Minimax-H3 Control (#506) 2026-08-24 16:47:38 +08:00
Bubbliiiing ad72867c0f Fix Bug in Group Offload when diffusers version is low. (#474) 2026-03-10 15:02:16 +08:00
Bubbliiiing 95737c8f1d Update Qwen Image Comfyui and pyproject.toml (#437) 2026-01-20 21:03:57 +08:00