Will Lin and Claude Fable 5
a43284ae1b
[bugfix]: swap cpu-offloaded text encoders to GPU for the forward
...
text_encoder_cpu_offload means params rest on CPU between calls but compute
on GPU: FSDP-wrapped encoders (T5/llama/clip) already get this via
CPUOffloadPolicy streaming, but encoders without _fsdp_shard_conditions
(reason1/Qwen2.5-VL) were parked on CPU and, after the encoder-device input
routing added for kandinsky5, silently ran their 7B forward on CPU (crashing
outright with flash-attn installed). Move plain CPU-parked encoders to the
target device for the forward and back afterwards, mirroring the
image-encoder/VAE offload pattern; FSDP (DTensor) encoders keep the existing
input routing. Revert the examples to text_encoder_cpu_offload=True now that
the default works. Verified e2e: T2V/I2V outputs are metric-identical to
GPU-resident runs, with ~12GB lower VRAM during denoising.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com >
2026-07-05 14:58:12 -07:00
Will Lin and Claude Fable 5
0434e9dcf0
[bugfix]: fix kandinsky5 registry detectors and distilled repo name
...
The i2v detector matched any path containing 'i2v' without excluding 't2v',
misrouting T2V checkpoints stored under i2v-containing directories. The
variant detectors all require lite/pro tokens, so the model_index _class_name
fallback ('kandinsky5t2vpipeline') could never match and I2V-Lite-distilled
checkpoints had no detector at all; add base T2V/I2V fallback registrations
after the variants. Also fix the registered Lite distilled repo to the real
kandinskylab/Kandinsky-5.0-T2V-Lite-distilled16steps-5s-Diffusers (the old
name 404s) and correct the example comments.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com >
2026-07-05 14:58:12 -07:00
Will Lin and Claude Fable 5
7a270e66be
[bugfix]: keep kandinsky5 example text encoders on GPU
...
text_encoder_cpu_offload=True makes the Qwen encoder compute on CPU, where
flash-attn has no kernels; with flash_attn installed both examples crash in
the first text-encoding forward. The offloaded path only worked in envs
without flash_attn via the silent SDPA fallback.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com >
2026-07-05 14:58:12 -07:00
leffff
562b951208
[feat] add support for Kandinsky 5 Pro, Lite I2V
2026-07-05 14:58:12 -07:00
leffff
313c2985f0
[feat] add support for Kandinsky5 I2V
2026-07-05 14:58:12 -07:00
leffff
b3b3858c02
[misc] add skeleton for Kandinsky5 I2V pipeline
2026-07-05 14:58:12 -07:00
leffff
f303d94780
add exmaple for kandinsky5 T2V Lite 5s
2026-07-05 14:58:12 -07:00
William Lin
b36d0ef085
[infra] Add DGX Spark and multi-architecture CUDA support ( #1447 )
2026-07-03 13:41:43 -07:00
alexzms
2a4fe697a6
[docs] LTX-2.3 distilled i2v: typed-API example (from_config + generate) ( #1448 )
2026-06-10 10:58:14 -07:00
alexzms
921db7479d
[perf] LTX-2.3 distilled i2v: drop max-autotune from compile kwargs ( #1445 )
2026-06-10 10:06:41 -07:00
Aryan Kumar and Aryan Kumar
7f539424cb
[feat]: add Lucy Edit inference scaffold ( #1363 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-06-09 15:21:43 -07:00
d922ab2cbc
[model] Flux2 Klein Port ( #1349 )
...
Co-authored-by: Gnav3852 <63612880+Gnav3852@users.noreply.github.com >
Co-authored-by: Mac Lee <macthecadillac@gmail.com >
2026-06-09 14:55:55 -07:00
alexzms and mergify[bot]
922e7e0813
[docs] LTX-2.3 distilled i2v example with compile + timing breakdown ( #1430 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-05 01:26:50 +00:00
Kaiqin Kong and SolitaryThinker
afdb6fbfa5
[feat] Add MatrixGame3.0 ( #1201 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-05-27 21:07:01 +00:00
Kaiqin Kong and mergify[bot]
773d44b875
[misc] Rename MatrixGame to MatrixGame2 ( #1357 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-17 22:57:03 -07:00
d2ffec5cce
[perf] Dreamverse 14/14: Add LTX2 profile speedups ( #1337 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com >
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com >
2026-05-15 18:10:47 -07:00
William Lin
140bd1a6cf
[misc]: standardize install instructions on uv pip install ( #1279 )
2026-05-02 12:45:50 -07:00
William Lin
c77a76c6af
[feat] Stable Audio Open 1.0: T2A + A2A + RePaint inpainting (native) ( #1260 )
2026-05-01 00:07:11 -07:00
William Lin
145a3f166b
[feat] [4/n] Improve API: refactor sampling param and merge with presets ( #1234 )
2026-04-16 14:10:02 -07:00
William Lin
c591d6d2a6
[feat] [2/n] Improve API: add initial support in video_generator ( #1220 )
2026-04-06 10:33:54 -07:00
vishruthb
5789955bbe
[feat] add gen3c (cosmos-7b) model and pipeline support ( #1059 )
2026-04-01 11:42:02 +00:00
Zhang Peiyuan
cd1b7cf139
[Refactor] SP Mask --> original seq len; HunyuanVideo 1.5 does not need mask ( #1142 )
2026-03-04 11:44:47 +08:00
10fc92dba5
Upstream LTX2 Training ( #1116 )
...
Co-authored-by: RandNMR73 <notomatthew31@gmail.com >
Co-authored-by: JerryZhou54 <zhouw.jerry2017@outlook.com >
Co-authored-by: Davids048 <jundasu@ucsd.edu >
Co-authored-by: Peiyuan Zhang <a1286225768@slurm-h200-204-239.slurm-compute.tenant-slurm.svc.cluster.local >
2026-02-21 16:06:55 -08:00
8e39ce38c9
[Feat] Native dit implementation for SD3.5 ( #1093 )
...
Co-authored-by: Ishan Vaish <vaish.ishan@gmail.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-02-18 10:19:40 +08:00
Mihir Jagtap
7a83e0e6fc
[feature] Add Hunyuan-GameCraft model support ( #1071 )
2026-02-14 08:07:44 +08:00
Shao Duan and Will Lin
7f795600c8
[bugfix] Fixed ltx2 base cfg guidance ( #1095 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-02-13 11:53:11 -08:00
Kaiqin Kong
31c0f1b341
[feat] Port LingBot-World-Base (Cam) ( #1081 )
2026-02-10 11:12:33 -08:00
William Lin
4bee0fa199
[misc] cleanup assets/ and demo/ ( #1091 )
2026-02-10 02:26:09 -08:00
530e6b8363
[Model] LTX 2 Base ( #1064 )
...
Co-authored-by: Davids048 <jundasu@ucsd.edu >
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-02-10 01:11:17 -08:00
Ishan and Jinzhe Pan
0aff68f51d
[Feat] Add Stable Diffusion 3.5 ( #1075 )
...
Co-authored-by: Jinzhe Pan <eigensystem1318@gmail.com >
2026-02-10 14:31:36 +08:00
ad58f802f3
[Feat] Port LTX2 trainer ( #1074 )
...
Co-authored-by: Davids048 <jundasu@ucsd.edu >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
2026-02-09 17:32:57 -08:00
Wei Zhou
98308db7e0
[Feature] [Hy1.5] Support HY1.5 super-resolution pipeline for 1080p videos ( #1046 )
2026-02-05 16:39:20 -08:00
Mingjia Huo
aae48a7e90
[feat] HYworld VAE with cache ( #1057 )
2026-02-05 04:18:17 -08:00
KyleShao and Will Lin
e10b26a3d8
[feat] Add Cosmos 2.5 I2W/V2W support (staged pipeline + examples) ( #1021 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-02-04 14:19:30 -08:00
Kaiqin Kong
0c6862ca55
[feature] Add Matrix Game 2.0 training ( #1017 )
...
The CI tests are quite unstable, but since multiple CI tests indicates that each individual tests are passed, I think we can merge this.
2026-01-26 19:21:43 -08:00
Mingjia Huo
59e00f6164
[feat] Add HY-World1.5-Bidirectional-480P-I2V ( #1027 )
...
VAE requires further improvement, will raise PR in near future.
2026-01-23 14:18:04 -08:00
Shao Duan and Will Lin
029216029f
Added LTX-2 Distilled T2V Generation ( #1016 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-01-21 14:11:39 -08:00
KyleShao
dbddfab6d2
[feat] Introduce Cosmos 2.5 Text2World pipeline ( #974 )
2026-01-15 15:09:05 -08:00
XOR-op
b7f69c2c1d
[feat!] Disable FSDP inference by default ( #1001 )
2026-01-13 14:20:05 -08:00
f4704847c2
[bugfix] Add configs for TurboDiffusion T2V/I2V models ( #993 )
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-01-06 16:36:45 -06:00
Shao Duan
d6651afd2e
[examples] Added longcat-video python api examples ( #994 )
2026-01-06 15:03:42 -06:00
William Lin
2f0a2b3c57
[misc] add pin_cpu_memory false for RTX 4090 ( #990 )
2026-01-05 15:45:35 -06:00
Loay Rashid
e7748d9952
[feat] add Turbodiffusion I2V pipeline ( #984 )
2026-01-05 15:41:23 -06:00
Kaiqin Kong
581e8115fe
[feat] support Matrix-Game 2.0 streaming generation ( #957 )
2026-01-02 19:14:38 -06:00
Loay Rashid
dea69cf651
[New Model] Turbodiffusion ( #971 )
2026-01-02 17:55:56 -06:00
Wei Zhou
1f70032af5
[New Model] Hunyuan1.5 ( #943 )
2025-12-21 00:57:52 -06:00
Kaiqin Kong
8fe1689968
[feat] Add Matrix-Game 2.0 ( #938 )
2025-12-20 14:09:12 -06:00
Loay Rashid
e53730f324
[docs] Minor Fixes ( #942 )
2025-12-19 16:48:16 -06:00
Wei Zhou
bef8169bb1
[Feat] [I2V] resize all image sizes to below 480*832 ( #890 )
2025-11-20 00:08:36 -08:00
e3b4564d5a
[feat] Add inference for MoE SF ( #880 )
...
Co-authored-by: RandNMR73 <notomatthew31@gmail.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2025-11-19 13:16:24 -08:00
