William Lin
9f59519959
[misc] Remove DreamX World, HunyuanGameCraft, GLM-Image, LongCat, TurboDiffusion, and Z-Image ( #1926 )
2026-10-14 23:16:32 -07:00
Zhang Peiyuan and Claude Opus 5.5
c520878fd2
[perf]: QAT/QAD add safe regional compile for modular training ( #1718 )
...
Adds opt-in regional torch.compile to the YAML-driven modular Wan trainer (training.model.enable_torch_compile / torch_compile_kwargs) with FA4 and Wan modulation forward/backward as opaque custom ops, compiled repeated DiT blocks after FSDP setup, and activation checkpointing applied before FSDP for trainable Wan transformers.
Merged with main's #1716 (WanModel resolves the checkpointing type in __init__; the PR's pre-FSDP wrap uses it and the post-load wrap is gone) and #1757 (pre_fsdp_model_transform runs before this PR's pre_fsdp_transform). Maintainer review (Swarm order #776 ): AdaLN skip names are canonicalized through checkpoint-wrapper prefixes, test_inference_regional_compile.py joins the unit lane, the Wan modulation custom-op test moved to the transformer lane, regional_compile is classified in the schema inventory, and a 1/2-GPU training smoke covers fully_shard(CheckpointWrapper) in eager and regional-compile modes. Validated on GB200: the FA4 CuTe forward/backward parity and fullgraph-backward tests and all four smoke cases pass.
Also exempts MMAudio recipes, whose student builds its pipeline config at init, from the fine-tuning recipe construction check that #1648 left failing on main.
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 05:24:24 -07:00
3467f8befb
[feat] Add end-to-end MMAudio V2A training, inference, and evaluation ( #1648 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 04:25:00 -07:00
2d6e7d9b6b
[feat]: MiniMax-H3 encoder split: dedicated text-encoder node group for 720p on DGX Spark ( #1877 )
...
Co-authored-by: magicbear <magicbear@users.noreply.github.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 03:46:33 -07:00
2452022f15
[new-model] Add LTX-2.5 inference support ( #1704 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: CodeRabbit <noreply@coderabbit.ai >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 03:34:18 -07:00
d5287f8352
[feat]: add MiniMax H3 Ref2VA and LoRA training support ( #1757 )
...
Co-authored-by: William Lin <8941107+SolitaryThinker@users.noreply.github.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 03:21:45 -07:00
ef62ac48d1
[new-model] Add Wan2.2-S2V-14B speech-to-video (model port + checkpoint converter) ( #1683 )
...
Co-authored-by: SuhaanCommits <suhaan@cedar.build >
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-10-07 01:36:01 -07:00
8b51380466
[feat]: FastH3 on single RTX GPUs ( #1919 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
Co-authored-by: Aryan Kumar <aryank@Aryans-Mac-Studio.local >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-06 11:37:01 -07:00
f06d824054
[feat]: add Kandinsky-6.0 TI2VA and VSR pipelines ( #1924 )
...
Co-authored-by: leffff <levnovitskiy@gmail.com >
Co-authored-by: Kirill <kykozlov@gmail.com >
Co-authored-by: shaoxiongduan <shaoxiongduan@gmail.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-06 10:50:17 -07:00
Kyle Hu
3a3ad3d209
[feat]: NVFP4 text encoder for MiniMax H3 ( #1837 )
2026-09-12 18:31:59 -07:00
William Lin and shaoxiongduan
a534ba20a0
[feat] Add MiniMax H3 LoRA inference and preview launchers ( #1771 )
...
Co-authored-by: shaoxiongduan <shaoxiongduan@gmail.com >
2026-08-27 14:43:39 -07:00
KyleNeverGivesUp
c9c5585758
[perf]: MiniMax H3 on GB10 - skip text encoder CPU offload on unified memory (5m49s to 30ms) ( #1710 )
2026-08-26 12:03:14 -07:00
William Lin
f9e3680f11
[perf] Align FastH3 optimized inference profile ( #1748 )
2026-08-23 02:01:03 -07:00
William Lin
d3cff517cd
[perf] Add opt-in regional fullgraph compile for DiT inference ( #1741 )
2026-08-22 12:14:39 -07:00
Junda Su
2f3d407406
[perf] Optimize MiniMax H3 VAE decoding ( #1734 )
2026-08-21 14:57:32 -07:00
Kaiqin Kong
bcffa4026e
[perf] Optimize MiniMax-H3 text encoder memory ( #1732 )
2026-08-21 14:57:06 -07:00
Kai
0653f8f3af
[new-model] Add V2A: native MMAudio inference pipeline ( #1622 )
2026-08-09 17:29:27 -07:00
William Lin
9028953625
[misc] yapf pass under CI's interpreter (3.12) + pin hook language_version ( #1702 )
2026-08-08 22:24:17 -07:00
Kaiqin Kong
e8b0e4c61e
[feat] Add MiniMax H3 ( #1674 )
2026-08-04 13:54:39 -07:00
William Lin
7b094c945b
[refactor]: resolve attention backend once per component at load time ( #1657 )
2026-08-02 15:07:42 -07:00
Junda Su
d4bdd3621a
[new-model] Port LingBot-World-v2 ( #1579 )
2026-07-16 19:51:53 -07:00
6966f9e0bc
[fix] Z-Image ( #1236 ) draft port: rebase + strict-load contract + bf16 encoder parity + PORT_STATUS ( #1339 )
...
Co-authored-by: Mrinaal Dogra <mdogra@ucsd.edu >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-16 18:18:25 -07:00
Shreejith SG and H1yori233
d82abc271e
[feat] Add GLM-Image inference support ( #1030 )
...
Co-authored-by: H1yori233 <k1kong@ucsd.edu >
2026-07-12 22:42:42 -07:00
02e1143f22
[feat] Add Kandinsky-5 T2V/I2V pipeline support ( #1471 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
Co-authored-by: leffff <levnovitskiy@gmail.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-07 14:43:30 -07:00
e60601df7f
[feat] QAD 5090: QAT training recipe — finetune + DMD distillation (12/12) ( #1462 )
...
Co-authored-by: William Lin <SolitaryThinker@users.noreply.github.com >
Co-authored-by: Loay Rashid <42599591+loaydatrain@users.noreply.github.com >
Co-authored-by: Kaiqin Kong <k1kong@ucsd.edu >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-17 15:18:52 -07:00
d922ab2cbc
[model] Flux2 Klein Port ( #1349 )
...
Co-authored-by: Gnav3852 <63612880+Gnav3852@users.noreply.github.com >
Co-authored-by: Mac Lee <macthecadillac@gmail.com >
2026-06-09 14:55:55 -07:00
Kaiqin Kong and SolitaryThinker
afdb6fbfa5
[feat] Add MatrixGame3.0 ( #1201 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-05-27 21:07:01 +00:00
b4de5a9f1b
[feat] Dreamverse 12/14: Add LTX2 refine and upsampler support ( #1335 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com >
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com >
2026-05-15 12:21:40 -07:00
William Lin
424c643b6e
[feat]: MagiHuman pipeline stages (4/8) ( #1298 )
2026-05-12 14:59:21 -07:00
William Lin
c77a76c6af
[feat] Stable Audio Open 1.0: T2A + A2A + RePaint inpainting (native) ( #1260 )
2026-05-01 00:07:11 -07:00
vishruthb
5789955bbe
[feat] add gen3c (cosmos-7b) model and pipeline support ( #1059 )
2026-04-01 11:42:02 +00:00
Zhang Peiyuan
03d9ce2edb
[Misc] Remove StepVideo ( #1118 )
2026-02-21 17:15:42 -08:00
10fc92dba5
Upstream LTX2 Training ( #1116 )
...
Co-authored-by: RandNMR73 <notomatthew31@gmail.com >
Co-authored-by: JerryZhou54 <zhouw.jerry2017@outlook.com >
Co-authored-by: Davids048 <jundasu@ucsd.edu >
Co-authored-by: Peiyuan Zhang <a1286225768@slurm-h200-204-239.slurm-compute.tenant-slurm.svc.cluster.local >
2026-02-21 16:06:55 -08:00
Ishan and Jinzhe Pan
0aff68f51d
[Feat] Add Stable Diffusion 3.5 ( #1075 )
...
Co-authored-by: Jinzhe Pan <eigensystem1318@gmail.com >
2026-02-10 14:31:36 +08:00
Wei Zhou
98308db7e0
[Feature] [Hy1.5] Support HY1.5 super-resolution pipeline for 1080p videos ( #1046 )
2026-02-05 16:39:20 -08:00
Mingjia Huo
59e00f6164
[feat] Add HY-World1.5-Bidirectional-480P-I2V ( #1027 )
...
VAE requires further improvement, will raise PR in near future.
2026-01-23 14:18:04 -08:00
Shao Duan and Will Lin
029216029f
Added LTX-2 Distilled T2V Generation ( #1016 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-01-21 14:11:39 -08:00
XOR-op
785d123e36
[feat] Hooks API and layerwise offloading for all DiTs ( #1006 )
2026-01-17 11:22:02 -08:00
William Lin
0f53b51e6c
[CI] Fix OOM issues in ssim tests ( #1011 )
2026-01-16 21:15:20 -08:00
KyleShao
dbddfab6d2
[feat] Introduce Cosmos 2.5 Text2World pipeline ( #974 )
2026-01-15 15:09:05 -08:00
Ohm-Rishabh
d83f45a6a0
Layer offloading ( #966 )
2026-01-03 21:46:00 -08:00
XOR-op
dd91542cd1
[feat] Support text encoder weight override and quantization ( #983 )
2026-01-03 15:33:33 -06:00
alexzms and Shao Duan
8f1e6c3336
Add LongCat T2V (Base, Distillation and Refinement) Support to FastVideo ( #883 )
...
Co-authored-by: Shao Duan <shaoxiongduan@gmail.com >
2025-12-23 01:11:18 -06:00
Wei Zhou
1f70032af5
[New Model] Hunyuan1.5 ( #943 )
2025-12-21 00:57:52 -06:00
Jinzhe Pan and Xingyu Long
f4c58894d9
[Feat] add ray support ( #838 )
...
Co-authored-by: Xingyu Long <xingyulong97@gmail.com >
2025-10-16 23:17:54 -07:00
zyang6 and kiritorl
87489f0872
Add wan2.1 functionality support for Ascend NPU platform ( #810 )
...
Co-authored-by: kiritorl <1021709528@qq.com >
2025-10-09 16:25:08 -07:00
William Lin
490bde90e1
[bugfix] Allow overriding dit checkpoint for inference and Lower VSA LR in example scripts ( #831 )
2025-10-05 01:44:49 -07:00
dc7596b973
[self-forcing][8/n] Self-Forcing For Wan2.2-A14B + torch.compile training and distillation support ( #818 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-10-02 15:01:45 -07:00
William Lin
404cbf4f3c
[self-forcing] [6/n] Add Ode Init training ( #811 )
2025-09-22 17:58:19 -07:00
31f000d1cc
[self-forcing] [5/n] Add Self-Forcing distillation pipeline ( #808 )
...
Co-authored-by: RandNMR73 <notomatthew31@gmail.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2025-09-20 19:32:10 -07:00
William Lin