Arunkumar Eli and Aryan Kumar
edd517e3fa
[bugfix] Make torch.compile reduce-overhead work in the shared denoising loop (Wan T2V) ( #2047 )
...
Co-authored-by: Aryan Kumar <156166681+aryan5v@users.noreply.github.com >
2026-11-07 23:55:36 +00:00
William Lin
cdda1b7535
[feat] Add H3 PDD/DMPDD training and packed Ref2VA preprocessing ( #1984 )
2026-10-20 11:15:57 -07:00
376e445f0e
[feat]: FastH3 OmniRef inference on consumer devices (RTX 5090 / PRO 6000 / DGX Spark / 4090) ( #1980 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-19 14:57:36 -07:00
2099dd5533
[feat]: Community MiniMax-H3 LoRA loading with quantized side branch ( #1973 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-10-19 14:29:23 -07:00
lpc0220 and root
d4ed61cc7c
[refactor] VSA: rename the sm100a block-sparse kernel to ptx_blackwell ( #1956 )
...
Co-authored-by: root <root@ptyche0124.ptyche.clusters.nvidia.com >
2026-10-17 21:10:19 -07:00
Zhang Peiyuan and Claude Opus 5.5
c520878fd2
[perf]: QAT/QAD add safe regional compile for modular training ( #1718 )
...
Adds opt-in regional torch.compile to the YAML-driven modular Wan trainer (training.model.enable_torch_compile / torch_compile_kwargs) with FA4 and Wan modulation forward/backward as opaque custom ops, compiled repeated DiT blocks after FSDP setup, and activation checkpointing applied before FSDP for trainable Wan transformers.
Merged with main's #1716 (WanModel resolves the checkpointing type in __init__; the PR's pre-FSDP wrap uses it and the post-load wrap is gone) and #1757 (pre_fsdp_model_transform runs before this PR's pre_fsdp_transform). Maintainer review (Swarm order #776 ): AdaLN skip names are canonicalized through checkpoint-wrapper prefixes, test_inference_regional_compile.py joins the unit lane, the Wan modulation custom-op test moved to the transformer lane, regional_compile is classified in the schema inventory, and a 1/2-GPU training smoke covers fully_shard(CheckpointWrapper) in eager and regional-compile modes. Validated on GB200: the FA4 CuTe forward/backward parity and fullgraph-backward tests and all four smoke cases pass.
Also exempts MMAudio recipes, whose student builds its pipeline config at init, from the fine-tuning recipe construction check that #1648 left failing on main.
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 05:24:24 -07:00
99f8f3e7a7
[feat] Add streaming and GPU-accelerated LoRA extraction ( #1784 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 04:48:35 -07:00
3467f8befb
[feat] Add end-to-end MMAudio V2A training, inference, and evaluation ( #1648 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 04:25:00 -07:00
2d6e7d9b6b
[feat]: MiniMax-H3 encoder split: dedicated text-encoder node group for 720p on DGX Spark ( #1877 )
...
Co-authored-by: magicbear <magicbear@users.noreply.github.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 03:46:33 -07:00
d5287f8352
[feat]: add MiniMax H3 Ref2VA and LoRA training support ( #1757 )
...
Co-authored-by: William Lin <8941107+SolitaryThinker@users.noreply.github.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 03:21:45 -07:00
37b9dc1836
[new-model] Add native Helios-Distilled T2V pipeline ( #1670 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 03:18:24 -07:00
8b51380466
[feat]: FastH3 on single RTX GPUs ( #1919 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
Co-authored-by: Aryan Kumar <aryank@Aryans-Mac-Studio.local >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-06 11:37:01 -07:00
Junda Su
02f1ce11ae
[misc] Move environment var reads into env registry and rename unprefixed variables ( #1897 )
2026-09-29 14:36:16 -07:00
Junda Su
e3b88bb12a
[feat] Add a typed environment-variable registry, policy doc, and contract test ( #1896 )
2026-09-29 12:50:45 -07:00
Junda Su
4e52f47d1e
[feat] add MXFP8 support on H3 ( #1796 )
2026-09-05 17:08:58 -07:00
Aryan Kumar and Aryan Kumar
f82d8be4bf
[perf] Sequential MiniMax H3 start with GPU-direct DiT load ( #1793 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-08-31 04:20:21 -07:00
William Lin and shaoxiongduan
a534ba20a0
[feat] Add MiniMax H3 LoRA inference and preview launchers ( #1771 )
...
Co-authored-by: shaoxiongduan <shaoxiongduan@gmail.com >
2026-08-27 14:43:39 -07:00
KyleNeverGivesUp
9bfa585448
[perf]: stop holding the whole checkpoint during DiT load, unblocking MiniMax H3 on one GB10 ( #1714 )
2026-08-26 15:23:51 -07:00
William Lin
f9e3680f11
[perf] Align FastH3 optimized inference profile ( #1748 )
2026-08-23 02:01:03 -07:00
William Lin
d3cff517cd
[perf] Add opt-in regional fullgraph compile for DiT inference ( #1741 )
2026-08-22 12:14:39 -07:00
William Lin
422585d08f
[misc]: add LTX-2.3 fine-tuning example recipes ( #1651 )
2026-07-27 18:42:44 -07:00
Junda Su
755a4e4470
[new-model] Add LingBot-Video Dense and MoE/refiner T2V inference ( #1595 )
2026-07-18 20:18:16 -07:00
Loay Rashid and SolitaryThinker
995a5fdf97
[bugfix] fixing denoising time in the fastwan script ( #1480 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-06-23 10:01:23 -07:00
Kevin Lin
82ed9fe58d
[feat] QAD 5090: FP8 linear layer inference ( #1465 )
2026-06-22 18:25:06 -07:00
e60601df7f
[feat] QAD 5090: QAT training recipe — finetune + DMD distillation (12/12) ( #1462 )
...
Co-authored-by: William Lin <SolitaryThinker@users.noreply.github.com >
Co-authored-by: Loay Rashid <42599591+loaydatrain@users.noreply.github.com >
Co-authored-by: Kaiqin Kong <k1kong@ucsd.edu >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-17 15:18:52 -07:00
d922ab2cbc
[model] Flux2 Klein Port ( #1349 )
...
Co-authored-by: Gnav3852 <63612880+Gnav3852@users.noreply.github.com >
Co-authored-by: Mac Lee <macthecadillac@gmail.com >
2026-06-09 14:55:55 -07:00
Wenxuan Tan and SolitaryThinker
af2ee9c78a
[feat] Optimize distributed weight loading in multi-node training ( #572 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-05-21 16:59:48 +00:00
b4de5a9f1b
[feat] Dreamverse 12/14: Add LTX2 refine and upsampler support ( #1335 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com >
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com >
2026-05-15 12:21:40 -07:00
jaisurya27
4d49f7b0aa
Kandinsky5 lite dit clean ( #1088 )
2026-03-26 08:07:11 +08:00
XOR-op
785d123e36
[feat] Hooks API and layerwise offloading for all DiTs ( #1006 )
2026-01-17 11:22:02 -08:00
William Lin
0f53b51e6c
[CI] Fix OOM issues in ssim tests ( #1011 )
2026-01-16 21:15:20 -08:00
KyleShao
dbddfab6d2
[feat] Introduce Cosmos 2.5 Text2World pipeline ( #974 )
2026-01-15 15:09:05 -08:00
Loay Rashid
dea69cf651
[New Model] Turbodiffusion ( #971 )
2026-01-02 17:55:56 -06:00
Ohm-Rishabh
2972fc9449
Improve FSDP loading with size-based filtering ( #853 )
2025-11-04 15:31:07 -08:00
zyang6 and kiritorl
87489f0872
Add wan2.1 functionality support for Ascend NPU platform ( #810 )
...
Co-authored-by: kiritorl <1021709528@qq.com >
2025-10-09 16:25:08 -07:00
dc7596b973
[self-forcing][8/n] Self-Forcing For Wan2.2-A14B + torch.compile training and distillation support ( #818 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-10-02 15:01:45 -07:00
31f000d1cc
[self-forcing] [5/n] Add Self-Forcing distillation pipeline ( #808 )
...
Co-authored-by: RandNMR73 <notomatthew31@gmail.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2025-09-20 19:32:10 -07:00
William Lin
f572319bd9
[Feature] Remove V1 folder ( #642 )
2025-07-24 22:43:12 -07:00