Will Lin and Claude Fable 5
129fcaffab
[perf] inference: regional fullgraph torch.compile of the DiT blocks (port of #1718 to the inference path)
...
Extend the training-side regional-compile port (internal 863e87342, GO
verdict vsa_gate/compile_ab/VERDICT.md) to inference so every H3 run can
compile the 52 transformer blocks. Opt-in and off by default:
- New FastVideoArgs.inference_torch_compile (CLI --inference-torch-compile),
env FASTVIDEO_INFERENCE_TORCH_COMPILE=1 folded in __post_init__ (the
attention_backend parse-once pattern), reachable through
PipelineSelection.experimental {"inference_torch_compile": true} exactly
like the VSA_sparsity / VSA_tile_size knobs.
- maybe_load_fsdp_model applies the compile right after the transformer
loads: per-_compile_conditions block, fullgraph=True + inductor
options.emulate_precision_casts injected, no user kwargs needed (the
compile-A/B verdict recipe). prepare_for_compile still runs first, so the
H3 fusion-inertness warning of #1735 is preserved.
- _regional_compile_unsupported_reason ported from the training loader:
VSA / VSA-H3 backends and the FASTVIDEO_DISABLE_ATTENTION_COMPILE=1
escape hatch degrade the transformer to eager with one warning; FLASH_ATTN
on flash-attn 3 is rejected with an actionable message. FA4/FA2/SDPA
compile through their existing custom-op boundaries (forward-only is
enough at inference; the training port's backward custom ops are not
needed under no_grad).
- FASTVIDEO_DISABLE_ATTENTION_COMPILE default flipped to 0 (attention is
traced by default), matching the training port and upstream #1718 —
eager runs are unaffected (torch.compiler.disable is inert outside
dynamo).
- enable_torch_compile + inference_torch_compile together skip the
pipeline-level DiT compile (the loader already owns those forwards).
- examples: --inference-torch-compile on basic_minimax_h3_t2v.py (dense
target) and basic_fasth3.py (exercises the VSA degrade path).
- CPU-safe contract tests for the guard and the kwargs injection.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com >
2026-08-22 02:56:30 +00:00
William Lin
6d6a10be7a
[feat] FastVideo-Minimax-FastH3-Preview few-step example + 64-token-tile VSA-H3 inference path ( #1731 )
2026-08-21 12:40:09 -05:00
Shao Duan
c4ad4227c0
[misc] MiniMax-H3: move the AdaLN converter into scripts/checkpoint_conversion ( #1712 )
2026-08-21 02:15:00 -05:00
Aryan Kumar and Aryan Kumar
8537dcd6de
[feat]: Apple Silicon MLX runtime — INT8 Wan2.1 and Wan2.2 inference ( #1638 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-08-18 15:08:00 -07:00
William Lin
8208536cd1
[bugfix] profiler region system: record + export actually work, usability roll-up ( #1691 )
2026-08-09 20:35:53 -07:00
Kai
0653f8f3af
[new-model] Add V2A: native MMAudio inference pipeline ( #1622 )
2026-08-09 17:29:27 -07:00
Shao Duan
541ef014ee
[perf] MiniMax-H3: rank-reduced AdaLN pruned model option (-39% params, -23 GiB VRAM) ( #1699 )
2026-08-09 12:31:57 -07:00
William Lin
9028953625
[misc] yapf pass under CI's interpreter (3.12) + pin hook language_version ( #1702 )
2026-08-08 22:24:17 -07:00
Junda Su
c3567eb468
[feat] add Minimax H3 sft pipeline ( #1688 )
2026-08-07 16:12:04 -07:00
William Lin
15568f27db
[perf]: H3 torch.compile + CUDA graphs (1.2-1.3x) with denoising step marking ( #1689 )
2026-08-06 16:23:33 -07:00
Raghav K and SolitaryThinker
a2bfc7cdb2
[docs] DGX Spark (GB10) performance & tuning guide + reproduction examples ( #1631 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-08-06 14:36:38 -07:00
Kaiqin Kong
e8b0e4c61e
[feat] Add MiniMax H3 ( #1674 )
2026-08-04 13:54:39 -07:00
Suhaan Khurana
05406c5d1b
[misc]: consolidate dataset download scripts under examples/datasets/ ( #1667 )
2026-08-02 14:21:24 -07:00
William Lin
98d65835b5
[misc]: refresh stale sm_120-only validation notes in QAT recipes ( #1655 )
2026-07-27 19:35:29 -07:00
William Lin
422585d08f
[misc]: add LTX-2.3 fine-tuning example recipes ( #1651 )
2026-07-27 18:42:44 -07:00
William Lin
d71acc0eb5
[bugfix]: fix stale imports in LTX-2.3 gradio local demo ( #1640 )
2026-07-27 16:31:07 -07:00
William Lin
af2934dd6b
[feat]: FA4-FP4 ATTN_QAT_INFER on sm_100/sm_103 + NVFP4 weight purge ( #1647 )
2026-07-27 15:46:52 -07:00
William Lin
5ae05b032e
[misc]: add LTX-2 fine-tuning example recipes ( #1645 )
2026-07-27 11:11:49 -07:00
Lev Novitskiy and Claude Sonnet 5
8b23984c79
[feat] Add Kandinsky5 QAD training pipeline: data preprocessing, QAT finetune, QAT-aware DMD distillation ( #1601 )
...
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com >
2026-07-26 02:59:21 -07:00
William Lin
bf18371afe
[feat] Enable LTX-2 NVFP4 linear and attention QAT fine-tuning ( #1626 )
2026-07-26 02:19:34 -07:00
William Lin
65f3b946b9
[feat] Add LTX-2 and LTX-2.3 fine-tuning to the modular trainer ( #1624 )
2026-07-20 11:58:39 -07:00
Zhang Peiyuan
191fcbf46c
[feat] add qat docs ( #1621 )
2026-07-19 18:37:47 -07:00
Junda Su
755a4e4470
[new-model] Add LingBot-Video Dense and MoE/refiner T2V inference ( #1595 )
2026-07-18 20:18:16 -07:00
9709b7513b
[feat] Port NVFP4 QAT/QAD to modular train framework ( #1619 )
...
Co-authored-by: Peiyuan Zhang <email>
Co-authored-by: Peiyuan <a>
2026-07-18 15:01:09 -07:00
Junda Su
d4bdd3621a
[new-model] Port LingBot-World-v2 ( #1579 )
2026-07-16 19:51:53 -07:00
6966f9e0bc
[fix] Z-Image ( #1236 ) draft port: rebase + strict-load contract + bf16 encoder parity + PORT_STATUS ( #1339 )
...
Co-authored-by: Mrinaal Dogra <mdogra@ucsd.edu >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-16 18:18:25 -07:00
b063f8ca41
[feat] Fix FLUX.1-dev port: native RoPE, parity tests, SSIM reference ( #1321 )
...
Co-authored-by: Ishan Vaish <ivaish@ucsd.edu >
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com >
2026-07-13 01:49:42 -07:00
Shreejith SG and H1yori233
d82abc271e
[feat] Add GLM-Image inference support ( #1030 )
...
Co-authored-by: H1yori233 <k1kong@ucsd.edu >
2026-07-12 22:42:42 -07:00
Guian Fang and SolitaryThinker
970409962f
[feat] Add AnyFlow any-step video distillation (pretrain + on-policy) ( #1371 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-12 02:32:08 +00:00
Mingjia Huo and Claude Fable 5
4c08ffce49
[feat] World model training using third person games ( #1443 )
...
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
2026-07-10 05:09:07 +00:00
alexzms and SolitaryThinker
c096fda1eb
[docs] Add LTX-2.3 distilled inference run configs (t2v/i2v × 5+2/8+3 × resolutions) ( #1568 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-09 18:53:12 +00:00
02e1143f22
[feat] Add Kandinsky-5 T2V/I2V pipeline support ( #1471 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
Co-authored-by: leffff <levnovitskiy@gmail.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-07 14:43:30 -07:00
Kaiqin Kong and SolitaryThinker
f037351146
[feat] Add Clean-history Teacher Forcing and Causal Consistency Distillation ( #1505 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-07 08:13:11 +00:00
595f0ea60e
[feat] Add DreamX-World 5B Cam and AR pipelines ( #1538 )
...
Co-authored-by: Suckl <Suckl@users.noreply.github.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-07 06:16:18 +00:00
William Lin
b36d0ef085
[infra] Add DGX Spark and multi-architecture CUDA support ( #1447 )
2026-07-03 13:41:43 -07:00
alexzms
8c23c86994
[docs]: add raw-video preprocess script for the QAD MixKit recipe ( #1487 )
2026-06-28 18:01:13 -07:00
William Lin
78d606a3a7
[feat]: make VSA tile cache configurable for training ( #1444 )
2026-06-28 02:18:31 -07:00
William Lin
6be280c914
[bugfix]: fix docs build ( #1502 )
2026-06-27 13:00:09 -07:00
Loay Rashid and SolitaryThinker
995a5fdf97
[bugfix] fixing denoising time in the fastwan script ( #1480 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-06-23 10:01:23 -07:00
Shao Duan
4d6ac89b43
[ci] eval: add metric regression + identity-invariant ci tests ( #1451 )
2026-06-23 01:27:34 -07:00
b2ade71467
[Bugfix] QAD 5090: Torch.compile and other optimizations (15/12) ( #1466 )
...
Co-authored-by: alexzms <3036648523@qq.com >
Co-authored-by: Kaiqin Kong <k1kong@ucsd.edu >
Co-authored-by: William Lin <SolitaryThinker@users.noreply.github.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-06-23 01:23:57 -07:00
Kevin Lin
82ed9fe58d
[feat] QAD 5090: FP8 linear layer inference ( #1465 )
2026-06-22 18:25:06 -07:00
e60601df7f
[feat] QAD 5090: QAT training recipe — finetune + DMD distillation (12/12) ( #1462 )
...
Co-authored-by: William Lin <SolitaryThinker@users.noreply.github.com >
Co-authored-by: Loay Rashid <42599591+loaydatrain@users.noreply.github.com >
Co-authored-by: Kaiqin Kong <k1kong@ucsd.edu >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-17 15:18:52 -07:00
c3b971488e
[docs] QAD 5090: Add NVFP4 + Attn-QAT inference example and how-to (9/12) ( #1458 )
...
Co-authored-by: William Lin <SolitaryThinker@users.noreply.github.com >
Co-authored-by: Loay Rashid <42599591+loaydatrain@users.noreply.github.com >
Co-authored-by: Kaiqin Kong <k1kong@ucsd.edu >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: alexzms <26690162+alexzms@users.noreply.github.com >
2026-06-16 14:36:50 -07:00
Junda Su and Peiyuan Zhang
5854aec2ce
[feat] Add Wan RL DiffusionNFT training ( #1450 )
...
Co-authored-by: Peiyuan Zhang <a1286225768@gmail.com >
2026-06-11 21:18:59 -07:00
alexzms
2a4fe697a6
[docs] LTX-2.3 distilled i2v: typed-API example (from_config + generate) ( #1448 )
2026-06-10 10:58:14 -07:00
alexzms
921db7479d
[perf] LTX-2.3 distilled i2v: drop max-autotune from compile kwargs ( #1445 )
2026-06-10 10:06:41 -07:00
Aryan Kumar and Aryan Kumar
7f539424cb
[feat]: add Lucy Edit inference scaffold ( #1363 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-06-09 15:21:43 -07:00
d922ab2cbc
[model] Flux2 Klein Port ( #1349 )
...
Co-authored-by: Gnav3852 <63612880+Gnav3852@users.noreply.github.com >
Co-authored-by: Mac Lee <macthecadillac@gmail.com >
2026-06-09 14:55:55 -07:00
Kaiqin Kong and mergify[bot]
efcc245c2e
[feat] VLM as judge for WM ( #1429 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-05 04:25:54 +00:00
