Will Lin and Claude Fable 5
8775bff28a
[bugfix] review fixes for regional compile: mode conflict, legacy scoping, AC-prefix loader trap, FA3 guard + config
...
1. mode/options conflict: _compile_model_regions now rejects
torch_compile_kwargs['mode'] with an actionable error instead of letting
torch raise about an 'options' key the user never wrote (the CLI help's
own example uses mode). CLI help updated.
2. Legacy stack scoping: new regional_compile flag (FastVideoArgs, default
False). The modular fastvideo/train moduleloader opts in; legacy
--enable-torch-compile recipes keep their pre-PR whole-model
torch.compile semantics (partial graphs, kwargs passed through).
3. AC-prefix normalization in the weight loader: checkpoint_wrapper strips
its prefix from state_dict() keys but not named_parameters()/
named_buffers(); with pre_fsdp_transform applying AC before load, a
loaded buffer inside a wrapped block was silently converted into a
TRAINABLE parameter by load_state_dict(assign=True) (verified on torch
2.12). All name-keyed lookups (buffer membership, fused weight_loader,
_get_parameter_dtype at load and shard time) now compare canonical names
via _strip_checkpoint_wrapper_prefix.
4. FA3: flash-attn 3's grad-enabled attention path graph-breaks, which
fullgraph regional compile turns into a hard error at step 1 on Hopper
hosts. The loader now detects FLASH_ATTN+fa3 and warns-and-disables
compile instead of crashing, and dmd2_t2v_fa3.yaml ships the recipe with
compile explicitly off (main config annotated).
Tests: mode-conflict rejection; AC-prefix canonicalization incl. the
buffer-stays-buffer regression under assign=True.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com >
2026-09-01 18:08:18 -07:00
Peiyuan
74003332b3
default add compile
2026-09-01 18:04:56 -07:00
William Lin
9028953625
[misc] yapf pass under CI's interpreter (3.12) + pin hook language_version ( #1702 )
2026-08-08 22:24:17 -07:00
Junda Su
c3567eb468
[feat] add Minimax H3 sft pipeline ( #1688 )
2026-08-07 16:12:04 -07:00
Suhaan Khurana
05406c5d1b
[misc]: consolidate dataset download scripts under examples/datasets/ ( #1667 )
2026-08-02 14:21:24 -07:00
William Lin
98d65835b5
[misc]: refresh stale sm_120-only validation notes in QAT recipes ( #1655 )
2026-07-27 19:35:29 -07:00
William Lin
422585d08f
[misc]: add LTX-2.3 fine-tuning example recipes ( #1651 )
2026-07-27 18:42:44 -07:00
William Lin
af2934dd6b
[feat]: FA4-FP4 ATTN_QAT_INFER on sm_100/sm_103 + NVFP4 weight purge ( #1647 )
2026-07-27 15:46:52 -07:00
William Lin
5ae05b032e
[misc]: add LTX-2 fine-tuning example recipes ( #1645 )
2026-07-27 11:11:49 -07:00
Lev Novitskiy and Claude Sonnet 5
8b23984c79
[feat] Add Kandinsky5 QAD training pipeline: data preprocessing, QAT finetune, QAT-aware DMD distillation ( #1601 )
...
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com >
2026-07-26 02:59:21 -07:00
William Lin
bf18371afe
[feat] Enable LTX-2 NVFP4 linear and attention QAT fine-tuning ( #1626 )
2026-07-26 02:19:34 -07:00
William Lin
65f3b946b9
[feat] Add LTX-2 and LTX-2.3 fine-tuning to the modular trainer ( #1624 )
2026-07-20 11:58:39 -07:00
Zhang Peiyuan
191fcbf46c
[feat] add qat docs ( #1621 )
2026-07-19 18:37:47 -07:00
9709b7513b
[feat] Port NVFP4 QAT/QAD to modular train framework ( #1619 )
...
Co-authored-by: Peiyuan Zhang <email>
Co-authored-by: Peiyuan <a>
2026-07-18 15:01:09 -07:00
Guian Fang and SolitaryThinker
970409962f
[feat] Add AnyFlow any-step video distillation (pretrain + on-policy) ( #1371 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-12 02:32:08 +00:00
Mingjia Huo and Claude Fable 5
4c08ffce49
[feat] World model training using third person games ( #1443 )
...
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
2026-07-10 05:09:07 +00:00
Kaiqin Kong and SolitaryThinker
f037351146
[feat] Add Clean-history Teacher Forcing and Causal Consistency Distillation ( #1505 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-07 08:13:11 +00:00
William Lin
78d606a3a7
[feat]: make VSA tile cache configurable for training ( #1444 )
2026-06-28 02:18:31 -07:00
Junda Su and Peiyuan Zhang
5854aec2ce
[feat] Add Wan RL DiffusionNFT training ( #1450 )
...
Co-authored-by: Peiyuan Zhang <a1286225768@gmail.com >
2026-06-11 21:18:59 -07:00
Mingjia Huo
63030cf6ec
[fix] Fix causal self-forcing attention settings ( #1355 )
2026-05-17 22:59:47 -07:00
Kaiqin Kong and mergify[bot]
773d44b875
[misc] Rename MatrixGame to MatrixGame2 ( #1357 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-17 22:57:03 -07:00
1df513922f
[feat] Add minimal LoRA finetuning support to the YAML training stack ( #1242 )
...
Co-authored-by: alexzms <3036648523@qq.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-17 14:49:13 -07:00
d6dfe95466
[feat] FastVideo World Model Training ( #1179 )
...
Co-authored-by: mignonjia <mhuo@ucsd.edu >
Co-authored-by: alexzms <3036648523@qq.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-11 05:13:12 +00:00
f633e30ebb
[feat]: add LongCat bidirectional finetuning support ( #1244 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
Co-authored-by: alexzms <3036648523@qq.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-09 12:20:43 -07:00
alexzms
d14d5aadea
[feat] Cosmos 2.5 training support in fastvideo.train ( #1224 )
2026-05-01 01:15:02 +00:00
alexzms
2085a4fc4a
[bugfix]: fix VAE temporal tiling blend corruption in tiled_encode ( #1181 )
2026-03-29 23:12:42 +00:00
alexzms
30129a3350
[misc]: reorganize training configs and add documentation ( #1177 )
2026-03-26 16:38:31 -07:00
alexzms
71bfc13d75
[feat]: add HunyuanVideo model plugin for fastvideo/train framework ( #1175 )
2026-03-24 16:49:51 -07:00
alexzms
14261bc98c
[feat] pre-commit support 120 col num ( #1167 )
2026-03-11 20:19:30 -07:00
alexzms
d92858659d
[feat] Self-Forcing methods in refactored training infra ( #1164 )
2026-03-09 20:20:59 -07:00
1a383f3f66
[refactor] train v1 clean up
...
Co-authored-by: alexzms <3036648523@qq.com >
Co-authored-by: Peiyuan Zhang <a1286225768@slurm-h200-204-215.slurm-compute.tenant-slurm.svc.cluster.local >
2026-03-09 18:58:56 -07:00
alexzms and Peiyuan Zhang
bc27a032c5
[feat] Refactor training framework into fastvideo/train ( #1159 )
...
Co-authored-by: Peiyuan Zhang <a1286225768@gmail.com >
2026-03-09 15:16:42 -07:00
