lpc0220 and root
d4ed61cc7c
[refactor] VSA: rename the sm100a block-sparse kernel to ptx_blackwell ( #1956 )
...
Co-authored-by: root <root@ptyche0124.ptyche.clusters.nvidia.com >
2026-10-17 21:10:19 -07:00
alanhuangyoo
6ef5b78020
[bugfix] LTX-2: train temporal RoPE at the clip's fps ( #1892 )
...
The legacy LTX-2 trainer did not give the clip fps to the DiT. The DiT then
kept temporal RoPE positions in frames during training, but inference uses
seconds (fps 24). The trainer now passes the fps of the stored latents (24 when
the value is missing).
The video transform stage resampled frames to train_fps but kept the source fps
in the batch. The saved clips then had the source fps, and the audio was cut to
the wrong length. The stage now sets the batch fps to train_fps.
The new regression test runs in the CI unit lane.
2026-10-07 14:54:34 -07:00
William Lin and Claude Opus 5.5
d1416b5930
[misc]: re-run pre-commit after the 2026-10-07 merges ( #1929 )
...
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 06:13:43 -07:00
3467f8befb
[feat] Add end-to-end MMAudio V2A training, inference, and evaluation ( #1648 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 04:25:00 -07:00
c18436125a
[misc]: Refactor separate training pipeline runner ( #1696 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 03:19:21 -07:00
6102fac00d
[bugfix]: fix modular ops activation checkpoint recomputation ( #1716 )
...
Co-authored-by: William Lin <8941107+SolitaryThinker@users.noreply.github.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 02:41:12 -07:00
1ad33c1832
[feat] Support training_cfg_rate > 0 for LTX-2 ( #1752 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 02:38:42 -07:00
fb5efebdab
[feat] Add HunyuanVideo 1.5 T2V training support ( #1662 )
...
Co-authored-by: William Lin <willlin@nvidia.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 02:19:22 -07:00
a4e7322ba6
[bugfix]: synchronize post-FSDP LoRA replicas ( #1666 )
...
Co-authored-by: Suckl <Suckl@users.noreply.github.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 01:53:30 -07:00
Junda Su
02f1ce11ae
[misc] Move environment var reads into env registry and rename unprefixed variables ( #1897 )
2026-09-29 14:36:16 -07:00
Junda Su
e3b88bb12a
[feat] Add a typed environment-variable registry, policy doc, and contract test ( #1896 )
2026-09-29 12:50:45 -07:00
Keith
e90be598e5
[perf] MiniMax H3: return uint8 frames from the decode worker ( #1828 )
2026-09-24 18:08:56 -07:00
William Lin
1c14afd559
[docs]: refresh AGENTS.md maps and add Wan SP/I2V and CI test notes ( #1845 )
2026-09-14 16:06:53 -07:00
Yaegaki1Erika
9a3c45779c
[bugfix]: fix Wan I2V DMD conditioning under sequence parallelism ( #1844 )
...
The pipeline pre-sharded only the image conditioning along the temporal axis while the noise input stayed full-length, so concatenation could not match for sp_world_size > 1. WanTransformer3DModel shards the flattened token sequence after patch embedding, so pass full-length mask+latent conditioning and let the transformer shard.
Also reads temporal_compression_ratio from the VAE config, simplifies the conditioning mask, concatenates in the transformer's (bs, c, t, h, w) layout, and adds unit coverage.
Co-authored-by: Yaegaki1Erika <70182590+Yaegaki1Erika@users.noreply.github.com >
2026-09-14 15:58:13 -07:00
William Lin
9212f4f218
[ci] make GPU validation change-aware ( #1747 )
2026-08-25 21:26:25 -07:00
Lev Novitskiy and Claude Sonnet 5
8b23984c79
[feat] Add Kandinsky5 QAD training pipeline: data preprocessing, QAT finetune, QAT-aware DMD distillation ( #1601 )
...
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com >
2026-07-26 02:59:21 -07:00
Mingjia Huo and Claude Fable 5
4c08ffce49
[feat] World model training using third person games ( #1443 )
...
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
2026-07-10 05:09:07 +00:00
Kared and SolitaryThinker
e2f4d1a7b5
[feat]: add SwanLab tracker ( #1461 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-07 08:35:38 +00:00
William Lin
78d606a3a7
[feat]: make VSA tile cache configurable for training ( #1444 )
2026-06-28 02:18:31 -07:00
Junda Su and Peiyuan Zhang
5854aec2ce
[feat] Add Wan RL DiffusionNFT training ( #1450 )
...
Co-authored-by: Peiyuan Zhang <a1286225768@gmail.com >
2026-06-11 21:18:59 -07:00
19a838f54f
[bugfix]: release VSA tile cache during training ( #1434 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-09 15:01:22 -07:00
d922ab2cbc
[model] Flux2 Klein Port ( #1349 )
...
Co-authored-by: Gnav3852 <63612880+Gnav3852@users.noreply.github.com >
Co-authored-by: Mac Lee <macthecadillac@gmail.com >
2026-06-09 14:55:55 -07:00
Kaiqin Kong and mergify[bot]
9ea77d37f3
[bugfix] EMA shadow on resume and EMA under MoE path ( #1441 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-09 00:55:43 +00:00
Kaiqin Kong
a931efe33a
[bugfix] EMA in distillation pipeline ( #1440 )
2026-06-06 17:38:03 -07:00
Kaiqin Kong and mergify[bot]
773d44b875
[misc] Rename MatrixGame to MatrixGame2 ( #1357 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-17 22:57:03 -07:00
Kaiqin Kong and mergify[bot]
a790153705
[bugfix] MatrixGame2 SF distillation under gradient checkpointing ( #1340 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-12 17:01:04 -07:00
Raghav K
9d0af28307
[feat] Add Cosmos 2.5 T2W training pipeline (LoRA + full fine-tune) ( #1227 )
2026-05-11 19:15:00 -07:00
d6dfe95466
[feat] FastVideo World Model Training ( #1179 )
...
Co-authored-by: mignonjia <mhuo@ucsd.edu >
Co-authored-by: alexzms <3036648523@qq.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-11 05:13:12 +00:00
f633e30ebb
[feat]: add LongCat bidirectional finetuning support ( #1244 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
Co-authored-by: alexzms <3036648523@qq.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-09 12:20:43 -07:00
William Lin
140bd1a6cf
[misc]: standardize install instructions on uv pip install ( #1279 )
2026-05-02 12:45:50 -07:00
William Lin
c85f6a477f
[docs] add hierarchical AGENTS.md per-directory guidance ( #1278 )
2026-05-02 03:28:18 -07:00
alexzms and mergify[bot]
74d09b0efd
[misc] cleanup: grad-norm asserts, dead offload file, callback names ( #1268 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-01 01:16:13 -07:00
alexzms
d14d5aadea
[feat] Cosmos 2.5 training support in fastvideo.train ( #1224 )
2026-05-01 01:15:02 +00:00
alexzms
37418946c8
[docs]: clarify real_score_guidance_scale CFG parameterization ( #1256 )
2026-04-26 16:38:00 +08:00
William Lin
145a3f166b
[feat] [4/n] Improve API: refactor sampling param and merge with presets ( #1234 )
2026-04-16 14:10:02 -07:00
Kun Lin and mergify[bot]
65dff806a8
[bugfix]Fixing Lora distillation training distributed checkpointing bug ( #1192 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-04-06 02:20:26 +00:00
KUAN-HAO HUANG and mergify[bot]
b85f0f4c2a
[perf]: Eliminate CPU-GPU synchronization bottlenecks in training pipeline ( #1217 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-04-06 02:03:46 +00:00
alexzms
14261bc98c
[feat] pre-commit support 120 col num ( #1167 )
2026-03-11 20:19:30 -07:00
alexzms and Peiyuan Zhang
bc27a032c5
[feat] Refactor training framework into fastvideo/train ( #1159 )
...
Co-authored-by: Peiyuan Zhang <a1286225768@gmail.com >
2026-03-09 15:16:42 -07:00
Zhang Peiyuan
cd1b7cf139
[Refactor] SP Mask --> original seq len; HunyuanVideo 1.5 does not need mask ( #1142 )
2026-03-04 11:44:47 +08:00
Zhang Peiyuan
d902967208
Py/fix sp ( #1138 )
2026-02-27 12:14:44 +08:00
William Lin
69dd3c68f6
[bugfix] fix matrix game kv indexing and CI ( #1135 )
2026-02-26 01:24:42 -08:00
10fc92dba5
Upstream LTX2 Training ( #1116 )
...
Co-authored-by: RandNMR73 <notomatthew31@gmail.com >
Co-authored-by: JerryZhou54 <zhouw.jerry2017@outlook.com >
Co-authored-by: Davids048 <jundasu@ucsd.edu >
Co-authored-by: Peiyuan Zhang <a1286225768@slurm-h200-204-239.slurm-compute.tenant-slurm.svc.cluster.local >
2026-02-21 16:06:55 -08:00
XOR-op
959dbcc8a2
[perf] causal MatrixGame optimization ( #1078 )
2026-02-15 09:51:00 +08:00
William Lin
36bf37e9ba
[bugfix] Fix failed kernel publish and SFT regressions ( #1103 )
2026-02-14 16:19:17 -08:00
530e6b8363
[Model] LTX 2 Base ( #1064 )
...
Co-authored-by: Davids048 <jundasu@ucsd.edu >
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-02-10 01:11:17 -08:00
Ishan and Jinzhe Pan
0aff68f51d
[Feat] Add Stable Diffusion 3.5 ( #1075 )
...
Co-authored-by: Jinzhe Pan <eigensystem1318@gmail.com >
2026-02-10 14:31:36 +08:00
ad58f802f3
[Feat] Port LTX2 trainer ( #1074 )
...
Co-authored-by: Davids048 <jundasu@ucsd.edu >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
2026-02-09 17:32:57 -08:00
Wei Zhou
04fa356ee3
[Misc] [Training] Fixed a bunch of bugs in current training pipeline ( #1084 )
2026-02-09 16:01:05 -08:00
XOR-op
aea300f690
[perf]: use CUDA IPC in multiproc executor to avoid serialization overhead ( #1061 )
2026-02-06 19:43:18 -05:00
