Commit Graph
72 Commits
Author SHA1 Message Date
RandNMR73 ad099ca18b clean 2026-04-08 09:10:11 +00:00
RandNMR73 1cdec40290 Merge branch 'matthew/clean' into sync-branch 2026-04-08 09:07:02 +00:00
1a383f3f66 [refactor] train v1 clean up
Co-authored-by: alexzms <3036648523@qq.com>
Co-authored-by: Peiyuan Zhang <a1286225768@slurm-h200-204-215.slurm-compute.tenant-slurm.svc.cluster.local>
2026-03-09 18:58:56 -07:00
Jinzhe Pan 5433f6e80b [fix] preprocessing issue (#1134) 2026-02-25 21:49:52 -08:00
10fc92dba5 Upstream LTX2 Training (#1116)
Co-authored-by: RandNMR73 <notomatthew31@gmail.com>
Co-authored-by: JerryZhou54 <zhouw.jerry2017@outlook.com>
Co-authored-by: Davids048 <jundasu@ucsd.edu>
Co-authored-by: Peiyuan Zhang <a1286225768@slurm-h200-204-239.slurm-compute.tenant-slurm.svc.cluster.local>
2026-02-21 16:06:55 -08:00
Zhang Peiyuanandgemini-code-assist[bot] 76d3ba69e0 [Misc] clean up VSA finetuning examples. (#1111)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-02-18 11:37:20 -08:00
ad58f802f3 [Feat] Port LTX2 trainer (#1074)
Co-authored-by: Davids048 <jundasu@ucsd.edu>
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com>
2026-02-09 17:32:57 -08:00
Wei Zhou 04fa356ee3 [Misc] [Training] Fixed a bunch of bugs in current training pipeline (#1084) 2026-02-09 16:01:05 -08:00
RandNMR73 643c8e9cd1 fix 14B validation videos 2026-01-27 12:57:08 +00:00
RandNMR73 72b61ab1fe add sage3 fwd + bf16 bwd script 2026-01-27 04:08:56 +00:00
Kaiqin Kong 0c6862ca55 [feature] Add Matrix Game 2.0 training (#1017)
The CI tests are quite unstable, but since multiple CI tests indicates that each individual tests are passed, I think we can merge this.
2026-01-26 19:21:43 -08:00
RandNMR73 d127e513e9 updates 2026-01-27 00:07:01 +00:00
RandNMR73 c00fac99b9 fix random seed in training pipeline bug 2026-01-25 22:10:16 +00:00
RandNMR73 aa49fb9dd8 add a bunch of scripts + modify sage3 to support turning off two level quant P 2026-01-25 04:24:34 +00:00
RandNMR73 900cc8d707 checkpoint (qat attn in progress) 2026-01-22 12:32:14 +00:00
RandNMR73 e332dbb857 more scripts 2026-01-22 11:51:12 +00:00
RandNMR73 4cd1297078 a bunch of changes 2026-01-22 06:38:41 +00:00
RandNMR73 3adfb07465 try sage3 finetuning with aligned backward pass 2026-01-07 01:37:09 +00:00
RandNMR73 30eeec0411 try sage3 finetuning again 2026-01-05 23:55:01 +00:00
RandNMR73 6c3d8781b7 test sage3 inference with smoothing q but no delta s 2025-12-26 05:05:37 +00:00
RandNMR73 eb160a2e23 modify scripts + launch qat run 2025-12-25 09:30:27 +00:00
RandNMR73 a34a6df844 update training script 2025-12-25 06:33:30 +00:00
RandNMR73 ca3b3985fb 6 gpus 2025-12-25 03:35:15 +00:00
RandNMR73 efcb3c4058 8 gpus 2025-12-25 02:00:45 +00:00
RandNMR73 36cdddfa9a bigger batch size + no grad around wrapped_flash_attn 2025-12-25 01:36:17 +00:00
RandNMR73 460df09e20 adjust sage3 block size to 64x64 2025-12-24 21:49:43 +00:00
RandNMR73 8d68a4fd46 add SageAttn3 with QAT 2025-12-24 09:28:22 +00:00
RandNMR73 7afe836f28 5090 testing 2025-12-24 06:04:36 +00:00
RandNMR73 9bcc41164a checkpoint (qat attn in progress) 2025-12-23 01:36:46 +00:00
Peiyuan Zhang b628b5fc7e save 2025-12-23 01:31:21 +00:00
Peiyuan Zhang 130b46634a save 2025-12-23 01:30:16 +00:00
Peiyuan Zhang fa91001127 update 2025-12-23 01:28:09 +00:00
Peiyuan Zhang 032016f7dd update 2025-12-23 01:28:08 +00:00
Peiyuan Zhang 2a28c081be update 2025-12-23 01:28:08 +00:00
Peiyuan Zhang 8abfe234af update 2025-12-23 01:27:22 +00:00
Peiyuan Zhang 9161ef60da update 2025-12-23 01:25:05 +00:00
Ohm-Rishabh d277361aae [misc] add schedule configurations to pytorch profiler (#934) 2025-12-18 01:45:23 -06:00
Loay Rashid 1c19a6a00c [Bugfix] Minor bugfixes (#889) 2025-11-26 17:20:45 -08:00
William Lin 490bde90e1 [bugfix] Allow overriding dit checkpoint for inference and Lower VSA LR in example scripts (#831) 2025-10-05 01:44:49 -07:00
William Lin 335afa4457 [bugfix] Use training_state_checkpointing_steps instead of checkpointing_steps (#821) 2025-09-28 15:22:43 -07:00
William Lin 404cbf4f3c [self-forcing] [6/n] Add Ode Init training (#811) 2025-09-22 17:58:19 -07:00
Yongqi Chen cd32b3e02f Update example files and readme (#809) 2025-09-20 18:15:59 -07:00
William Lin c5f9ea53b2 [self-forcing] [4/n] Preprocessing for collecting ODE trajectory (#788) 2025-09-15 17:54:42 -07:00
Jinzhe Pan 4aa307be55 [Preprocess][Feat] support torchvision to load video in new preprocessing (#761) 2025-09-01 23:37:01 -07:00
William LinandPeiyuan Zhang b91020b407 [VSA] [STA] Fix directory structure for pypi publishing (#769)
Co-authored-by: Peiyuan Zhang <a1286225768@gmail.com>
2025-08-28 22:34:03 -07:00
Jinzhe Pan 0eced76a41 [Feat][Preprocess] support multi-gpus (#753) 2025-08-23 11:34:42 +08:00
Jinzhe Pan 3ab6470d1a [Feat][Preprocess] support merged dataset (#752) 2025-08-22 15:29:33 -07:00
Wenxuan Tan 989a03532c Optionally use unmerged weights for inference (#745) 2025-08-22 15:20:31 -07:00
Jinzhe Pan 911a6a6a35 [Feat][Preprocessing] i2v preprocessing workflow (#737) 2025-08-14 20:47:25 -07:00
Wenxuan Tan 5357f63327 Fix LoRA load from training checkpoint (#719) 2025-08-09 20:46:00 -05:00