Commit Graph
61 Commits
Author SHA1 Message Date
RandNMR73 d127e513e9 updates 2026-01-27 00:07:01 +00:00
RandNMR73 c00fac99b9 fix random seed in training pipeline bug 2026-01-25 22:10:16 +00:00
RandNMR73 aa49fb9dd8 add a bunch of scripts + modify sage3 to support turning off two level quant P 2026-01-25 04:24:34 +00:00
RandNMR73 900cc8d707 checkpoint (qat attn in progress) 2026-01-22 12:32:14 +00:00
RandNMR73 e332dbb857 more scripts 2026-01-22 11:51:12 +00:00
RandNMR73 4cd1297078 a bunch of changes 2026-01-22 06:38:41 +00:00
RandNMR73 3adfb07465 try sage3 finetuning with aligned backward pass 2026-01-07 01:37:09 +00:00
RandNMR73 30eeec0411 try sage3 finetuning again 2026-01-05 23:55:01 +00:00
RandNMR73 6c3d8781b7 test sage3 inference with smoothing q but no delta s 2025-12-26 05:05:37 +00:00
RandNMR73 eb160a2e23 modify scripts + launch qat run 2025-12-25 09:30:27 +00:00
RandNMR73 a34a6df844 update training script 2025-12-25 06:33:30 +00:00
RandNMR73 ca3b3985fb 6 gpus 2025-12-25 03:35:15 +00:00
RandNMR73 efcb3c4058 8 gpus 2025-12-25 02:00:45 +00:00
RandNMR73 36cdddfa9a bigger batch size + no grad around wrapped_flash_attn 2025-12-25 01:36:17 +00:00
RandNMR73 460df09e20 adjust sage3 block size to 64x64 2025-12-24 21:49:43 +00:00
RandNMR73 8d68a4fd46 add SageAttn3 with QAT 2025-12-24 09:28:22 +00:00
RandNMR73 7afe836f28 5090 testing 2025-12-24 06:04:36 +00:00
RandNMR73 9bcc41164a checkpoint (qat attn in progress) 2025-12-23 01:36:46 +00:00
Peiyuan Zhang b628b5fc7e save 2025-12-23 01:31:21 +00:00
Peiyuan Zhang 130b46634a save 2025-12-23 01:30:16 +00:00
Peiyuan Zhang fa91001127 update 2025-12-23 01:28:09 +00:00
Peiyuan Zhang 032016f7dd update 2025-12-23 01:28:08 +00:00
Peiyuan Zhang 2a28c081be update 2025-12-23 01:28:08 +00:00
Peiyuan Zhang 8abfe234af update 2025-12-23 01:27:22 +00:00
Peiyuan Zhang 9161ef60da update 2025-12-23 01:25:05 +00:00
Ohm-Rishabh d277361aae [misc] add schedule configurations to pytorch profiler (#934) 2025-12-18 01:45:23 -06:00
Loay Rashid 1c19a6a00c [Bugfix] Minor bugfixes (#889) 2025-11-26 17:20:45 -08:00
William Lin 490bde90e1 [bugfix] Allow overriding dit checkpoint for inference and Lower VSA LR in example scripts (#831) 2025-10-05 01:44:49 -07:00
William Lin 335afa4457 [bugfix] Use training_state_checkpointing_steps instead of checkpointing_steps (#821) 2025-09-28 15:22:43 -07:00
William Lin 404cbf4f3c [self-forcing] [6/n] Add Ode Init training (#811) 2025-09-22 17:58:19 -07:00
Yongqi Chen cd32b3e02f Update example files and readme (#809) 2025-09-20 18:15:59 -07:00
William Lin c5f9ea53b2 [self-forcing] [4/n] Preprocessing for collecting ODE trajectory (#788) 2025-09-15 17:54:42 -07:00
Jinzhe Pan 4aa307be55 [Preprocess][Feat] support torchvision to load video in new preprocessing (#761) 2025-09-01 23:37:01 -07:00
William LinandPeiyuan Zhang b91020b407 [VSA] [STA] Fix directory structure for pypi publishing (#769)
Co-authored-by: Peiyuan Zhang <a1286225768@gmail.com>
2025-08-28 22:34:03 -07:00
Jinzhe Pan 0eced76a41 [Feat][Preprocess] support multi-gpus (#753) 2025-08-23 11:34:42 +08:00
Jinzhe Pan 3ab6470d1a [Feat][Preprocess] support merged dataset (#752) 2025-08-22 15:29:33 -07:00
Wenxuan Tan 989a03532c Optionally use unmerged weights for inference (#745) 2025-08-22 15:20:31 -07:00
Jinzhe Pan 911a6a6a35 [Feat][Preprocessing] i2v preprocessing workflow (#737) 2025-08-14 20:47:25 -07:00
Wenxuan Tan 5357f63327 Fix LoRA load from training checkpoint (#719) 2025-08-09 20:46:00 -05:00
Wenxuan Tan 6c6bcd914d Remove all empty_cache (#713) 2025-08-07 22:50:38 -07:00
Jinzhe Pan 86604a684b [3/3][Preprocess] add preprocessing workflows (#645) 2025-08-07 01:49:07 -07:00
Wenxuan Tan 4b7266349a [misc] Remove allow_tf32 in scripts (#705) 2025-08-04 15:37:56 -05:00
Wenxuan Tanandgemini-code-assist[bot] 31200fbb83 [Misc] Fix training scripts (#683)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-08-01 15:54:31 -05:00
Zhang Peiyuan 516ecd374a [Misc] Update examples/ and other misc (#672) 2025-07-30 19:10:27 -07:00
Yongqi Chen f759980a58 [Feature]Add VSA slurm training example scripts (#666) 2025-07-30 01:27:54 -04:00
Yongqi Chen 4cb046768d [Feature]Add DMD distillation training resume checkpoint; Update DMD CI test (#662) 2025-07-29 19:06:05 -04:00
Yongqi Chen 3322542444 [Feature] Add DMD CI test (#661) 2025-07-29 03:14:00 -04:00
William Lin f572319bd9 [Feature] Remove V1 folder (#642) 2025-07-24 22:43:12 -07:00
William Lin 8573d4f05e [Docs] Docs update for Training and MPS (#641) 2025-07-24 19:23:58 -07:00
Wenxuan Tan 210a733515 [Bugfix] Fix LoRA trainable params and training ckpt loading (#630) 2025-07-23 20:01:40 -07:00