nodes/hao-ai-lab-FastVideo
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
191 Commits 335 Branches 8 Tags
bdfdf1dfeea2aebac8a462df9c3bcb2d1d11a01c
Commit Graph
51 Commits
Author SHA1 Message Date
Kevin Lin bdfdf1dfee [Training] Add distributed checkpointing (#458) 2025-06-02 15:15:45 -07:00
William LinandZihang-He 357b0533fe [Training] [7/n] gradient clipping (#449) 
Co-authored-by: Zihang-He <z6he@ucsd.edu>
 2025-05-29 15:07:29 -07:00
William Lin 2ec3732758 [Training] [6/n]Mixed precision training (#448) 2025-05-29 14:34:28 -07:00
Wei Zhouand“BrianChen1129” a004408a93 [Training] [0/n] Add preprocessing pipeline (#442) 
Co-authored-by: “BrianChen1129” <yongqich@umich.edu>
 2025-05-29 14:30:09 -07:00
William LinJerryZhou54Wei ZhouKevin Lin“BrianChen1129”
 		007e237e69 [Training] [5/n] Add single gpu training pipeline (#447) 
Co-authored-by: JerryZhou54 <zhouw.jerry2017@outlook.com>
Co-authored-by: Wei Zhou <69577934+JerryZhou54@users.noreply.github.com>
Co-authored-by: Kevin Lin <42618777+kevin314@users.noreply.github.com>
Co-authored-by: “BrianChen1129” <yongqich@umich.edu>
 2025-05-29 11:49:46 -07:00
applesaucethebunandBrayden Zhong 51956369a5 [Misc] Replace instances of time.time() with time.perf_counter() (#396) 
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
 2025-05-11 15:56:39 -07:00
River (Zihang He)andWill Lin 1a3ac9074b Zihang stepvideo v1 (#389) 
Co-authored-by: Will Lin <wlsaidhi@gmail.com>
 2025-05-11 14:41:42 -07:00
William Lin 9aadb4bf8c [1/n] [v1] Add Worker abstractions for User API (#336) 2025-04-18 14:38:46 -07:00
Yongqi Chen 8a73876d3b add STA to Wan v1 (#349) 2025-04-17 16:35:19 -07:00
Zhang PeiyuanandSolitaryThinker 2325adffa2 Add STA to V1 (#312) 
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
 2025-04-15 02:39:58 -07:00
William Lin 13583f5ffb [Model] Remove RMSNorm's forward_native hardcode from Wan (#339) 2025-04-14 16:46:43 -07:00
William LinandJerryZhou54 008ee2099a V1 wan rebased (#335) 
Co-authored-by: JerryZhou54 <zhouw.jerry2017@outlook.com>
 2025-04-11 15:34:54 -07:00
William Linandkevin314 c64f826ae2 Add torch sdpa backend to ssim test (#316) 
Co-authored-by: kevin314 <kevin.lin.cs1@gmail.com>
 2025-04-07 13:50:46 -07:00
Zhang PeiyuanWilliam LinWill LinZhou, WeiKevin Linkevin314JerryZhou54Yongqi ChenPeiyuan Zhang
 		1fee098f10 [do not merge] Rebased refactor (#270) 
Signed-off-by: <>
Co-authored-by: William Lin <SolitaryThinker@users.noreply.github.com>
Co-authored-by: Will Lin <wlsaidhi@gmail.com>
Co-authored-by: Zhou, Wei <wzhou322@gatech.edu>
Co-authored-by: Kevin Lin <42618777+kevin314@users.noreply.github.com>
Co-authored-by: kevin314 <kevin.lin.cs1@gmail.com>
Co-authored-by: JerryZhou54 <69577934+JerryZhou54@users.noreply.github.com>
Co-authored-by: Yongqi Chen <144848849+BrianChen1129@users.noreply.github.com>
Co-authored-by: Peiyuan Zhang <m2deng@ucsd.edu>
 2025-03-29 17:43:47 -05:00
Yongqi ChenandPeiyuan Zhang 1e08893546 Added multi-GPU support for Hunyuan STA (#211) 
Co-authored-by: Peiyuan Zhang <a1286225768@gmail.com>
 2025-02-21 14:16:28 -08:00
Zhang Peiyuan 09ab452610 Update STA README.md (#206) 2025-02-20 22:26:26 -08:00
Zhang Peiyuanrlsu9BrianChen1129
 		ead6c62be4 [Feat] Add STA for StepVideo (#200) 
Co-authored-by: rlsu9 <r3su@ucsd.edu>
Co-authored-by: BrianChen1129 <yongqich@umich.edu>
 2025-02-20 11:33:58 -08:00
Yongqi ChenandPeiyuan Zhang 76a12cc8a1 Infer sta tea with torch.compile (#190) 
Co-authored-by: Peiyuan Zhang <a1286225768@gmail.com>
 2025-02-18 11:29:36 -08:00
Yongqi ChenandPeiyuan Zhang 9ea39cee57 Add STA and teacache forward (#184) 
Co-authored-by: Peiyuan Zhang <a1286225768@gmail.com>
 2025-02-15 16:22:01 -08:00
Brian Chen 218449c54d adding hunyuan hf (support lora finetuning); unified hunyuan hf inference with quantization (#135) 2025-01-13 19:47:42 -08:00
Yuzhou Nieand“Peiyuan Zhang” 4a1f1e35bb add parallel for vae decoding (#134) 
Co-authored-by: “Peiyuan Zhang” <a1286225768@gmail.com>
 2025-01-07 17:14:21 -08:00
Zhang Peiyuan dd75ee8509 [Fix] Save CK, Dataset bug fix (#125) 2024-12-31 22:19:10 -08:00
rlsu9 0aed1868df [feat]: Add format auto fixer to main branch (#124) 2024-12-31 15:23:17 -08:00
Zhang Peiyuanandrlsu9 88b2583c2c [feat]:Single 4090 inference for fasthunyuan (#104) 
Co-authored-by: rlsu9 <r3su@ucsd.edu>
 2024-12-25 12:40:16 -08:00
Brian Chen edf116fa46 fix lora checkpoint saving issue (#97) 2024-12-19 08:42:59 -08:00
Zhang Peiyuanrlsu9rlsu9
 		a57122c519 Rlsu lora readme (#86) 
Co-authored-by: rlsu9 <r3su@ucsd.edu>
Co-authored-by: rlsu9 <147024991+rlsu9@users.noreply.github.com>
 2024-12-17 11:37:07 -08:00
Zhang Peiyuanandrlsu9 b393570e45 Update README (#85) 
Co-authored-by: rlsu9 <r3su@ucsd.edu>
 2024-12-16 17:06:14 -08:00
Zhang Peiyuanandrlsu9 285635e8c0 Clean up (#84) 
Co-authored-by: rlsu9 <r3su@ucsd.edu>
 2024-12-15 20:33:11 -08:00
Zhang Peiyuanandrlsu9 58cfd71b5e Cleanup 
Co-authored-by: rlsu9 <r3su@ucsd.edu>
 2024-12-15 17:03:29 -08:00
Hangliang Dingandrlsu9 3bf892b6ab update release readme (#81) 
Co-authored-by: rlsu9 <r3su@ucsd.edu>
 2024-12-15 22:24:13 +08:00
Zhang Peiyuan 85639d1101 [feat] add hunyuan adv (#79) 2024-12-13 11:52:57 -08:00
Zhang Peiyuanandforeverpiano 6ab2263f3a [Feat] Add HunyuanVideo (#78) 
Co-authored-by: foreverpiano <pianoqwz@qq.com>
 2024-12-12 14:14:09 -08:00
Zhang Peiyuanandrlsu9 b421c2e183 Cleanup (#77) 
Co-authored-by: rlsu9 <r3su@ucsd.edu>
 2024-12-12 14:04:02 -08:00
Zhang Peiyuan de1e8d868e Cleanup (#75) 2024-12-06 20:56:06 -08:00
Zhang Peiyuanandforeverpiano 8d41d505fe [cleanup] (#72) 
Co-authored-by: foreverpiano <pianoqwz@gmail.com>
 2024-12-05 21:02:10 -08:00
Zhang Peiyuan cf15594055 [Feat & Debug] fix uncond; multi guidance validaiton; multiphase schedule; linear range (#64) 
typo

update

update

typo

[Debug] Typo (#65)

debug gradient accumulation loss

update gitignore

typo

typo

update scripts

update experiment 10

new script

typo

update

update

update

update

wandb offline and dir

runlong

update

update

update

update

update

update

update

fix finetune code bug

update

update

update

add l2

update
 2024-11-30 16:43:24 -08:00
Zhang Peiyuan ce95c2df29 [Feat] EMA Distill; Distributed validation (#63) 
update
 2024-11-29 21:46:40 -08:00
Zhang Peiyuan d417e4c7c4 [Feat] Refactor GAN; State saving & Resume; Experiments script (#59) 
typo

add upload command

add

add ema_transform

add ema transformer

remove harcode

ok

ema

remove hardcode

update env

update script; no sp

revert to sp=4, sp bs=2, full shard

add aws efo env

distributed validation

readme

distributed validation

add gupload

linear range; fix uncond; multi guidance validation

add script
 2024-11-28 21:09:31 -08:00
Zhang Peiyuanandforeverpiano 7106eadffc [feat]: Add LADD (#45) 
Co-authored-by: Peiyuan Zhang <a1286225768@gmail.com>
Co-authored-by: foreverpiano <pianoqwz@gmail.com>
 2024-11-15 19:28:41 -08:00
Zhang Peiyuan b042e321a1 [Refactor] Switch to FSDP (#42) 2024-11-09 15:46:25 -08:00
rlsu9 44bda9f8a3 [feat]: Add adaptive fps dataloader and remove redundant code (#41) 
No checkout mochi
 2024-11-06 19:52:48 -08:00
rlsu9 035ba5f5cf [feat]: Add vae encoder embedded generator to main (#30) 2024-11-06 11:58:15 -08:00
Zhang Peiyuanandforeverpiano f0bc297260 [Feat] Sequence Parallel (#31) 
Co-authored-by: foreverpiano <pianoqwz@gmail.com>
 2024-11-05 08:13:01 -08:00
Peiyuan Zhang 8ec82cbc37 Generate synthetic dataset 
Delete Open Sora Plan Modeling

amend log validation

Change name to fast video

Remove OSP modeling

clean up name changing

remove files

 Deleted unnecessary files

commit first

commit first

training

ok

Update generate_synthetic.sh and deepspeed_zero2_config.yaml

14

debug

overfitting ....

debugging ..

Debug successful!

Add zero3

OK

update optimizer

load

small bug

random seed args

sp enable & still has bug

rename

update inference sp code / can run / still has bug / don't output normal mp4

switch to deepspeed dummyoptim

fix some bugs; still output green

SP inference done!

fix typos in readme and latent dataset debug file
 2024-10-28 00:44:02 +00:00
Peiyuan Zhang 857f5df51b normalize 255; vae reconstruct 2024-10-26 18:57:07 +00:00
Peiyuan Zhang c16625242e Delete merge_data.txt 2024-10-26 18:00:16 +00:00
Peiyuan Zhang 23181aac96 Update T5Base 2024-10-26 17:53:51 +00:00
Peiyuan Zhang 25498a9d85 Update model path and cache directory 2024-10-25 10:21:31 +00:00
Peiyuan Zhang 5680039dbe Add environment setup and training instructions to README.md 
Update dependencies; Setup code for debugging

Delete unused files and code

Remove all npu code

Update torchvision imports

Update EMA model and t2v_debug.sh script

Delete npu related stuff and remove inpaint module

Remove compress kv

Fix warning with dataset handling and model loading

Update PyTorch index URLs and video length tolerance range

Remove UDIT and inpaint

fix typo for dataset download

 include pretrained open-sora

Add pretrained model for OpenSoraT2V-ROPE-L

Update max height and width for video processing
 2024-10-24 17:47:34 +00:00
jzhang38 5e2e3ab06a Remove unused scripts and update TODO list 2024-10-24 02:27:03 +00:00