JerryZhou54 42a2f272d5 Preprocessing Stage: 1. Save to parquets periodically 2. Allow resuming from the middle 3. Doesn't support multi-gpu for now. Data Loader Stage: 1. Allow multi-gpu dataloader 2. Doesn't drop files even if number of parquet files is not divisible by num_gpus 3. Able to resume training

2025-05-23 00:57:39 +00:00

..

dataset_preparation

[Misc] Replace instances of time.time() with time.perf_counter() (#396)

2025-05-11 15:56:39 -07:00

distill

Finish data preprocessing and loading

2025-05-21 22:34:03 +00:00

finetune

adding hunyuan hf (support lora finetuning); unified hunyuan hf inference with quantization (#135)

2025-01-13 19:47:42 -08:00

huggingface

[Feat] Add STA for StepVideo (#200)

2025-02-20 11:33:58 -08:00

inference

Zihang stepvideo v1 (#389)

2025-05-11 14:41:42 -07:00

preprocess

Preprocessing Stage: 1. Save to parquets periodically 2. Allow resuming from the middle 3. Doesn't support multi-gpu for now. Data Loader Stage: 1. Allow multi-gpu dataloader 2. Doesn't drop files even if number of parquet files is not divisible by num_gpus 3. Able to resume training

2025-05-23 00:57:39 +00:00