JerryZhou54 42a2f272d5 Preprocessing Stage: 1. Save to parquets periodically 2. Allow resuming from the middle 3. Doesn't support multi-gpu for now. Data Loader Stage: 1. Allow multi-gpu dataloader 2. Doesn't drop files even if number of parquet files is not divisible by num_gpus 3. Able to resume training

2025-05-23 00:57:39 +00:00

..

preprocess_text_embeddings.py

[Feat] Add STA for StepVideo (#200)

2025-02-20 11:33:58 -08:00

preprocess_vae_latents.py

[Feat] Add STA for StepVideo (#200)

2025-02-20 11:33:58 -08:00

preprocess_validation_text_embeddings.py

[Feat] Add STA for StepVideo (#200)

2025-02-20 11:33:58 -08:00

preprocess.py

Preprocessing Stage: 1. Save to parquets periodically 2. Allow resuming from the middle 3. Doesn't support multi-gpu for now. Data Loader Stage: 1. Allow multi-gpu dataloader 2. Doesn't drop files even if number of parquet files is not divisible by num_gpus 3. Able to resume training

2025-05-23 00:57:39 +00:00