- V2 config now matches the canonical 16-GPU stage 1: warmup 10, min LR ratio 0.3, HSDP 16. - State that the published V2.1 checkpoint is linears-only (BF16 VSA attention); the FP4 adaptation is a separate, non-public stage. - Name the released checkpoints and starting models. - Vendor and pin both calibrated amax tables. - Add the V2 prompt/embedding and OmniRef eval data-prep scripts.
Training Configs
Single-step training configurations organized by method and model.
configs/
├── fine_tuning/ # Standard finetuning and DFSFT
├── distribution_matching/ # DMD2 and Self-Forcing
├── knowledge_distillation/ # KD from teacher to student
└── example.yaml # Annotated reference config with all fields
Each method directory contains per-model subdirectories (e.g. wan/, hunyuan/).
Launch any config with:
bash examples/train/run.sh examples/train/configs/<method>/<model>/<config>.yaml
For multi-step training pipelines, see examples/train/scenario/.