Self-Forcing Distillation for SFWan2.1 T2V 1.3B
These scripts demonstrate self-forcing distillation (SFwan) for the causal Wan2.1 T2V 1.3B model. The workflow mirrors DMD2 while injecting self-forcing blocks so the student can autoregressively refine later frames.
Run the recipe
- Download the preprocessed text-video dataset:
bash examples/datasets/crush-smol/download_dataset.sh - (Optional) Regenerate parquet shards locally:
bash examples/distill/SFWan2.1-T2V/preprocess_data.sh - Launch self-forcing distillation with your cluster settings:
sbatch examples/distill/SFWan2.1-T2V/distill_dmd_t2v_1.3B.sh
Update the dataset paths and wandb credentials inside the script before running on your environment.