diff --git a/docs/source/distillation/dmd.md b/docs/source/distillation/dmd.md index ea5ab5572..74a3cbc4f 100644 --- a/docs/source/distillation/dmd.md +++ b/docs/source/distillation/dmd.md @@ -6,7 +6,7 @@ We introduce a new finetuning strategy - **Sparse-distill**, which jointly integ We provide two distilled models: -- **[FastWan2.1-T2V-1.3B-Diffusers](https://huggingface.co/FastVideo/FastWan2.1-T2V-1.3B-Diffusers)**: 3-step inference, up to **20 FPS** on H100 GPU +- **[FastWan2.1-T2V-1.3B-Diffusers](https://huggingface.co/FastVideo/FastWan2.1-T2V-1.3B-Diffusers)**: 3-step inference, up to **16 FPS** on H100 GPU - **[FastWan2.1-T2V-14B-480P-Diffusers](https://huggingface.co/FastVideo/FastWan2.1-T2V-14B-480P-Diffusers)**: 3-step inference, up to **60x speed up** at 480P, **90x speed up** at 720P for denoising loop - **[FastWan2.2-TI2V-5B-FullAttn-Diffusers](https://huggingface.co/FastVideo/FastWan2.2-TI2V-5B-FullAttn-Diffusers)**: 3-step inference, up to **50x speed up** at 720P for denoising loop diff --git a/docs/source/sliding_tile_attention/installation.md b/docs/source/sliding_tile_attention/installation.md index 9069bcdd0..46bde6b6f 100644 --- a/docs/source/sliding_tile_attention/installation.md +++ b/docs/source/sliding_tile_attention/installation.md @@ -53,3 +53,9 @@ out = sliding_tile_attention(q, k, v, window_size, text_length) out = sliding_tile_attention(q, k, v, window_size, 0, False) ``` + +# 🚀Inference + +```bash +bash scripts/inference/v1_inference_wan_STA.sh +``` diff --git a/docs/source/video_sparse_attention/installation.md b/docs/source/video_sparse_attention/installation.md index 78a9a907c..00192802b 100644 --- a/docs/source/video_sparse_attention/installation.md +++ b/docs/source/video_sparse_attention/installation.md @@ -59,3 +59,9 @@ from vsa import video_sparse_attn output = video_sparse_attn(q, k, v, variable_block_sizes, topk, block_size, compress_attn_weight) ``` + +# 🚀Inference + +```bash +bash scripts/inference/v1_inference_wan_VSA.sh +``` diff --git a/examples/distill/Wan2.2-TI2V-5B-Diffusers/Data-free/README.md b/examples/distill/Wan2.2-TI2V-5B-Diffusers/Data-free/README.md new file mode 100644 index 000000000..f709a92da --- /dev/null +++ b/examples/distill/Wan2.2-TI2V-5B-Diffusers/Data-free/README.md @@ -0,0 +1,13 @@ +# Wan2.2-5B Distill Example +These are end-to-end example scripts for distilling Wan2.2 TI2V 5B model DMD+VSA methods. + +### 0. Make sure you have installed VSA + +```bash +cd csrc/attn +git submodule update --init --recursive +python setup_vsa.py install +``` + +### Data-free Distillation +When `--simulate_generator_forward` is enabled, distillation becomes data-free by simulating intermediate steps through forward inference of the generator. This helps avoid training–inference mismatch. See Section 4.5 of [DMD2](https://arxiv.org/pdf/2405.14867) for details. \ No newline at end of file diff --git a/examples/distill/Wan2.2-TI2V-5B-Diffusers/crush_smol/README.md b/examples/distill/Wan2.2-TI2V-5B-Diffusers/crush_smol/README.md index bb05d2a48..0c71a0005 100644 --- a/examples/distill/Wan2.2-TI2V-5B-Diffusers/crush_smol/README.md +++ b/examples/distill/Wan2.2-TI2V-5B-Diffusers/crush_smol/README.md @@ -9,4 +9,14 @@ git submodule update --init --recursive python setup_vsa.py install ``` -### TODO \ No newline at end of file +### 1. Download dataset: +```bash +bash examples/distill/Wan2.2-TI2V-5B-Diffusers/crush_smol/download_dataset.sh +``` + +### 2. Configure and run distillation: + +#### For DMD-only distillation: +```bash +bash examples/distill/Wan2.2-TI2V-5B-Diffusers/crush_smol/examples/distill/Wan2.2-TI2V-5B-Diffusers/crush_smol/ +```