diff --git a/README.md b/README.md index 445ec157d..fb293374a 100644 --- a/README.md +++ b/README.md @@ -33,7 +33,7 @@ FastVideo has the following features: - [Sparse distillation](https://hao-ai-lab.github.io/blogs/fastvideo_post_training/) to achieve >50x denoising speedup - Scalable training with FSDP2, sequence parallelism, and selective activation checkpointing. - Causal distillation through Self-Forcing - - See this [page](https://hao-ai-lab.github.io/FastVideo/training/overview/) for full list of supported models and recipes. + - See this [page](https://hao-ai-lab.github.io/FastVideo/training/overview/) for the supported training workflows, and the [support matrix](https://hao-ai-lab.github.io/FastVideo/inference/support_matrix/) for supported models. - State-of-the-art performance optimizations for inference - Sequence Parallelism for distributed inference - Multiple state-of-the-art attention backends diff --git a/docs/getting_started/installation.md b/docs/getting_started/installation.md index cfda9fac2..0818b875f 100644 --- a/docs/getting_started/installation.md +++ b/docs/getting_started/installation.md @@ -54,8 +54,10 @@ UV_TORCH_BACKEND=cu126 uv pip install -e . uv pip install flash-attn --no-build-isolation -v ``` -## Hardware Requirements +## Requirements +- **Python**: 3.10-3.12 is the tested and recommended range (the commands + above pin 3.12) - **NVIDIA GPUs**: CUDA 12.6+ with compute capability 7.0+ - **Apple Silicon**: macOS 14.0+ with M1/M2/M3/M4 chips - **CPU**: x86_64 architecture (for CPU-only inference) diff --git a/docs/index.md b/docs/index.md index 86b7a1e00..4ad651866 100644 --- a/docs/index.md +++ b/docs/index.md @@ -5,7 +5,7 @@
-FastVideo is a unified inference and post-training framework for accelerated video generation. +FastVideo is a unified post-training and real-time inference framework for accelerated video generation.
@@ -25,14 +25,23 @@ FastVideo is an inference and post-training framework for diffusion models. It f FastVideo has the following features: +- End-to-end post-training support for bidirectional and autoregressive models + - Full finetuning and LoRA [finetuning](training/finetune.md) for state-of-the-art open video DiTs + - [Data preprocessing pipeline](training/data_preprocess.md) for video, image, and text data + - [Distribution Matching Distillation (DMD2)](distillation/dmd.md) stepwise distillation + - Sparse attention with [Video Sparse Attention](attention/vsa/index.md) + - [Sparse distillation](https://hao-ai-lab.github.io/blogs/fastvideo_post_training/) to achieve >50x denoising speedup + - [Attn-QAT training](training/attn_qat.md) for quantization-aware post-training + - Causal distillation through Self-Forcing + - Scalable training with FSDP2, sequence parallelism, and selective activation checkpointing + - See the [training overview](training/overview.md) for the full training workflow - State-of-the-art performance optimizations for inference - - [Sliding Tile Attention](attention/sta/index.md) - - [Sage Attention](https://arxiv.org/abs/2410.02367) -- E2E post-training support - - Data preprocessing pipeline for video data - - [Sparse distillation](https://hao-ai-lab.github.io/blogs/fastvideo_post_training/) for Wan2.1 and Wan2.2 using [Video Sparse Attention](https://arxiv.org/pdf/2505.13389) and [Distribution Matching Distillation](https://tianweiy.github.io/dmd2/) - - Support full finetuning and LoRA finetuning for state-of-the-art open video DiTs. - - Scalable training with FSDP2, sequence parallelism, and selective activation checkpointing, with near linear scaling to 64 GPUs. + - Sequence parallelism for distributed inference + - Multiple state-of-the-art [attention backends](attention/index.md) + - User-friendly [CLI](inference/cli.md) and Python API + - See the [support matrix](inference/support_matrix.md) for supported models and [optimizations](inference/optimizations.md) for the full list +- Realtime video generation and editing + - [Dreamverse](https://github.com/hao-ai-lab/FastVideo/tree/main/apps/dreamverse): stream and "vibe direct" video in realtime ([live demo](https://dreamverse.fastvideo.org/)) ## Documentation diff --git a/docs/inference/inference_quick_start.md b/docs/inference/inference_quick_start.md index 488f81b58..c3e7849f6 100644 --- a/docs/inference/inference_quick_start.md +++ b/docs/inference/inference_quick_start.md @@ -4,10 +4,11 @@ This page contains step-by-step instructions to get you quickly started with vid ## Requirements -- **OS**: Linux (Tested on Ubuntu 22.04+) +- **OS**: Linux (tested on Ubuntu 22.04+), or macOS on Apple silicon via the + [MPS installation guide](../getting_started/installation/mps.md) - **Python**: 3.10-3.12 -- **CUDA**: 12.6 or 13.0 -- **GPU**: At least one NVIDIA GPU +- **CUDA**: 12.6 or 13.0 (NVIDIA GPUs) +- **GPU**: At least one NVIDIA GPU, or an Apple silicon chip with MPS ## Installation diff --git a/mkdocs.yml b/mkdocs.yml index 3cc6a92a0..e47f2fe4b 100644 --- a/mkdocs.yml +++ b/mkdocs.yml @@ -163,8 +163,11 @@ nav: - CLI: inference/cli.md - Add Pipeline: inference/add_pipeline.md - Examples: + - Examples Index: inference/examples/examples_inference_index.md - Basic: inference/examples/basic.md - Optimizations: inference/examples/optimizations.md + - LTX-2.3: inference/examples/ltx2_3.md + - LTX-2.3 Gradio Demo: inference/examples/gradio_local_demo_ltx2_3.md - STA Mask Search (Archived): inference/examples/sta_mask_search.md - Training: - Overview: training/overview.md