SolitaryThinker
a16ce1a07f
Five self-contained, runnable scripts (CPU/numpy) for the Wan2.1-1.3B card on the v2 runtime, each bootstrapping the repo onto sys.path so they run from anywhere: - 01_basic_t2v.py minimal path: build engine → T2V request → run → video - 02_params_and_reproducibility.py DiffusionParams knobs + seeded bit-identical reproducibility - 03_streaming.py per-denoise-step preview chunks (OutputSpec stream) - 04_concurrent_interleaved.py step-interleaved batching + interleave parity gate + cache reuse - 05_async_serving.py AsyncEngine: concurrent generate, event stream, step-boundary cancel + README.md indexing them. All five run green; use only the public API.
26 lines
1.5 KiB
Markdown
26 lines
1.5 KiB
Markdown
# v2_examples/inference — Wan2.1-1.3B
|
|
|
|
Runnable, self-contained **inference** examples for the Wan2.1-1.3B *(recipe, runtime)* card on the
|
|
`v2` runtime. CPU + numpy only — the architecture (cards, driven loops, scheduler, caches, parity) is
|
|
real; the neural forwards are numpy toys (see [`../../v2/README.md`](../../v2/README.md) and
|
|
[`../../designv4.md`](../../designv4.md)). On a GPU box you swap `ComponentSpec.factory` for the torch
|
|
Wan adapter and **none of these scripts change**.
|
|
|
|
Each script bootstraps the repo onto `sys.path`, so run it from anywhere:
|
|
|
|
```bash
|
|
python3 v2_examples/inference/01_basic_t2v.py
|
|
```
|
|
|
|
| Script | What it shows |
|
|
|---|---|
|
|
| `01_basic_t2v.py` | the minimal path: build engine → typed T2V request → `run` → read the video artifact |
|
|
| `02_params_and_reproducibility.py` | `DiffusionParams` knobs (steps / CFG guidance / resolution) + seeded bit-identical reproducibility |
|
|
| `03_streaming.py` | per-denoise-step preview chunks via `OutputSpec(stream=...)` (off by default) |
|
|
| `04_concurrent_interleaved.py` | step-interleaved batching, the **interleave parity gate** (serial == interleaved), shared-prompt feature-cache reuse |
|
|
| `05_async_serving.py` | `AsyncEngine`: concurrent generate, live event streaming, step-boundary cancellation |
|
|
|
|
All five use only the public API (`v2.models.build_default_engine`, `v2.request.make_request`,
|
|
`v2.runtime.AsyncEngine`). For the OpenAI HTTP server, disaggregated pools, and the fleet/Dynamo path,
|
|
see `python3 -m v2.examples` (example *h*).
|