Davids048andClaude Fable 5.1
1ea7278c00
pipeline.model is a tagged union: a mapping with exactly one key, which names the model family (ltx2, minimax_h3, longcat, or generic) and selects that family's options class. The former sibling sections pipeline.ltx2, pipeline.minimax_h3, and pipeline.longcat, and the DiT/VAE architecture override dicts pipeline.dit and pipeline.vae, live inside the family block. The parser implements tagged unions as a general mechanism (a dataclass with a TAGS table); the family is readable as pipeline.model.family. Resolution validates the tag against the family that the registry chose for model_path (validate_model_family raises and names the registry class and the right block) and fills the family's empty block when the input has none (fill_model_family), so readers never see None. Family-only fills and derivations (the MiniMax-H3 parallel-VAE environment variables, the LTX-2 tile-size derivation and refine preset copy, the LongCat BSA mirrors) run only for their family. Against the3f6893a0goldens every PipelineConfig is identical and no other field differs beyond the allowed categories; family-only settings are no longer decided on models of another family. LingBot-Video reads its refiner switch from pipeline.preset_overrides.refine.enabled and loads the refiner by default when the checkpoint has one, as at3f6893a0. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01CbSuTKA9oX4YsECdcBPAsX
61 lines
1.8 KiB
YAML
61 lines
1.8 KiB
YAML
# FastH3 on two DGX Sparks (one GPU each) over QSFP RoCE.
|
|
# Bring up the Ray cluster first: docs/getting_started/installation/spark_pair.md
|
|
#
|
|
# request.sampling below is an example, not a required recipe. Change height,
|
|
# width, num_frames, num_inference_steps, seed, and prompt. Legal H3 frame
|
|
# counts are 17n+5, max 345 (15 s).
|
|
#
|
|
# source examples/inference/optimizations/spark_pair_env.sh
|
|
# export RAY_ADDRESS=<qsfp-head>:6379
|
|
# export FASTVIDEO_HOST_IP=<qsfp-head>
|
|
# FASTVIDEO_VSA_SM100A=0 FASTVIDEO_FA4=0 FASTVIDEO_ATTENTION_BACKEND=VIDEO_SPARSE_ATTN_H3 \
|
|
# FASTVIDEO_VAE_PARALLEL_DECODE=1 FASTVIDEO_STAGE_LOGGING=1 \
|
|
# fastvideo generate --config examples/inference/basic/basic_fasth3_spark_pair.yaml
|
|
generator:
|
|
model_path: FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree
|
|
engine:
|
|
num_gpus: 2
|
|
execution_backend: ray
|
|
use_fsdp_inference: false
|
|
parallelism:
|
|
tp_size: 1
|
|
sp_size: 2
|
|
offload:
|
|
dit: false
|
|
dit_layerwise: false
|
|
text_encoder: true
|
|
vae: true
|
|
pin_cpu_memory: true
|
|
lazy_module_load: true
|
|
compile:
|
|
enabled: false
|
|
vae_enabled: true
|
|
regional: true
|
|
attention:
|
|
backend: VIDEO_SPARSE_ATTN_H3
|
|
vsa_sparsity: 0.9
|
|
vsa_tile_size: 64
|
|
pipeline:
|
|
model:
|
|
minimax_h3:
|
|
vae_parallel_decode: true
|
|
vae_parallel_decode_strategy: gather
|
|
request:
|
|
prompt: >-
|
|
A wide cinematic shot of an alpine meadow at sunrise, pale pink mountain
|
|
peaks above a blue valley filled with thin morning mist.
|
|
negative_prompt: ""
|
|
sampling:
|
|
seed: 2026
|
|
height: 768
|
|
width: 1344
|
|
num_frames: 124
|
|
fps: 24
|
|
num_inference_steps: 5
|
|
guidance_scale: 1.0
|
|
batch_cfg: false
|
|
output:
|
|
output_path: outputs/fasth3_spark_pair/
|
|
save_video: true
|
|
return_frames: false
|