Aryan Kumar
881400490c
[bugfix]: stabilize fastcheck lanes for Kandinsky PR
2026-07-06 11:42:26 -07:00
Will Lin and Claude Fable 5
09c42cc73a
[bugfix]: raise on unknown rope types in custom qwen2.5-vl encoder
...
The transformers-5.x compat fallback rescued every rope_type missing from
ROPE_INIT_FUNCTIONS, silently computing unscaled default frequencies for
typo'd or future scaling types; only 'default' (removed from the table in
transformers>=5) falls back now, anything else raises KeyError.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com >
2026-07-05 14:58:12 -07:00
Will Lin and Claude Fable 5
b9dfb12502
[feat]: register NABLA sparse attention as an attention backend
...
Move nablaT_v2 + the flex-attention guard out of the Kandinsky5 DiT into
fastvideo/attention/backends/nabla.py with backend/metadata/builder/impl
classes, a NABLA_ATTN enum entry, and CUDA platform wiring that refuses to
silently fall back to dense attention when flex_attention is unavailable.
Add a generic default_backend parameter to the selector and LocalAttention —
a layer-level default that the global force and FASTVIDEO_ATTENTION_BACKEND
still override — so nabla checkpoints select the backend by default while
users keep env-var control. The DiT's sparse path now dispatches through a
dedicated LocalAttention (with a direct-flex fallback for standalone parity
tests without a forward context); verified bit-identical to the previous
inline flex call.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com >
2026-07-05 14:58:12 -07:00
Will Lin and Claude Fable 5
9472ed0aab
[bugfix]: surface kandinsky5 flex-attention failures and preserve rotary dtype
...
Replace the bare except around the flex_attention import (which swallowed
every error, printed blank lines to stdout, and silently degraded NABLA
requests to dense attention over ~95k tokens) with except ImportError plus a
logger warning, and raise a RuntimeError when sparse attention is requested
without flex_attention, matching the reference implementation. Also restore
the input dtype in _apply_rotary instead of hard-casting to bf16, which
truncated fp32 q/k through a bf16 round-trip in fp32/parity runs.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com >
2026-07-05 14:58:12 -07:00
Will Lin and Claude Fable 5
6979040225
[bugfix]: make custom qwen2.5-vl encoder compatible with transformers 5.x
...
transformers>=5 stops forwarding text-model attributes from the composite
Qwen2_5_VLConfig, drops the 'default' ROPE_INIT_FUNCTIONS entry, and requires
flash-attn functions to be preloaded before _flash_attention_forward. Flatten
text_config at model entry, replicate the 4.x default rope init, and preload
flash-attn (falling back to SDPA). Fixes Kandinsky5 and Cosmos 2.5 encoder
loading under the transformers>=4.57.3 pin.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com >
2026-07-05 14:58:12 -07:00
leffff
d39e2e9fd7
fix nabla attention
2026-07-05 14:58:12 -07:00
leffff
a66fb26781
add nabla
2026-07-05 14:58:12 -07:00
Aryan Kumar
0ce6dc928f
[feat]: add kandinsky5 pipeline support
2026-07-05 14:58:12 -07:00
Mac Lee and SolitaryThinker
31aa115611
[bugfix]: preserve FSDP hooks for RMSNorm qk norms ( #1513 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-05 04:15:49 +00:00
William Lin
b36d0ef085
[infra] Add DGX Spark and multi-architecture CUDA support ( #1447 )
2026-07-03 13:41:43 -07:00
William Lin
c4e108de78
[docs]: modernize documentation build ( #1503 )
2026-06-28 02:02:09 -07:00
Kaiqin Kong
16bf2eaf77
[feat] Relativistic RoPE re-indexing for long causal rollouts ( #1454 )
2026-06-28 01:43:00 -07:00
KyleNeverGivesUp and Claude Opus 4.8
3ccdec9798
[bugfix] Make enable_torch_compile_vae actually compile the Wan VAE ( #1498 )
...
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com >
2026-06-27 12:30:59 -07:00
Loay Rashid and SolitaryThinker
995a5fdf97
[bugfix] fixing denoising time in the fastwan script ( #1480 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-06-23 10:01:23 -07:00
Kevin Lin
82ed9fe58d
[feat] QAD 5090: FP8 linear layer inference ( #1465 )
2026-06-22 18:25:06 -07:00
e60601df7f
[feat] QAD 5090: QAT training recipe — finetune + DMD distillation (12/12) ( #1462 )
...
Co-authored-by: William Lin <SolitaryThinker@users.noreply.github.com >
Co-authored-by: Loay Rashid <42599591+loaydatrain@users.noreply.github.com >
Co-authored-by: Kaiqin Kong <k1kong@ucsd.edu >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-17 15:18:52 -07:00
d922ab2cbc
[model] Flux2 Klein Port ( #1349 )
...
Co-authored-by: Gnav3852 <63612880+Gnav3852@users.noreply.github.com >
Co-authored-by: Mac Lee <macthecadillac@gmail.com >
2026-06-09 14:55:55 -07:00
2e35b0c6bd
[refactor]: linear/mlp FP4 path additions for Wan-2.1 (Attn-QAT 6/12) ( #1390 )
...
Co-authored-by: Peiyuan Zhang <a1286225768@gmail.com >
Co-authored-by: Matthew Noto <notomatthew31@gmail.com >
2026-06-08 14:51:57 -07:00
Shao Duan and SolitaryThinker
570607945c
[feat] dreamverse: sequence parallelism for serving ( #1424 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-06-01 23:13:49 -07:00
Kaiqin Kong
3f24578139
[bugfix] LTX2: honor video_position_offset_sec in the DiT ( #1422 )
2026-06-01 16:59:15 -07:00
Kevin Lin
89fcf08378
[bugfix] Fix STFT dtype mismatch ( #1419 )
2026-05-31 20:56:07 -07:00
alexzms
84214c80bb
[feat] LTX-2.3 audio: BWE vocoder path ( #1398 )
2026-05-29 16:43:26 -07:00
alexzms and mergify[bot]
c2d7143c72
[feat] LTX-2.3 transformer support (config-gated extension of LTX-2) ( #1397 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-29 16:42:37 -07:00
Kaiqin Kong and SolitaryThinker
afdb6fbfa5
[feat] Add MatrixGame3.0 ( #1201 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-05-27 21:07:01 +00:00
Junda Su
2c137931f3
[bugfix] Fix Dreamverse Modal compile warmup latency ( #1394 )
2026-05-26 17:58:38 -07:00
Wenxuan Tan and SolitaryThinker
af2ee9c78a
[feat] Optimize distributed weight loading in multi-node training ( #572 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-05-21 16:59:48 +00:00
Mingjia Huo
63030cf6ec
[fix] Fix causal self-forcing attention settings ( #1355 )
2026-05-17 22:59:47 -07:00
Kaiqin Kong and mergify[bot]
773d44b875
[misc] Rename MatrixGame to MatrixGame2 ( #1357 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-17 22:57:03 -07:00
d2ffec5cce
[perf] Dreamverse 14/14: Add LTX2 profile speedups ( #1337 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com >
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com >
2026-05-15 18:10:47 -07:00
0958c344b8
[feat] Dreamverse 13/14: Activate LTX2 integration ( #1336 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com >
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com >
2026-05-15 15:35:05 -07:00
b4de5a9f1b
[feat] Dreamverse 12/14: Add LTX2 refine and upsampler support ( #1335 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com >
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com >
2026-05-15 12:21:40 -07:00
William Lin
424c643b6e
[feat]: MagiHuman pipeline stages (4/8) ( #1298 )
2026-05-12 14:59:21 -07:00
William Lin
de803cb250
[feat]: MagiHuman DiT (transformer) port + parity tests (3/8) ( #1297 )
2026-05-12 14:49:03 -07:00
William Lin
b1ddb1ba33
[feat]: T5-Gemma encoder for MagiHuman pipeline (2/8) ( #1296 )
2026-05-12 13:59:55 -07:00
Raghav K
9d0af28307
[feat] Add Cosmos 2.5 T2W training pipeline (LoRA + full fine-tune) ( #1227 )
2026-05-11 19:15:00 -07:00
d6dfe95466
[feat] FastVideo World Model Training ( #1179 )
...
Co-authored-by: mignonjia <mhuo@ucsd.edu >
Co-authored-by: alexzms <3036648523@qq.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-11 05:13:12 +00:00
f633e30ebb
[feat]: add LongCat bidirectional finetuning support ( #1244 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
Co-authored-by: alexzms <3036648523@qq.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-09 12:20:43 -07:00
William Lin
140bd1a6cf
[misc]: standardize install instructions on uv pip install ( #1279 )
2026-05-02 12:45:50 -07:00
William Lin
c85f6a477f
[docs] add hierarchical AGENTS.md per-directory guidance ( #1278 )
2026-05-02 03:28:18 -07:00
alexzms and mergify[bot]
74d09b0efd
[misc] cleanup: grad-norm asserts, dead offload file, callback names ( #1268 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-01 01:16:13 -07:00
William Lin
c77a76c6af
[feat] Stable Audio Open 1.0: T2A + A2A + RePaint inpainting (native) ( #1260 )
2026-05-01 00:07:11 -07:00
alexzms
d14d5aadea
[feat] Cosmos 2.5 training support in fastvideo.train ( #1224 )
2026-05-01 01:15:02 +00:00
vishruthb
5789955bbe
[feat] add gen3c (cosmos-7b) model and pipeline support ( #1059 )
2026-04-01 11:42:02 +00:00
alexzms
2085a4fc4a
[bugfix]: fix VAE temporal tiling blend corruption in tiled_encode ( #1181 )
2026-03-29 23:12:42 +00:00
jaisurya27
4d49f7b0aa
Kandinsky5 lite dit clean ( #1088 )
2026-03-26 08:07:11 +08:00
alexzms
14261bc98c
[feat] pre-commit support 120 col num ( #1167 )
2026-03-11 20:19:30 -07:00
Zhang Peiyuan
cd1b7cf139
[Refactor] SP Mask --> original seq len; HunyuanVideo 1.5 does not need mask ( #1142 )
2026-03-04 11:44:47 +08:00
Zhang Peiyuan
d902967208
Py/fix sp ( #1138 )
2026-02-27 12:14:44 +08:00
William Lin
69dd3c68f6
[bugfix] fix matrix game kv indexing and CI ( #1135 )
2026-02-26 01:24:42 -08:00
Zhang Peiyuan and Will Lin
fc80d95d7e
[Misc] Remove STA ( #1124 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-02-23 15:14:42 -08:00
Aryan Kumar