Will Lin and Claude Fable 5
b9dfb12502
[feat]: register NABLA sparse attention as an attention backend
...
Move nablaT_v2 + the flex-attention guard out of the Kandinsky5 DiT into
fastvideo/attention/backends/nabla.py with backend/metadata/builder/impl
classes, a NABLA_ATTN enum entry, and CUDA platform wiring that refuses to
silently fall back to dense attention when flex_attention is unavailable.
Add a generic default_backend parameter to the selector and LocalAttention —
a layer-level default that the global force and FASTVIDEO_ATTENTION_BACKEND
still override — so nabla checkpoints select the backend by default while
users keep env-var control. The DiT's sparse path now dispatches through a
dedicated LocalAttention (with a direct-flex fallback for standalone parity
tests without a forward context); verified bit-identical to the previous
inline flex call.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com >
2026-07-05 14:58:12 -07:00
Will Lin and Claude Fable 5
4eb4e252eb
[bugfix]: preserve tokenizer_kwargs customizations across update_model_arch
...
TextEncoderArchConfig.__post_init__ rebuilt tokenizer_kwargs from scratch, and
TextEncoderLoader.load -> update_model_arch re-runs __post_init__, silently
wiping customizations applied by pipeline configs (kandinsky5/gen3c/longcat
set 'padding'; multi-prompt kandinsky5 runs then crash on ragged sequences).
Merge defaults under existing keys instead of rebuilding.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com >
2026-07-05 14:58:12 -07:00
Aryan Kumar
0ce6dc928f
[feat]: add kandinsky5 pipeline support
2026-07-05 14:58:12 -07:00
Kaiqin Kong
16bf2eaf77
[feat] Relativistic RoPE re-indexing for long causal rollouts ( #1454 )
2026-06-28 01:43:00 -07:00
1dee77f4a4
[feat] QAD 5090: Wire the Attn-QAT training attention backend (10/12) ( #1459 )
...
Co-authored-by: William Lin <SolitaryThinker@users.noreply.github.com >
Co-authored-by: Loay Rashid <42599591+loaydatrain@users.noreply.github.com >
Co-authored-by: Kaiqin Kong <k1kong@ucsd.edu >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: alexzms <26690162+alexzms@users.noreply.github.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-17 13:32:56 -07:00
88e753f281
[feat] QAD 5090: Wire the Attn-QAT inference attention backend (8/12) ( #1457 )
...
Co-authored-by: William Lin <SolitaryThinker@users.noreply.github.com >
Co-authored-by: Loay Rashid <42599591+loaydatrain@users.noreply.github.com >
Co-authored-by: Kaiqin Kong <k1kong@ucsd.edu >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: alexzms <26690162+alexzms@users.noreply.github.com >
2026-06-16 13:12:33 -07:00
d922ab2cbc
[model] Flux2 Klein Port ( #1349 )
...
Co-authored-by: Gnav3852 <63612880+Gnav3852@users.noreply.github.com >
Co-authored-by: Mac Lee <macthecadillac@gmail.com >
2026-06-09 14:55:55 -07:00
c2930b2aa1
[ci] Add additional Dreamverse UI tests ( #1417 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-31 19:53:29 -07:00
alexzms and mergify[bot]
c2d7143c72
[feat] LTX-2.3 transformer support (config-gated extension of LTX-2) ( #1397 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-29 16:42:37 -07:00
Kaiqin Kong and SolitaryThinker
afdb6fbfa5
[feat] Add MatrixGame3.0 ( #1201 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-05-27 21:07:01 +00:00
Kaiqin Kong and mergify[bot]
773d44b875
[misc] Rename MatrixGame to MatrixGame2 ( #1357 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-17 22:57:03 -07:00
d45d82334f
[infra] Dreamverse 11/14: Add NVFP4 quantization support ( #1334 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com >
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com >
2026-05-14 16:26:39 -07:00
William Lin
de803cb250
[feat]: MagiHuman DiT (transformer) port + parity tests (3/8) ( #1297 )
2026-05-12 14:49:03 -07:00
William Lin
b1ddb1ba33
[feat]: T5-Gemma encoder for MagiHuman pipeline (2/8) ( #1296 )
2026-05-12 13:59:55 -07:00
Raghav K
9d0af28307
[feat] Add Cosmos 2.5 T2W training pipeline (LoRA + full fine-tune) ( #1227 )
2026-05-11 19:15:00 -07:00
William Lin
c77a76c6af
[feat] Stable Audio Open 1.0: T2A + A2A + RePaint inpainting (native) ( #1260 )
2026-05-01 00:07:11 -07:00
alexzms
d14d5aadea
[feat] Cosmos 2.5 training support in fastvideo.train ( #1224 )
2026-05-01 01:15:02 +00:00
vishruthb
5789955bbe
[feat] add gen3c (cosmos-7b) model and pipeline support ( #1059 )
2026-04-01 11:42:02 +00:00
jaisurya27
4d49f7b0aa
Kandinsky5 lite dit clean ( #1088 )
2026-03-26 08:07:11 +08:00
alexzms
14261bc98c
[feat] pre-commit support 120 col num ( #1167 )
2026-03-11 20:19:30 -07:00
Zhang Peiyuan
cd1b7cf139
[Refactor] SP Mask --> original seq len; HunyuanVideo 1.5 does not need mask ( #1142 )
2026-03-04 11:44:47 +08:00
Peiyuan Zhang
e1eda47589
remove temporal frame adjustment
2026-02-27 20:47:16 +00:00
Zhang Peiyuan and Will Lin
fc80d95d7e
[Misc] Remove STA ( #1124 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-02-23 15:14:42 -08:00
Zhang Peiyuan
128d0b7fc5
[Misc] Remove Teacache ( #1121 )
2026-02-22 16:53:07 -08:00
Zhang Peiyuan
03d9ce2edb
[Misc] Remove StepVideo ( #1118 )
2026-02-21 17:15:42 -08:00
10fc92dba5
Upstream LTX2 Training ( #1116 )
...
Co-authored-by: RandNMR73 <notomatthew31@gmail.com >
Co-authored-by: JerryZhou54 <zhouw.jerry2017@outlook.com >
Co-authored-by: Davids048 <jundasu@ucsd.edu >
Co-authored-by: Peiyuan Zhang <a1286225768@slurm-h200-204-239.slurm-compute.tenant-slurm.svc.cluster.local >
2026-02-21 16:06:55 -08:00
8e39ce38c9
[Feat] Native dit implementation for SD3.5 ( #1093 )
...
Co-authored-by: Ishan Vaish <vaish.ishan@gmail.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-02-18 10:19:40 +08:00
Mihir Jagtap
7a83e0e6fc
[feature] Add Hunyuan-GameCraft model support ( #1071 )
2026-02-14 08:07:44 +08:00
Kaiqin Kong
31c0f1b341
[feat] Port LingBot-World-Base (Cam) ( #1081 )
2026-02-10 11:12:33 -08:00
Ishan and Jinzhe Pan
0aff68f51d
[Feat] Add Stable Diffusion 3.5 ( #1075 )
...
Co-authored-by: Jinzhe Pan <eigensystem1318@gmail.com >
2026-02-10 14:31:36 +08:00
ad58f802f3
[Feat] Port LTX2 trainer ( #1074 )
...
Co-authored-by: Davids048 <jundasu@ucsd.edu >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
2026-02-09 17:32:57 -08:00
XOR-op
f76efe798e
[bugfix]: _compile_conditions regression ( #1077 )
2026-02-06 18:57:43 -08:00
Wei Zhou
98308db7e0
[Feature] [Hy1.5] Support HY1.5 super-resolution pipeline for 1080p videos ( #1046 )
2026-02-05 16:39:20 -08:00
Mingjia Huo
aae48a7e90
[feat] HYworld VAE with cache ( #1057 )
2026-02-05 04:18:17 -08:00
Wei Zhou
7e2f3f14e7
[Bugfix] [Wan I2V] Fix CLIP Image encoder config ( #1063 )
2026-02-04 13:20:19 -08:00
Kaiqin Kong
0c6862ca55
[feature] Add Matrix Game 2.0 training ( #1017 )
...
The CI tests are quite unstable, but since multiple CI tests indicates that each individual tests are passed, I think we can merge this.
2026-01-26 19:21:43 -08:00
Mingjia Huo
59e00f6164
[feat] Add HY-World1.5-Bidirectional-480P-I2V ( #1027 )
...
VAE requires further improvement, will raise PR in near future.
2026-01-23 14:18:04 -08:00
Shao Duan and Will Lin
029216029f
Added LTX-2 Distilled T2V Generation ( #1016 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-01-21 14:11:39 -08:00
KyleShao
dbddfab6d2
[feat] Introduce Cosmos 2.5 Text2World pipeline ( #974 )
2026-01-15 15:09:05 -08:00
Will Lin
4d7bf35fa3
Revert "dit"
...
This reverts commit a6a9c9ca07
2026-01-07 03:22:48 -08:00
Will Lin
a6a9c9ca07
dit
2026-01-07 03:18:48 -08:00
Shao Duan
d6ddcea682
Add LongCat-Video I2V and Video Continuation (Base, Distillation and Refinement) Support to FastVideo ( #953 )
2026-01-04 22:20:09 -06:00
Loay Rashid
dea69cf651
[New Model] Turbodiffusion ( #971 )
2026-01-02 17:55:56 -06:00
alexzms and Shao Duan
8f1e6c3336
Add LongCat T2V (Base, Distillation and Refinement) Support to FastVideo ( #883 )
...
Co-authored-by: Shao Duan <shaoxiongduan@gmail.com >
2025-12-23 01:11:18 -06:00
Wei Zhou
1f70032af5
[New Model] Hunyuan1.5 ( #943 )
2025-12-21 00:57:52 -06:00
Kaiqin Kong
8fe1689968
[feat] Add Matrix-Game 2.0 ( #938 )
2025-12-20 14:09:12 -06:00
KyleShao and KyleS1016
e04a192de6
[feat]: add COSMOS 2.5 DiT implementation ( #897 )
...
Co-authored-by: KyleS1016 <kyle.s@gmicloud.ai >
2025-12-07 21:48:32 -08:00
Kevin Lin
543fea88e3
[Feature] Add Cosmos2 i2v pipeline ( #837 )
2025-10-30 20:03:57 -07:00
Jiali Chen
404314d00f
[Feature]Add video-to-video (V2V) pipeline ( #829 )
2025-10-12 21:53:05 -07:00
RandNMR73
13d0aae706
Add Sage Attention 3 Backend ( #815 )
2025-09-24 15:11:38 -07:00
