Aryan Kumar
881400490c
[bugfix]: stabilize fastcheck lanes for Kandinsky PR
2026-07-06 11:42:26 -07:00
Will Lin and Claude Fable 5
b9dfb12502
[feat]: register NABLA sparse attention as an attention backend
...
Move nablaT_v2 + the flex-attention guard out of the Kandinsky5 DiT into
fastvideo/attention/backends/nabla.py with backend/metadata/builder/impl
classes, a NABLA_ATTN enum entry, and CUDA platform wiring that refuses to
silently fall back to dense attention when flex_attention is unavailable.
Add a generic default_backend parameter to the selector and LocalAttention —
a layer-level default that the global force and FASTVIDEO_ATTENTION_BACKEND
still override — so nabla checkpoints select the backend by default while
users keep env-var control. The DiT's sparse path now dispatches through a
dedicated LocalAttention (with a direct-flex fallback for standalone parity
tests without a forward context); verified bit-identical to the previous
inline flex call.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com >
2026-07-05 14:58:12 -07:00
Will Lin and Claude Fable 5
4eb4e252eb
[bugfix]: preserve tokenizer_kwargs customizations across update_model_arch
...
TextEncoderArchConfig.__post_init__ rebuilt tokenizer_kwargs from scratch, and
TextEncoderLoader.load -> update_model_arch re-runs __post_init__, silently
wiping customizations applied by pipeline configs (kandinsky5/gen3c/longcat
set 'padding'; multi-prompt kandinsky5 runs then crash on ragged sequences).
Merge defaults under existing keys instead of rebuilding.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com >
2026-07-05 14:58:12 -07:00
Will Lin and Claude Fable 5
74de6f27a2
[bugfix]: fix kandinsky5 t2v frame-0 denoising and restore trained prompt template
...
Denoising keyed cond_frames off transformer.visual_cond, but official T2V
checkpoints also ship visual_cond=true, so latent frame 0 was never stepped
and decoded as pure noise in every T2V video; key off batch.image_latent
instead. Restore the byte-exact upstream prompt template (typos included):
the checkpoints were trained with it, and ENCODE_START_IDX=129 matches the
upstream template while the corrected wording moves user content to 127,
silently dropping the first user-prompt tokens. Verified against the
checkpoint tokenizer and by end-to-end T2V/I2V generation.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com >
2026-07-05 14:58:12 -07:00
Aryan Kumar
c57fa1eab0
[misc]: polish kandinsky5 sparse attention updates
2026-07-05 14:58:12 -07:00
leffff
313c2985f0
[feat] add support for Kandinsky5 I2V
2026-07-05 14:58:12 -07:00
coderabbitai[bot] and CodeRabbit
dae7c0da89
fix: apply CodeRabbit auto-fixes
...
Fixed 2 file(s) based on 2 unresolved review comments.
Co-authored-by: CodeRabbit <noreply@coderabbit.ai >
2026-07-05 14:58:12 -07:00
Aryan Kumar
0ce6dc928f
[feat]: add kandinsky5 pipeline support
2026-07-05 14:58:12 -07:00
Kaiqin Kong
16bf2eaf77
[feat] Relativistic RoPE re-indexing for long causal rollouts ( #1454 )
2026-06-28 01:43:00 -07:00
Raghav K
4f3ad3f6df
[perf] Default Wan VAE decode to bf16 (lossless, faster) ( #1472 )
2026-06-26 12:42:29 -07:00
1dee77f4a4
[feat] QAD 5090: Wire the Attn-QAT training attention backend (10/12) ( #1459 )
...
Co-authored-by: William Lin <SolitaryThinker@users.noreply.github.com >
Co-authored-by: Loay Rashid <42599591+loaydatrain@users.noreply.github.com >
Co-authored-by: Kaiqin Kong <k1kong@ucsd.edu >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: alexzms <26690162+alexzms@users.noreply.github.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-17 13:32:56 -07:00
88e753f281
[feat] QAD 5090: Wire the Attn-QAT inference attention backend (8/12) ( #1457 )
...
Co-authored-by: William Lin <SolitaryThinker@users.noreply.github.com >
Co-authored-by: Loay Rashid <42599591+loaydatrain@users.noreply.github.com >
Co-authored-by: Kaiqin Kong <k1kong@ucsd.edu >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: alexzms <26690162+alexzms@users.noreply.github.com >
2026-06-16 13:12:33 -07:00
Aryan Kumar and Aryan Kumar
7f539424cb
[feat]: add Lucy Edit inference scaffold ( #1363 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-06-09 15:21:43 -07:00
d922ab2cbc
[model] Flux2 Klein Port ( #1349 )
...
Co-authored-by: Gnav3852 <63612880+Gnav3852@users.noreply.github.com >
Co-authored-by: Mac Lee <macthecadillac@gmail.com >
2026-06-09 14:55:55 -07:00
c2930b2aa1
[ci] Add additional Dreamverse UI tests ( #1417 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-31 19:53:29 -07:00
alexzms and mergify[bot]
c2d7143c72
[feat] LTX-2.3 transformer support (config-gated extension of LTX-2) ( #1397 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-29 16:42:37 -07:00
Kaiqin Kong and SolitaryThinker
afdb6fbfa5
[feat] Add MatrixGame3.0 ( #1201 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-05-27 21:07:01 +00:00
Kaiqin Kong and mergify[bot]
773d44b875
[misc] Rename MatrixGame to MatrixGame2 ( #1357 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-17 22:57:03 -07:00
d45d82334f
[infra] Dreamverse 11/14: Add NVFP4 quantization support ( #1334 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com >
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com >
2026-05-14 16:26:39 -07:00
William Lin
de803cb250
[feat]: MagiHuman DiT (transformer) port + parity tests (3/8) ( #1297 )
2026-05-12 14:49:03 -07:00
William Lin
b1ddb1ba33
[feat]: T5-Gemma encoder for MagiHuman pipeline (2/8) ( #1296 )
2026-05-12 13:59:55 -07:00
Raghav K
9d0af28307
[feat] Add Cosmos 2.5 T2W training pipeline (LoRA + full fine-tune) ( #1227 )
2026-05-11 19:15:00 -07:00
William Lin
c85f6a477f
[docs] add hierarchical AGENTS.md per-directory guidance ( #1278 )
2026-05-02 03:28:18 -07:00
William Lin
c77a76c6af
[feat] Stable Audio Open 1.0: T2A + A2A + RePaint inpainting (native) ( #1260 )
2026-05-01 00:07:11 -07:00
alexzms
d14d5aadea
[feat] Cosmos 2.5 training support in fastvideo.train ( #1224 )
2026-05-01 01:15:02 +00:00
William Lin
70ee5d230c
[feat] [6/n] Improve API: LTX-2 public preset + asset wiring + gpu_pool translation ( #1239 )
2026-04-23 11:36:45 -07:00
William Lin
145a3f166b
[feat] [4/n] Improve API: refactor sampling param and merge with presets ( #1234 )
2026-04-16 14:10:02 -07:00
vishruthb
5789955bbe
[feat] add gen3c (cosmos-7b) model and pipeline support ( #1059 )
2026-04-01 11:42:02 +00:00
jaisurya27
4d49f7b0aa
Kandinsky5 lite dit clean ( #1088 )
2026-03-26 08:07:11 +08:00
alexzms
14261bc98c
[feat] pre-commit support 120 col num ( #1167 )
2026-03-11 20:19:30 -07:00
Zhang Peiyuan
cd1b7cf139
[Refactor] SP Mask --> original seq len; HunyuanVideo 1.5 does not need mask ( #1142 )
2026-03-04 11:44:47 +08:00
Peiyuan Zhang
e1eda47589
remove temporal frame adjustment
2026-02-27 20:47:16 +00:00
Zhang Peiyuan
fea556269b
[Misc] Fix memory leakage in VideoGenerator ( #1132 )
2026-02-26 19:51:32 -08:00
Zhang Peiyuan
f8d9a0c57f
[misc] fix hunyuan ( #1125 )
2026-02-25 08:26:29 +08:00
Zhang Peiyuan and Will Lin
fc80d95d7e
[Misc] Remove STA ( #1124 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-02-23 15:14:42 -08:00
Shao Duan and SolitaryThinker
37cab18780
[bugfix] Added ltx2 guidance missing modulation term ( #1100 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-02-23 14:22:31 -08:00
Zhang Peiyuan
128d0b7fc5
[Misc] Remove Teacache ( #1121 )
2026-02-22 16:53:07 -08:00
Zhang Peiyuan
03d9ce2edb
[Misc] Remove StepVideo ( #1118 )
2026-02-21 17:15:42 -08:00
10fc92dba5
Upstream LTX2 Training ( #1116 )
...
Co-authored-by: RandNMR73 <notomatthew31@gmail.com >
Co-authored-by: JerryZhou54 <zhouw.jerry2017@outlook.com >
Co-authored-by: Davids048 <jundasu@ucsd.edu >
Co-authored-by: Peiyuan Zhang <a1286225768@slurm-h200-204-239.slurm-compute.tenant-slurm.svc.cluster.local >
2026-02-21 16:06:55 -08:00
8e39ce38c9
[Feat] Native dit implementation for SD3.5 ( #1093 )
...
Co-authored-by: Ishan Vaish <vaish.ishan@gmail.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-02-18 10:19:40 +08:00
Jinzhe Pan
ff3d5aff75
[Fix] hunyuan postprecessing issue ( #1104 )
2026-02-15 12:26:35 -08:00
Mihir Jagtap
7a83e0e6fc
[feature] Add Hunyuan-GameCraft model support ( #1071 )
2026-02-14 08:07:44 +08:00
Shao Duan and Will Lin
7f795600c8
[bugfix] Fixed ltx2 base cfg guidance ( #1095 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-02-13 11:53:11 -08:00
Kaiqin Kong
31c0f1b341
[feat] Port LingBot-World-Base (Cam) ( #1081 )
2026-02-10 11:12:33 -08:00
Ishan and Jinzhe Pan
0aff68f51d
[Feat] Add Stable Diffusion 3.5 ( #1075 )
...
Co-authored-by: Jinzhe Pan <eigensystem1318@gmail.com >
2026-02-10 14:31:36 +08:00
ad58f802f3
[Feat] Port LTX2 trainer ( #1074 )
...
Co-authored-by: Davids048 <jundasu@ucsd.edu >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
2026-02-09 17:32:57 -08:00
XOR-op
f76efe798e
[bugfix]: _compile_conditions regression ( #1077 )
2026-02-06 18:57:43 -08:00
Hao Zhang
b92219f6a6
more fix and relocate STA arguments to pipeline config ( #1073 )
2026-02-06 13:38:35 -08:00
Wei Zhou
98308db7e0
[Feature] [Hy1.5] Support HY1.5 super-resolution pipeline for 1080p videos ( #1046 )
2026-02-05 16:39:20 -08:00
William Lin
75e193a2c9
[core] Refactor and centralize our registry for models, pipelines, and sampling params ( #1066 )
2026-02-05 14:40:30 -08:00
Aryan Kumar