SolitaryThinker
ee607bd0d0
feat(api): typed omni request plane (OmniRequest/Output/Event)
...
First stacked PR of plan.md M1 (the request-plane cut). Adds the typed
omni vocabulary from design.md §6.1 as a new, additive, torch-free module
(fastvideo/api/omni.py):
- OmniRequest: declared TaskType, typed ModalPart inputs, AR SamplingParams
vs DiffusionParams, OutputSpec, per-node NodeOverrides.
- OmniOutput: named Artifact slots with provenance (kills extra["audio"]).
- OmniEvent: one progress/chunk/final streaming union.
- Adapters to/from GenerationRequest / GenerationResult / VideoEvent so the
new types run through today's VideoGenerator unchanged.
Later stacked PRs evolve GenerationRequest into OmniRequest in place and
retire the adapters. No existing surface changed.
2026-06-13 01:36:24 -07:00
alexzms and mergify[bot]
633d393568
[ci] layer-0 grad-norm regression for per-method training tests (5a-ii) ( #1396 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-12 04:45:07 +00:00
Junda Su and Peiyuan Zhang
5854aec2ce
[feat] Add Wan RL DiffusionNFT training ( #1450 )
...
Co-authored-by: Peiyuan Zhang <a1286225768@gmail.com >
2026-06-11 21:18:59 -07:00
Mook
30e45c2411
[bugfix] Classify new config/sampling fields in schema parity inventory ( #1446 )
2026-06-10 13:38:36 -07:00
alexzms
2a4fe697a6
[docs] LTX-2.3 distilled i2v: typed-API example (from_config + generate) ( #1448 )
2026-06-10 10:58:14 -07:00
alexzms
921db7479d
[perf] LTX-2.3 distilled i2v: drop max-autotune from compile kwargs ( #1445 )
2026-06-10 10:06:41 -07:00
Aryan Kumar and Aryan Kumar
7f539424cb
[feat]: add Lucy Edit inference scaffold ( #1363 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-06-09 15:21:43 -07:00
19a838f54f
[bugfix]: release VSA tile cache during training ( #1434 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-09 15:01:22 -07:00
d922ab2cbc
[model] Flux2 Klein Port ( #1349 )
...
Co-authored-by: Gnav3852 <63612880+Gnav3852@users.noreply.github.com >
Co-authored-by: Mac Lee <macthecadillac@gmail.com >
2026-06-09 14:55:55 -07:00
Kaiqin Kong and mergify[bot]
9ea77d37f3
[bugfix] EMA shadow on resume and EMA under MoE path ( #1441 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-09 00:55:43 +00:00
2e35b0c6bd
[refactor]: linear/mlp FP4 path additions for Wan-2.1 (Attn-QAT 6/12) ( #1390 )
...
Co-authored-by: Peiyuan Zhang <a1286225768@gmail.com >
Co-authored-by: Matthew Noto <notomatthew31@gmail.com >
2026-06-08 14:51:57 -07:00
William Lin
1c627a3f98
[bugfix]: build fastvideo-kernel on GPU-less Docker runners ( #1437 )
2026-06-06 17:52:45 -07:00
Kaiqin Kong
a931efe33a
[bugfix] EMA in distillation pipeline ( #1440 )
2026-06-06 17:38:03 -07:00
William Lin
041e5e9029
[bugfix]: unblock PyPI publish (flash-attn-cute direct dep) ( #1436 )
2026-06-05 10:07:12 -07:00
Kaiqin Kong and mergify[bot]
efcc245c2e
[feat] VLM as judge for WM ( #1429 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-05 04:25:54 +00:00
alexzms and mergify[bot]
922e7e0813
[docs] LTX-2.3 distilled i2v example with compile + timing breakdown ( #1430 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-05 01:26:50 +00:00
William Lin
c62a8514b0
[chore]: release v0.2.0 ( #1432 )
2026-06-04 14:22:49 -07:00
William Lin
3eb8081801
[chore]: unpin runtime deps in pyproject.toml ( #1431 )
2026-06-04 13:46:49 -07:00
Raghav K
3505d09564
[bugfix] tests: include ltx2_3_base in expected LTX2 preset set ( #1427 ) ( #1428 )
2026-06-04 12:17:18 -07:00
Shao Duan and SolitaryThinker
570607945c
[feat] dreamverse: sequence parallelism for serving ( #1424 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-06-01 23:13:49 -07:00
Kaiqin Kong and SolitaryThinker
d3a821cdcf
[feat] LoRA controls and integration for Dreamverse ( #1420 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-06-01 18:54:11 -07:00
Kaiqin Kong
3f24578139
[bugfix] LTX2: honor video_position_offset_sec in the DiT ( #1422 )
2026-06-01 16:59:15 -07:00
Kevin Lin
89fcf08378
[bugfix] Fix STFT dtype mismatch ( #1419 )
2026-05-31 20:56:07 -07:00
c2930b2aa1
[ci] Add additional Dreamverse UI tests ( #1417 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-31 19:53:29 -07:00
KUAN-HAO HUANG and SolitaryThinker
019239690b
[perf] Add Adaptive Guidance (CFG gating) for stale-uncond reuse ( #1372 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-05-30 13:58:55 -07:00
alexzms
d6119c1f82
[bugfix]: dreamverse modal bypasses ENTRYPOINT — set ffmpeg env + key check ( #1413 )
2026-05-29 16:50:01 -07:00
alexzms
84214c80bb
[feat] LTX-2.3 audio: BWE vocoder path ( #1398 )
2026-05-29 16:43:26 -07:00
alexzms and mergify[bot]
c2d7143c72
[feat] LTX-2.3 transformer support (config-gated extension of LTX-2) ( #1397 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-29 16:42:37 -07:00
Kaiqin Kong and SolitaryThinker
afdb6fbfa5
[feat] Add MatrixGame3.0 ( #1201 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-05-27 21:07:01 +00:00
alexzms
ba4c02d883
[docs]: highlight Dreamverse deployment paths + add Server B200 (SSH) guide ( #1409 )
2026-05-27 09:30:58 -07:00
Junda Su
2c137931f3
[bugfix] Fix Dreamverse Modal compile warmup latency ( #1394 )
2026-05-26 17:58:38 -07:00
Shao Duan
36682797a0
[feat] eval: input ergonomics + Evaluator features + bug fixes ( #1392 )
2026-05-26 13:59:45 -07:00
William Lin
0ef1357a77
[docs]: surface activation-trace utility in add-model skills ( #1399 )
2026-05-26 13:45:12 -07:00
William Lin
a75d19786a
[docs]: Wire activation trace into mkdocs nav + perf/troubleshooting ( #1304 )
2026-05-26 13:14:36 -07:00
alexzms
be548a78ea
[feat] VSA-256 fastpath on Blackwell via FA4 CuTe block-sparse attention ( #1354 )
2026-05-26 12:58:29 -07:00
alexzms
6a610e2bc9
[ci] add per-method single-step training tests for fastvideo.train ( #1343 )
2026-05-25 17:09:54 -07:00
Shao Duan and abaghyangor
321d5112b4
[refactor] eval: consolidate FVD into common.fvd, remove benchmarks/fvd ( #1380 )
...
Co-authored-by: abaghyangor <abaghyangor@gmail.com >
2026-05-24 12:09:47 -07:00
William Lin
ba75ad82db
[refactor]: shared attention infra additions for QAT-compat (Attn-QAT 5/12) ( #1383 )
2026-05-23 16:19:24 -07:00
Junda Su
58caa5109f
[ci] Add DreamVerse app CI tests ( #1386 )
2026-05-23 14:28:26 -07:00
2f3ca8aaad
[perf]: register FA2/FA3 default flash_attn_func as a torch.library custom op ( #1373 )
...
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-05-23 00:39:06 -07:00
Junda Su
3a67319cb6
[infra] Use npm for Dreamverse web builds ( #1385 )
2026-05-22 18:50:10 -07:00
Junda Su
266fa044b3
[infra] Add Dreamverse Modal UI image build ( #1381 )
2026-05-22 11:36:53 -07:00
William Lin
f3398db868
chore: pin dreamverse npm deps to address Dependabot alerts ( #1359 )
2026-05-22 11:29:33 -07:00
fda02036bc
[feat]: Attn-QAT inference + training backends (deadcode) (Attn-QAT 4/12) ( #1358 )
...
Co-authored-by: jzhang38 <42993249+jzhang38@users.noreply.github.com >
Co-authored-by: RandNMR73 <99706358+RandNMR73@users.noreply.github.com >
2026-05-22 02:59:25 -07:00
Raghav K
68179cd752
[docs] Document enable_torch_compile (+ A/B example) ( #1366 )
2026-05-22 00:25:42 -07:00
Satyam Srivastava and SolitaryThinker
2dd5760291
[docs] Document performance benchmark workflow ( #1376 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-05-21 20:25:58 -07:00
Wenxuan Tan and SolitaryThinker
af2ee9c78a
[feat] Optimize distributed weight loading in multi-node training ( #572 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-05-21 16:59:48 +00:00
Satyam Srivastava and Satyam Srivastava
1c80371b27
[ci] Component time performance + reseed hf baseline skill ( #1292 )
...
Co-authored-by: Satyam Srivastava <satyam53@Satyams-MacBook-Air.local >
2026-05-20 13:51:11 -07:00
Junda Su
eef473225d
[ci] Add Dreamverse Docker image workflow ( #1369 )
2026-05-20 13:50:02 -07:00
Junda Su
44fb84ef6a
[bugfix]: shrink Dreamverse Docker context ( #1368 )
2026-05-20 13:38:52 -07:00
SolitaryThinker