SolitaryThinker
3a7e7fc69f
studio: single resident generator + engine log tail; fix ray PG leak
...
reload-after-unload failed because RayDistributedExecutor.shutdown() killed
the actors but never removed the placement group — the GPUs stayed reserved
forever. remove it on shutdown.
studio generator management simplified to a single slot: one VideoGenerator
instance at a time, one load in flight at a time (409 otherwise), loading a
new config always releases the old instance, unload shuts it down and
deletes it. jobs wait out an in-flight preload and reuse it on config match.
GET /api/engine/logs: incremental tail of the server's stdout/stderr (ray
relays worker output to the driver, so this captures every rank).
2026-08-06 22:40:39 -07:00
SolitaryThinker
02a10268e9
studio ui: warm models panel on the inference page
...
lists resident/loading/failed generators, preload from the model dropdown
using the persisted default job options (same cache key as jobs), unload with
409 surfaced as a toast. polls only while something is loading. mock server
+ playwright spec + vitest coverage.
2026-08-06 22:29:03 -07:00
SolitaryThinker
9c9dd70214
studio: preload/list/unload resident generators
...
generators were already cached across jobs but only implicitly — the first
job per config silently paid the whole model load. adds:
- POST /api/generators/preload: load a model into memory ahead of time
(async, idempotent; state loading/ready/failed)
- GET /api/generators: what's resident or in flight
- POST /api/generators/unload: shutdown + free VRAM (409 while inference
jobs run)
cache key builder shared with the job path and pinned by a test so preload
and job lookup can't drift apart.
2026-08-06 22:20:28 -07:00
SolitaryThinker
dc13c59dca
fix ray executor: implement the log-queue abstract methods
...
RayDistributedExecutor became uninstantiable when set_log_queue/
clear_log_queue were added to the Executor ABC (only the mp executor got
implementations). No-op on ray: a Manager queue can't cross nodes.
2026-08-06 19:16:33 -07:00
SolitaryThinker
6dd75ef5ab
studio: multi-node inference knobs
...
- forward num_gpus to from_pretrained (was dropped: multi-gpu only ever
happened via sp_size)
- FASTVIDEO_STUDIO_EXECUTOR_BACKEND=ray env knob so a deployment on a ray
cluster can span nodes
- FASTVIDEO_STUDIO_MODEL_PATHS="id=/local/dir" serves a registered model id
from local weights (avoids re-downloading checkpoints already on shared fs)
- accept an existing local dir as model_id in POST /api/jobs
2026-08-06 18:42:44 -07:00
William Lin
15568f27db
[perf]: H3 torch.compile + CUDA graphs (1.2-1.3x) with denoising step marking ( #1689 )
2026-08-06 16:23:33 -07:00
Kaiqin Kong
126a75ad63
[misc] Support partial Hugging Face model downloads ( #1684 )
2026-08-06 16:09:46 -07:00
Raghav K and SolitaryThinker
a2bfc7cdb2
[docs] DGX Spark (GB10) performance & tuning guide + reproduction examples ( #1631 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-08-06 14:36:38 -07:00
William Lin
b963a24612
[bugfix]: hard-fail when ATTN_QAT_INFER is selected but the kernel is unusable ( #1690 )
2026-08-06 13:12:27 -07:00
William Lin
fb7be2fe2c
[ci]: add golden-gate lane — single-layer bitwise DiT fingerprints for all SSIM-covered families ( #1682 )
2026-08-05 12:47:03 -07:00
William Lin
ab00392664
[bugfix]: add GB200 to the inline SSIM device tables #1676 missed ( #1681 )
2026-08-05 10:33:46 -07:00
Shao Duan
9f1e7c19d2
[bugfix] Wan I2V: CLIP image conditioning silently dropped when passed as a tensor during training ( #1673 )
2026-08-05 01:35:09 -07:00
Kaiqin Kong
e8b0e4c61e
[feat] Add MiniMax H3 ( #1674 )
2026-08-04 13:54:39 -07:00
Haochen Jiang
9145ffdc46
[bugfix]: keep _resolved_attention_backend out of the positional config signature ( #1678 )
2026-08-03 17:09:15 -07:00
William Lin
c3d07c870b
[bugfix]: give GB200 its own SSIM reference folder instead of B200's ( #1676 )
2026-08-03 15:14:25 -07:00
William Lin
e8812bef0b
[docs]: batched docs cleanup (landing page, links, requirements, nav) ( #1644 )
2026-08-02 18:03:26 -07:00
William Lin
b9be2449dc
[refactor]: delete the dead global attention-backend override ( #1672 )
2026-08-02 18:00:42 -07:00
Adhvay Iyer and SolitaryThinker
bc7a804618
[bugfix]: harden FastVideo Studio UI reliability and accessibility ( #1659 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-08-02 15:26:18 -07:00
William Lin
7b094c945b
[refactor]: resolve attention backend once per component at load time ( #1657 )
2026-08-02 15:07:42 -07:00
William Lin
eeb3e8a597
[bugfix]: left-align Gemma connector tokens per batch row ( #1664 )
2026-08-02 15:01:34 -07:00
Suhaan Khurana
05406c5d1b
[misc]: consolidate dataset download scripts under examples/datasets/ ( #1667 )
2026-08-02 14:21:24 -07:00
KyleNeverGivesUp and Claude Opus 5
99d04a7f98
[bugfix] keep loader-populated text encoder configs in the validation pipeline ( #1669 )
...
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-08-02 14:10:16 -07:00
William Lin
1b2b2a0161
[bugfix]: copy text encoder outputs out of CUDAGraph static buffers ( #1650 )
2026-07-27 21:52:53 -07:00
William Lin
98d65835b5
[misc]: refresh stale sm_120-only validation notes in QAT recipes ( #1655 )
2026-07-27 19:35:29 -07:00
William Lin
422585d08f
[misc]: add LTX-2.3 fine-tuning example recipes ( #1651 )
2026-07-27 18:42:44 -07:00
ryanM154
e59a1ce16a
[bugfix] Report actual package version in fastvideo --version ( #1652 )
2026-07-27 16:32:01 -07:00
William Lin
d71acc0eb5
[bugfix]: fix stale imports in LTX-2.3 gradio local demo ( #1640 )
2026-07-27 16:31:07 -07:00
William Lin
af2934dd6b
[feat]: FA4-FP4 ATTN_QAT_INFER on sm_100/sm_103 + NVFP4 weight purge ( #1647 )
2026-07-27 15:46:52 -07:00
William Lin
1801512818
[docs]: cover all registered models in the support matrix ( #1641 )
2026-07-27 11:13:53 -07:00
William Lin
5ae05b032e
[misc]: add LTX-2 fine-tuning example recipes ( #1645 )
2026-07-27 11:11:49 -07:00
Mac Lee
7a592ff09a
[ci]: cache FastVideo kernel builds in Modal ( #1562 )
2026-07-26 04:21:09 -07:00
Lev Novitskiy and Claude Sonnet 5
8b23984c79
[feat] Add Kandinsky5 QAD training pipeline: data preprocessing, QAT finetune, QAT-aware DMD distillation ( #1601 )
...
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com >
2026-07-26 02:59:21 -07:00
William Lin
bf18371afe
[feat] Enable LTX-2 NVFP4 linear and attention QAT fine-tuning ( #1626 )
2026-07-26 02:19:34 -07:00
William Lin
69349dd2aa
[docs]: unify community links on the README Slack invite ( #1643 )
2026-07-25 17:26:58 -07:00
Yogya Mehrotra and Claude Sonnet 5
8d89f30d3f
[bugfix] Skip CUDA-only fastvideo-kernel/flashinfer-python deps on non-Linux ( #1574 )
...
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com >
2026-07-23 14:23:45 -07:00
William Lin
10546353da
[ci]: extend Full Suite training lane timeouts ( #1616 )
2026-07-23 13:00:00 -07:00
pkisfaludi-nv and Claude Opus 4.8
9fb74b9732
Make LTX-2 RMSNorm out-of-place so torch_tensorrt + Ulysses SP compiles ( #1623 )
...
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
2026-07-22 04:32:04 -07:00
Adriel Fung and SolitaryThinker
521dee0e82
[perf]: enable per-block torch.compile for LTX2 with persistent cache ( #1602 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-20 15:59:13 -07:00
William Lin
229419208e
[ci]: opt in to fork-PR head checkout after actions/checkout guard change ( #1625 )
2026-07-20 13:12:22 -07:00
William Lin
65f3b946b9
[feat] Add LTX-2 and LTX-2.3 fine-tuning to the modular trainer ( #1624 )
2026-07-20 11:58:39 -07:00
Zhang Peiyuan
191fcbf46c
[feat] add qat docs ( #1621 )
2026-07-19 18:37:47 -07:00
Junda Su
755a4e4470
[new-model] Add LingBot-Video Dense and MoE/refiner T2V inference ( #1595 )
2026-07-18 20:18:16 -07:00
9709b7513b
[feat] Port NVFP4 QAT/QAD to modular train framework ( #1619 )
...
Co-authored-by: Peiyuan Zhang <email>
Co-authored-by: Peiyuan <a>
2026-07-18 15:01:09 -07:00
William Lin
32cd603515
Revert docs trusted-branch-only workflow ( #1618 )
2026-07-17 00:22:56 -07:00
Junda Su
d4bdd3621a
[new-model] Port LingBot-World-v2 ( #1579 )
2026-07-16 19:51:53 -07:00
William Lin
e2f8322842
[ci]: skip unused Buildkite submodule checkout ( #1614 )
2026-07-16 18:37:57 -07:00
6966f9e0bc
[fix] Z-Image ( #1236 ) draft port: rebase + strict-load contract + bf16 encoder parity + PORT_STATUS ( #1339 )
...
Co-authored-by: Mrinaal Dogra <mdogra@ucsd.edu >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-16 18:18:25 -07:00
Mac Lee
743f4ed5f9
[ci]: harden Modal repository checkout ( #1590 )
2026-07-16 18:05:50 -07:00
Mac Lee
1c04ace573
[ci]: pin VSA training regression to H100 ( #1591 )
2026-07-15 22:04:57 -07:00
Mac Lee and Satyam Srivastava
6cbff73687
[bugfix]: skip unused output materialization ( #1567 )
...
Co-authored-by: Satyam Srivastava <srivastavasatyam53@gmail.com >
2026-07-16 04:03:07 +00:00
SolitaryThinker