SolitaryThinker
5bbbaa92f9
[docs] Pin the NVFP4 FA4 dependency stack
2026-07-25 17:41:10 -07:00
SolitaryThinker
137b089e74
[feat] Validate LTX-2 QAT with NVFP4 FA4
2026-07-25 17:41:10 -07:00
SolitaryThinker
233c75a7f1
[test] Seed LTX-2 NVFP4 QAT GB200 gradient norm
...
Record 0.3661 from a single-GB200 forward/backward using the corrected 576-linear deployment target profile.
2026-07-25 17:41:10 -07:00
SolitaryThinker
b6b0f042a7
[test] Fix LTX-2 loader monkeypatch target
2026-07-25 17:41:10 -07:00
SolitaryThinker
5651f57a74
[bugfix] Align LTX-2 QAT with the NVFP4 deployment profile
...
Reuse the curated LTX-2 NVFP4 linear target set for QAT while preserving the existing Wan-style profile. This changes LTX-2 attachment from 1,344 broad substring matches to the 576 linears used by deployment.
Forward the role-local attention backend through LTX2Model so transformer construction remains compatible with the model-loader API merged in #1619 . Add CPU parser/export reconstruction and target-profile coverage, hardware gates, and update the documented YAML surface.
2026-07-25 17:41:10 -07:00
Will Lin
43f667dd4c
[feat] Add NVFP4 QAT support to modular trainer for LTX-2 fine-tuning
...
Resolve string pipeline.dit_config.quant_config values (e.g.
nvfp4_qat_train) into registered QuantizationConfig instances during
config parsing. The resolver lives in _parse_pipeline_config so it
covers training, resume, and dcp_to_diffusers export (which rebuilds
from checkpoint metadata and bypasses load_run_config).
nvfp4_qat_train runs attention/FFN linear forwards through real NVFP4
GEMMs (flashinfer cutlass) with a straight-through-estimator backward
into dense fp32 master weights; no extra params or buffers, so FSDP2
sharding, DCP checkpoints, and export are unchanged. Attention stays
dense, matching LTX-2 NVFP4 deployment.
Add an NVFP4 QAT overfit config, a QAT smoke test asserting the quant
method attaches to all 1344 matched linears (GB200 grad-norm ref
seeded), and an ltx2_nvfp4_qat nightly e2e case.
Verified on 4x GB200: 300-step cat-sample overfit, ~2x dense step
time, train loss -> 0.022, validation mean MS-SSIM vs the training
clip 0.14 (step 0) -> 0.955 (step 300, nightly e2e PASSED; bf16 dense
twin reaches 0.964).
2026-07-25 17:41:10 -07:00
William Lin
69349dd2aa
[docs]: unify community links on the README Slack invite ( #1643 )
2026-07-25 17:26:58 -07:00
Yogya Mehrotra and Claude Sonnet 5
8d89f30d3f
[bugfix] Skip CUDA-only fastvideo-kernel/flashinfer-python deps on non-Linux ( #1574 )
...
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com >
2026-07-23 14:23:45 -07:00
William Lin
10546353da
[ci]: extend Full Suite training lane timeouts ( #1616 )
2026-07-23 13:00:00 -07:00
pkisfaludi-nv and Claude Opus 4.8
9fb74b9732
Make LTX-2 RMSNorm out-of-place so torch_tensorrt + Ulysses SP compiles ( #1623 )
...
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
2026-07-22 04:32:04 -07:00
Adriel Fung and SolitaryThinker
521dee0e82
[perf]: enable per-block torch.compile for LTX2 with persistent cache ( #1602 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-20 15:59:13 -07:00
William Lin
229419208e
[ci]: opt in to fork-PR head checkout after actions/checkout guard change ( #1625 )
2026-07-20 13:12:22 -07:00
William Lin
65f3b946b9
[feat] Add LTX-2 and LTX-2.3 fine-tuning to the modular trainer ( #1624 )
2026-07-20 11:58:39 -07:00
Zhang Peiyuan
191fcbf46c
[feat] add qat docs ( #1621 )
2026-07-19 18:37:47 -07:00
Junda Su
755a4e4470
[new-model] Add LingBot-Video Dense and MoE/refiner T2V inference ( #1595 )
2026-07-18 20:18:16 -07:00
9709b7513b
[feat] Port NVFP4 QAT/QAD to modular train framework ( #1619 )
...
Co-authored-by: Peiyuan Zhang <email>
Co-authored-by: Peiyuan <a>
2026-07-18 15:01:09 -07:00
William Lin
32cd603515
Revert docs trusted-branch-only workflow ( #1618 )
2026-07-17 00:22:56 -07:00
Junda Su
d4bdd3621a
[new-model] Port LingBot-World-v2 ( #1579 )
2026-07-16 19:51:53 -07:00
William Lin
e2f8322842
[ci]: skip unused Buildkite submodule checkout ( #1614 )
2026-07-16 18:37:57 -07:00
6966f9e0bc
[fix] Z-Image ( #1236 ) draft port: rebase + strict-load contract + bf16 encoder parity + PORT_STATUS ( #1339 )
...
Co-authored-by: Mrinaal Dogra <mdogra@ucsd.edu >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-16 18:18:25 -07:00
Mac Lee
743f4ed5f9
[ci]: harden Modal repository checkout ( #1590 )
2026-07-16 18:05:50 -07:00
Mac Lee
1c04ace573
[ci]: pin VSA training regression to H100 ( #1591 )
2026-07-15 22:04:57 -07:00
Mac Lee and Satyam Srivastava
6cbff73687
[bugfix]: skip unused output materialization ( #1567 )
...
Co-authored-by: Satyam Srivastava <srivastavasatyam53@gmail.com >
2026-07-16 04:03:07 +00:00
William Lin
dec8b10939
[docs]: document automatic Docker image builds ( #1608 )
2026-07-15 18:52:21 -07:00
William Lin
133a5278af
[ci] Run docs only for trusted PR branches ( #1610 )
2026-07-15 18:51:59 -07:00
William Lin
da856274cc
[feat]: FastVideo Studio — SvelteKit → Next.js port + review fixes ( #1612 )
2026-07-15 18:51:33 -07:00
Mac Lee and SolitaryThinker
a253856147
[ci] Add exact identity performance statuses ( #1560 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-15 14:59:09 -07:00
Satyam Srivastava and gemini-code-assist[bot]
6e25d94ebc
[ci]: enable scheduled perf runs to update rolling baseline ( #1599 )
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-07-14 16:55:12 -07:00
Mac Lee
cae8fa18dc
[bugfix]: propagate Qwen2.5-VL visual dtype ( #1580 )
2026-07-13 18:37:11 -07:00
William Lin
821e5a0832
[bugfix]: fix FlashAttention resolver tests after tuple return ( #1597 )
2026-07-13 16:29:03 -07:00
William Lin
c1abc42782
[bugfix]: allow unrestricted head sizes in SDPA ( #1596 )
2026-07-13 16:04:51 -07:00
William Lin
ef15ea2391
[bugfix]: keep LTX2 rms_norm outputs bf16 under torch 2.12 autocast ( #1587 )
2026-07-13 16:04:21 -07:00
Mac Lee
1ea2517e22
[ci]: extend LoRA training CI timeout ( #1589 )
2026-07-13 02:47:28 -07:00
Mook and SolitaryThinker
0c63528c59
[perf] Cache RoPE position-embedding tables across denoising steps ( #1442 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-13 02:34:51 -07:00
b063f8ca41
[feat] Fix FLUX.1-dev port: native RoPE, parity tests, SSIM reference ( #1321 )
...
Co-authored-by: Ishan Vaish <ivaish@ucsd.edu >
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com >
2026-07-13 01:49:42 -07:00
William Lin
e7fff0173a
[bugfix]: benchmark_weight_loading_comparison.py — iterate safe_open via .keys() ( #1378 )
2026-07-12 22:50:45 -07:00
Shreejith SG and H1yori233
d82abc271e
[feat] Add GLM-Image inference support ( #1030 )
...
Co-authored-by: H1yori233 <k1kong@ucsd.edu >
2026-07-12 22:42:42 -07:00
Guian Fang and SolitaryThinker
970409962f
[feat] Add AnyFlow any-step video distillation (pretrain + on-policy) ( #1371 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-12 02:32:08 +00:00
Raghav K
055586703d
[perf]: register a real backward for FA2 default + masked/varlen custom ops (training-under-compile) ( #1388 )
2026-07-12 00:45:27 +00:00
Mac Lee
5d89f86675
[ci] Stop forcing FA4 in model-load lanes ( #1561 )
2026-07-11 14:10:36 -07:00
Satyam Srivastava
19a51a1fe6
[ci] Trigger performance benchmarks for performance code changes ( #1583 )
2026-07-10 20:21:33 -07:00
William Lin
d3232cea5a
[ci]: gate the full-suite trigger on pre-commit and docs build ( #1572 )
2026-07-11 02:56:49 +00:00
Raghav K and SolitaryThinker
0c90c8c24d
[bugfix] nvfp4: cast fp32 inputs to bf16 instead of asserting ( #1488 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-10 21:39:17 +00:00
Mingjia Huo and Claude Fable 5
4c08ffce49
[feat] World model training using third person games ( #1443 )
...
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
2026-07-10 05:09:07 +00:00
Atharv Ramesh
af4a77553c
[ci]: add SSIM reference bootstrap flow ( #1522 ) ( #1547 )
2026-07-10 01:49:38 +00:00
alexzms and SolitaryThinker
c096fda1eb
[docs] Add LTX-2.3 distilled inference run configs (t2v/i2v × 5+2/8+3 × resolutions) ( #1568 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-09 18:53:12 +00:00
William Lin
8f47e85be0
[bugfix]: retry remote image downloads in load_image ( #1570 )
2026-07-09 07:33:24 -07:00
William Lin
90d3bd19eb
[infra] Deliver per-job Buildkite env to Modal CI at runtime, not as image layers ( #1569 )
2026-07-09 06:33:37 -07:00
Mac Lee and SolitaryThinker
afb4f7d3c5
[ci]: emit v2 performance result schema ( #1551 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-09 06:11:15 +00:00
02e1143f22
[feat] Add Kandinsky-5 T2V/I2V pipeline support ( #1471 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
Co-authored-by: leffff <levnovitskiy@gmail.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-07 14:43:30 -07:00
SolitaryThinker