SolitaryThinker
c6468e8def
[misc]: collect fastvideo/tests/batching in the Modal unit-test lane ( #1453 )
...
The new batching unit tests (admission, signature) were not collected by
any CI lane. stages/ is already collected on main, so only batching/ is
added.
2026-07-05 13:46:41 -07:00
SolitaryThinker
2c0d9a0828
[bugfix]: keep completed results when a prompt-file batch group fails ( #1453 )
...
The dynamic-batching prompt-file branch let a single failed group raise
out of generate_video, discarding every completed result (and tripping
the strict zip). Restore the legacy per-prompt tolerance: a failed group
now yields an error entry per prompt, keeping results aligned with the
input prompts while completed videos survive.
2026-07-05 13:46:22 -07:00
SolitaryThinker
b9876ee06d
[bugfix]: fail fast when submitting to a stopped batch scheduler ( #1453 )
...
submit() after stop() enqueued jobs the drained run loop would never
resolve, hanging the caller forever on the future. Raise immediately
instead.
2026-07-05 13:45:35 -07:00
SolitaryThinker
a568406b8c
[bugfix]: drain queued jobs greedily when batching delay is 0 ( #1453 )
...
With the default batching_delay_ms=0, _collect_batch called
wait_for(timeout=0) which timed out before draining the queue, so every
dispatched batch had size 1 and dynamic batching silently no-oped. When
delay is 0, drain already-queued jobs non-blocking (until empty,
max_size, or an incompatible job) instead of waiting.
2026-07-05 13:45:21 -07:00
SolitaryThinker
39cc075452
[bugfix]: reserve batch output paths so duplicate prompts do not collide ( #1453 )
...
Batch mode resolves every output path via _prepare_output_path before any
file is written, so the os.path.exists dedupe never fired and duplicate
prompts (or prompts equal in their first 100 sanitized chars) overwrote
each other. Track paths reserved within the batch and suffix duplicates,
matching what the legacy sequential path produces for the same inputs.
2026-07-05 13:44:57 -07:00
Mac Lee
88f50fa7d6
[bugfix]: address batching review comments ( #1453 )
2026-07-05 13:39:16 -07:00
Mac Lee
4b25087bd8
[bugfix]: update batching schema test fixtures ( #1453 )
2026-07-05 13:39:16 -07:00
Mac Lee
a314489b78
[docs]: record checklist closure ( #1453 )
2026-07-05 13:39:16 -07:00
Mac Lee
a1b8a78e9e
[misc]: satisfy all-files pre-commit formatting
2026-07-05 13:39:16 -07:00
Mac Lee
df55a31824
[docs]: record SSIM validation follow-up
2026-07-05 13:39:16 -07:00
Mac Lee
d022cf00e3
[docs]: record final batching validation result
2026-07-05 13:39:16 -07:00
Mac Lee
7dc3166827
[docs]: record multimodal batching validation report
2026-07-05 13:39:16 -07:00
Mac Lee
ce4c4f37c7
[fix]: harden dynamic generation batching
2026-07-05 13:39:16 -07:00
Mac Lee
48dff4be69
[misc]: record batching stage 5 state
2026-07-05 13:39:16 -07:00
Mac Lee
d9736d5e5d
[feat]: add OpenAI video batching scheduler
2026-07-05 13:39:16 -07:00
Mac Lee
7396024f95
[misc]: record batching stage 2 state
2026-07-05 13:39:16 -07:00
Mac Lee
978896f534
[feat]: add generator dynamic batching path
2026-07-05 13:39:16 -07:00
Mac Lee
560810c592
[misc]: record batching stage 1 state
2026-07-05 13:39:16 -07:00
Mac Lee
e3a7450a05
[feat]: add generation batching primitives
2026-07-05 13:39:15 -07:00
Mac Lee and SolitaryThinker
6aab7f3832
[ci] cover Hunyuan 1.5 chat-list text preprocessing ( #1518 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-05 12:05:25 -07:00
Mac Lee
9cd53fe5f8
[ci] Add metric-specific performance thresholds ( #1545 )
2026-07-05 12:04:33 -07:00
Mac Lee
6a32cf3a5e
[ci]: expose LoRA extraction slash command ( #1542 )
2026-07-05 06:45:31 -07:00
William Lin
98be9b3da2
[bugfix]: address the three remaining #1447 review findings ( #1549 )
2026-07-05 06:43:27 -07:00
Mac Lee
c53e85b767
[ci] Add v2 performance benchmark config identity fields ( #1544 )
2026-07-05 06:18:15 -07:00
William Lin
40a8bd2d3b
[bugfix]: skip ThunderKittens kernels on aarch64 and document the kernel build matrix ( #1548 )
2026-07-05 06:13:11 -07:00
Mac Lee and SolitaryThinker
31aa115611
[bugfix]: preserve FSDP hooks for RMSNorm qk norms ( #1513 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-05 04:15:49 +00:00
zainnh and SolitaryThinker
98ac10a528
[infra] Auto-rebuild CUDA images when docker/Dockerfile changes on main ( #1526 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-04 16:25:46 -07:00
William Lin
a5a6d171e5
[attn] Make FA4 explicit opt-in via FASTVIDEO_FA4 and delete the runtime fallback machinery ( #1540 )
2026-07-04 14:51:00 -07:00
William Lin
51ed1ea423
[build] Bump fastvideo-kernel pin to 0.3.2 ( #1541 )
2026-07-03 14:48:15 -07:00
Mac Lee
00ec3e7388
[bugfix]: compute VSA topk from padded blocks ( #1517 )
2026-07-03 14:16:51 -07:00
William Lin
0d626ef2d1
[kernel] Bump fastvideo-kernel pin to 0.3.1 and version the FA4 tile_mn port as 0.3.2 ( #1539 )
2026-07-03 14:11:08 -07:00
William Lin
b36d0ef085
[infra] Add DGX Spark and multi-architecture CUDA support ( #1447 )
2026-07-03 13:41:43 -07:00
William Lin
10c8c5df4d
[misc] reorg: relocate ui/ and performance_dashboard/ under apps/ ( #1537 )
2026-07-02 20:29:17 -07:00
William Lin
31e26abec4
[chore] release fastvideo-kernel 0.3.1 ( #1520 )
2026-06-30 12:25:27 -07:00
sumyyyyy and SolitaryThinker
9e83ba630c
[kernel] Extract VSA utility functions into fastvideo_kernel ( #1408 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-06-30 12:19:25 -07:00
William Lin
fc02a9ce8e
[ci] aarch64 kernel wheel: build for Blackwell (sm_100a/sm_120a), not Hopper ( #1516 )
2026-06-29 16:10:42 -07:00
William Lin
3d36160fc4
[bugfix] -fsigned-char so ThunderKittens compiles on aarch64 (Grace Hopper) ( #1515 )
2026-06-29 14:05:38 -07:00
William Lin
a11ec43de2
[ci] build + publish aarch64 (Grace Hopper) kernel wheels alongside x86_64 ( #1514 )
2026-06-29 12:28:34 -07:00
William Lin
2656d6530c
[bugfix] compile FP4 (attn_qat_infer) kernels for sm_120a only via per-arch split ( #1508 )
2026-06-29 11:07:27 -07:00
Kevin Lin
e3f54e7169
[bugfix] Fix causal attention mask for Blackwell FP4 MMA column layout ( #1506 )
2026-06-28 20:36:40 -07:00
William Lin
4ba5681307
[bugfix] guard ThunderKittens Hopper kernels for non-sm_90a device passes ( #1507 )
2026-06-28 20:07:43 -07:00
alexzms
8c23c86994
[docs]: add raw-video preprocess script for the QAD MixKit recipe ( #1487 )
2026-06-28 18:01:13 -07:00
William Lin
78d606a3a7
[feat]: make VSA tile cache configurable for training ( #1444 )
2026-06-28 02:18:31 -07:00
William Lin
c4e108de78
[docs]: modernize documentation build ( #1503 )
2026-06-28 02:02:09 -07:00
Kaiqin Kong
16bf2eaf77
[feat] Relativistic RoPE re-indexing for long causal rollouts ( #1454 )
2026-06-28 01:43:00 -07:00
William Lin
1d15d974fa
[misc]: cleanup outdated or unneeded agent infrastructure ( #1504 )
2026-06-27 19:37:49 -07:00
alexzms
5e57868b76
[ci] train-framework model coverage: Cosmos/MatrixGame2 finetune grad-norm + Cosmos/LongCat/MatrixGame2 loading smokes ( #1497 )
2026-06-27 17:16:00 -07:00
William Lin
6be280c914
[bugfix]: fix docs build ( #1502 )
2026-06-27 13:00:09 -07:00
KyleNeverGivesUp and Claude Opus 4.8
3ccdec9798
[bugfix] Make enable_torch_compile_vae actually compile the Wan VAE ( #1498 )
...
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com >
2026-06-27 12:30:59 -07:00
Satyam Srivastava
8658f774f3
[docs] Restructure contributing CI/CD and testing docs ( #1501 )
2026-06-27 11:46:18 -07:00