SolitaryThinker
dcd2cba956
[bugfix]: coalesce in-flight arrivals when the batching deadline has expired ( #1453 )
...
When batching_delay_ms > 0, the collect deadline anchors to the first
job's enqueue time. Any job that waited behind an in-flight generation
arrives with an already-expired deadline and was dispatched as a batch
of 1, degrading dynamic batching to sequential under sustained load.
Fall through to the same non-blocking greedy drain the delay=0 path
uses so queued compatible jobs still coalesce up to batching_max_size.
2026-07-11 18:35:45 -07:00
SolitaryThinker
cdd0f7f48f
[misc]: drop .agents/exploration journals added by #1453
...
AGENTS.md bans experiment journals and branch-state snapshots under
.agents/.
2026-07-11 18:35:45 -07:00
SolitaryThinker
6ab03e1745
[misc]: collect fastvideo/tests/batching in the Modal unit-test lane ( #1453 )
...
The new batching unit tests (admission, signature) were not collected by
any CI lane. stages/ is already collected on main, so only batching/ is
added.
2026-07-11 18:35:45 -07:00
SolitaryThinker
06f354afa1
[bugfix]: keep completed results when a prompt-file batch group fails ( #1453 )
...
The dynamic-batching prompt-file branch let a single failed group raise
out of generate_video, discarding every completed result (and tripping
the strict zip). Restore the legacy per-prompt tolerance: a failed group
now yields an error entry per prompt, keeping results aligned with the
input prompts while completed videos survive.
2026-07-11 18:35:45 -07:00
SolitaryThinker
a4f54702c3
[bugfix]: fail fast when submitting to a stopped batch scheduler ( #1453 )
...
submit() after stop() enqueued jobs the drained run loop would never
resolve, hanging the caller forever on the future. Raise immediately
instead.
2026-07-11 18:35:45 -07:00
SolitaryThinker
522b9f7e47
[bugfix]: drain queued jobs greedily when batching delay is 0 ( #1453 )
...
With the default batching_delay_ms=0, _collect_batch called
wait_for(timeout=0) which timed out before draining the queue, so every
dispatched batch had size 1 and dynamic batching silently no-oped. When
delay is 0, drain already-queued jobs non-blocking (until empty,
max_size, or an incompatible job) instead of waiting.
2026-07-11 18:35:45 -07:00
SolitaryThinker
961383b077
[bugfix]: reserve batch output paths so duplicate prompts do not collide ( #1453 )
...
Batch mode resolves every output path via _prepare_output_path before any
file is written, so the os.path.exists dedupe never fired and duplicate
prompts (or prompts equal in their first 100 sanitized chars) overwrote
each other. Track paths reserved within the batch and suffix duplicates,
matching what the legacy sequential path produces for the same inputs.
2026-07-11 18:35:45 -07:00
Mac Lee
49e4673f6e
[bugfix]: address batching review comments ( #1453 )
2026-07-11 18:35:45 -07:00
Mac Lee
e6c84fe2fd
[bugfix]: update batching schema test fixtures ( #1453 )
2026-07-11 18:35:45 -07:00
Mac Lee
733462b4da
[docs]: record checklist closure ( #1453 )
2026-07-11 18:35:45 -07:00
Mac Lee
0f413c2e8f
[misc]: satisfy all-files pre-commit formatting
2026-07-11 18:35:45 -07:00
Mac Lee
d8ece1f37f
[docs]: record SSIM validation follow-up
2026-07-11 18:35:45 -07:00
Mac Lee
2633eb1525
[docs]: record final batching validation result
2026-07-11 18:35:45 -07:00
Mac Lee
8e2b9ced60
[docs]: record multimodal batching validation report
2026-07-11 18:35:45 -07:00
Mac Lee
45d7b55456
[fix]: harden dynamic generation batching
2026-07-11 18:35:45 -07:00
Mac Lee
400e57a9de
[misc]: record batching stage 5 state
2026-07-11 18:35:45 -07:00
Mac Lee
5560eab1db
[feat]: add OpenAI video batching scheduler
2026-07-11 18:35:45 -07:00
Mac Lee
ff75cb2c97
[misc]: record batching stage 2 state
2026-07-11 18:35:45 -07:00
Mac Lee
8d4627845b
[feat]: add generator dynamic batching path
2026-07-11 18:35:45 -07:00
Mac Lee
602d57c370
[misc]: record batching stage 1 state
2026-07-11 18:35:45 -07:00
Mac Lee
a6aab65d97
[feat]: add generation batching primitives
2026-07-11 18:35:45 -07:00
Raghav K
055586703d
[perf]: register a real backward for FA2 default + masked/varlen custom ops (training-under-compile) ( #1388 )
2026-07-12 00:45:27 +00:00
Mac Lee
5d89f86675
[ci] Stop forcing FA4 in model-load lanes ( #1561 )
2026-07-11 14:10:36 -07:00
Satyam Srivastava
19a51a1fe6
[ci] Trigger performance benchmarks for performance code changes ( #1583 )
2026-07-10 20:21:33 -07:00
William Lin
d3232cea5a
[ci]: gate the full-suite trigger on pre-commit and docs build ( #1572 )
2026-07-11 02:56:49 +00:00
Raghav K and SolitaryThinker
0c90c8c24d
[bugfix] nvfp4: cast fp32 inputs to bf16 instead of asserting ( #1488 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-10 21:39:17 +00:00
Mingjia Huo and Claude Fable 5
4c08ffce49
[feat] World model training using third person games ( #1443 )
...
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
2026-07-10 05:09:07 +00:00
Atharv Ramesh
af4a77553c
[ci]: add SSIM reference bootstrap flow ( #1522 ) ( #1547 )
2026-07-10 01:49:38 +00:00
alexzms and SolitaryThinker
c096fda1eb
[docs] Add LTX-2.3 distilled inference run configs (t2v/i2v × 5+2/8+3 × resolutions) ( #1568 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-09 18:53:12 +00:00
William Lin
8f47e85be0
[bugfix]: retry remote image downloads in load_image ( #1570 )
2026-07-09 07:33:24 -07:00
William Lin
90d3bd19eb
[infra] Deliver per-job Buildkite env to Modal CI at runtime, not as image layers ( #1569 )
2026-07-09 06:33:37 -07:00
Mac Lee and SolitaryThinker
afb4f7d3c5
[ci]: emit v2 performance result schema ( #1551 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-09 06:11:15 +00:00
02e1143f22
[feat] Add Kandinsky-5 T2V/I2V pipeline support ( #1471 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
Co-authored-by: leffff <levnovitskiy@gmail.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-07 14:43:30 -07:00
Kared and SolitaryThinker
e2f4d1a7b5
[feat]: add SwanLab tracker ( #1461 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-07 08:35:38 +00:00
Kaiqin Kong and SolitaryThinker
f037351146
[feat] Add Clean-history Teacher Forcing and Causal Consistency Distillation ( #1505 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-07 08:13:11 +00:00
Mac Lee and SolitaryThinker
1ee11e08dc
[ci]: add performance fingerprint cohorts ( #1546 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-07 07:24:00 +00:00
595f0ea60e
[feat] Add DreamX-World 5B Cam and AR pipelines ( #1538 )
...
Co-authored-by: Suckl <Suckl@users.noreply.github.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-07 06:16:18 +00:00
William Lin
d921832cd2
[misc]: reserve CPU/memory for timing-sensitive Modal CI lanes ( #1566 )
2026-07-06 22:13:53 -07:00
William Lin
629697629a
[bugfix]: free CUDA memory between train-framework model tests (LongCat OOM on L40S) ( #1565 )
2026-07-06 21:27:30 -07:00
William Lin
a25313beec
[ci]: wire fastvideo/tests/ops/ into the unit-test lane ( #1559 )
2026-07-06 12:07:26 -07:00
William Lin
dbde64385b
[bugfix]: bump FA4 pin to the CuTe DSL 4.6 compatible rev ( #1564 )
2026-07-06 12:06:59 -07:00
William Lin
9d909f5f04
[test]: remove dead and duplicate tests (-489 lines) ( #1556 )
2026-07-05 15:53:40 -07:00
William Lin
76b0550c15
[ci]: run pre-commit on fork PRs without manual approval ( #1555 )
2026-07-05 14:18:16 -07:00
William Lin
384c1e9493
[misc]: update reseed-performance-baseline skill for the hf_store move ( #1545 follow-up) ( #1553 )
2026-07-05 14:16:55 -07:00
William Lin
b1dbcc93f6
[misc]: reformat fastvideo/performance to the repo yapf config ( #1554 )
2026-07-05 14:16:20 -07:00
William Lin
b93833772e
[ci]: guard against test directories no CI lane collects ( #1552 )
2026-07-05 14:07:38 -07:00
Mac Lee
30b523edd6
[ci] Normalize performance stage component metrics ( #1475 ) ( #1550 )
2026-07-05 14:05:26 -07:00
Mac Lee and SolitaryThinker
6aab7f3832
[ci] cover Hunyuan 1.5 chat-list text preprocessing ( #1518 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-05 12:05:25 -07:00
Mac Lee
9cd53fe5f8
[ci] Add metric-specific performance thresholds ( #1545 )
2026-07-05 12:04:33 -07:00
Mac Lee
6a32cf3a5e
[ci]: expose LoRA extraction slash command ( #1542 )
2026-07-05 06:45:31 -07:00
SolitaryThinker