Junda ChenandClaude Opus 5.5 be8a13b749 [perf] FastH3 two-Spark: gather packed FP4 inputs before head projections ...

Opt-in h3_vsa_fp4.sp_input_gather (default false; requires sp_projection_overlap) gathers the
already-packed FP4 inputs and rotary tables, then computes each rank's assigned Q/K/V heads locally;
the gate projection overlaps the smaller transfer. Supported on the measured GB10/cuDNN shape only;
other shapes keep the existing exchange. Enabled in the Spark-pair example.
T2AV on 2 Sparks: 19.35 -> 18.76 s/clip (merge gate check, same SP reduction order rules).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

2026-10-24 02:16:48 +00:00

..

datasets

[misc]: consolidate dataset download scripts under examples/datasets/ (#1667)

2026-08-02 14:21:24 -07:00

distill

[misc]: Refactor separate training pipeline runner (#1696)

2026-10-07 03:19:21 -07:00

inference

[perf] FastH3 two-Spark: gather packed FP4 inputs before head projections

2026-10-24 02:16:48 +00:00

serving

[feat] Cookbook serving, hardware catalog, and landing page (#1999)

2026-10-20 09:10:29 -07:00

train

[feat] Add H3 PDD/DMPDD training and packed Ref2VA preprocessing (#1984)

2026-10-20 11:15:57 -07:00

training

[feat] Add end-to-end MMAudio V2A training, inference, and evaluation (#1648)

2026-10-07 04:25:00 -07:00