Satyam Srivastava
0ef47caf86
[bugfix]: select architecture-specific Blackwell kernel targets
...
- Detect GB200 and GB300 as 10.0a and 10.3a
- Build future GB200 CI images with 10.0a
- Add regression tests for detection, cache keys, and build arguments
2026-10-05 15:42:48 -07:00
Satyam Srivastava
e71d01648c
[feat]: add selectable Modal and GB200 Kubernetes GPU CI
...
- Preserve existing CI and add configurable GPU backend routing
- Limit execution to 2 active PRs, 4 GPUs per PR, and 8 GPUs total
- Add persistent admission, cancellation recovery, and backend statuses
- Document deployment and add infrastructure regression tests
2026-10-01 14:44:14 -07:00
Junda Su
02f1ce11ae
[misc] Move environment var reads into env registry and rename unprefixed variables ( #1897 )
2026-09-29 14:36:16 -07:00
Aryan Kumar and Aryan Kumar
7f03e03dc6
[docs]: FastH3 V2 cookbook serving and MLX install guide ( #1884 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-09-29 13:03:18 -07:00
Junda Su
e3b88bb12a
[feat] Add a typed environment-variable registry, policy doc, and contract test ( #1896 )
2026-09-29 12:50:45 -07:00
Kyle Hu
81f3fec7fd
[bugfix]: workers killed by a signal now log the reason ( #1725 )
2026-09-24 17:06:55 -07:00
Aryan Kumar
361f919c88
[feat]: add a narrow FastH3 8-step MLX ladder
...
Keep the four-step uniform AdaLN cache, and use explicit DMD rungs only when the snapshot declares its own scheduler shifts.
2026-09-23 11:06:55 -07:00
Keith and SolitaryThinker
c4824c7764
[bugfix] FP8: gate the ROCm _scaled_mm path on CDNA4 (gfx950) instead of the capability tuple ( #1859 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-09-16 19:58:55 -07:00
William Lin
0100218594
[feat] Support the FastH3 8-Step V2 checkpoint: checkpoint-defined shifts, explicit DMD schedule, new example ( #1852 )
2026-09-15 14:13:45 -07:00
sudhirpol522
8839ba8d4d
[bugfix] Add OpenAI-compatible image generation endpoint ( #1840 )
2026-09-14 17:55:56 -07:00
Lele
316f3876c2
[bugfix]: allow MiniMax H3 frame padding at the 15-second limit
...
Accept the causal-VAE-aligned 362-frame bucket (15.083 s) for 15-second H3 requests.
- Hoist MINIMAX_H3_MIN/MAX_ALIGNED_FRAMES next to align_num_frames and reuse them in the CUDA stage, the MLX runtime, and the LoRA example so the bound is consistent across entry points.
- State the accepted frame range in the error messages.
- Cover seconds="15" -> 362 at OpenAI admission and the MLX resolve_geometry bound.
- Update the Spark/openai cookbook frame caps from 345 to 362.
Known gaps: no GPU-lane coverage for the 362 bucket (SSIM runs 124 frames; the golden gate is a fixed-geometry fingerprint), and explicit num_frames=360 still hits the pre-existing grid gate.
2026-09-14 16:54:41 -07:00
William Lin
556ac7088e
[refactor] Simplify Wan sampling and tests ( #1825 )
2026-09-07 15:57:19 -07:00
William Lin
7f83164233
[refactor] Move Wan VAE into the Wan package ( #1824 )
2026-09-05 18:43:55 -07:00
William Lin
e19913f6e9
[refactor] Group Wan transformer and config ( #1823 )
2026-09-05 17:05:32 -07:00
Aryan Kumar and Aryan Kumar
0bd19a976b
[docs]: add one-Spark FastH3 cookbook runtime with a device-count row ( #1811 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-09-02 10:05:59 -07:00
3d8ac9d14b
[feat]: collapse cookbook recipe pages into an accordion layout, add … ( #1805 )
...
Co-authored-by: Vaish, Ishan <isvaish@UCSD.EDU >
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com >
2026-09-01 01:51:51 -07:00
aaef49bfc6
[feat]: run FastH3 across two DGX Sparks with Ray sequence parallel ( #1803 )
...
Co-authored-by: Kyle <shh075@ucsd.edu >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
Co-authored-by: Satyam Srivastava <srivastavasatyam53@gmail.com >
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-09-01 01:37:23 -07:00
Aryan Kumar and Aryan Kumar
cf6a00b9be
[feat]: add opt-in CUDA TAEH3 preview decode for FastH3 ( #1795 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-08-31 23:34:56 -07:00
Shahrad Zomorrodi and Shahrad Zomorrodi
1ae39562dd
[bugfix] Write generated documentation as UTF-8 ( #1797 )
...
Co-authored-by: Shahrad Zomorrodi <264690209+shahradzomorrodi@users.noreply.github.com >
2026-08-31 22:45:03 -07:00
Aryan Kumar and Aryan Kumar
26064193e2
[feat] Add an H3 server cookbook and prompt playground ( #1798 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-08-31 22:14:33 -07:00
Aryan Kumar and Aryan Kumar
a28f2bab4b
[feat] Add an optional MLX TAEH3 preview decoder ( #1794 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-08-31 05:08:06 -07:00
Aryan Kumar and Aryan Kumar
f82d8be4bf
[perf] Sequential MiniMax H3 start with GPU-direct DiT load ( #1793 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-08-31 04:20:21 -07:00
Aryan Kumar and Aryan Kumar
620bc36dc4
[docs]: Cookbook catalog improvements ( #1790 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-08-30 17:50:57 -07:00
Suhaan Khurana
29ff16ec96
[feat] Add MiniMax H3 MLX spatial fast mode ( #1789 )
2026-08-30 17:47:02 -07:00
a4d9a75e2c
[perf] Add MiniMax H3 MLX VSA and SIMD attention ( #1776 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2026-08-30 13:44:54 -07:00
Aryan Kumar and Aryan Kumar
ccc9014430
[docs] Add model-family inference cookbook ( #1787 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-08-30 02:26:10 -07:00
William Lin
a159b63c67
[bugfix] Harden OpenAI serving after post-merge review ( #1782 )
2026-08-28 22:29:24 -07:00
ac48bb3cd1
[feat] Add MiniMax H3 MLX T2VA inference ( #1770 )
...
Co-authored-by: Aryan Kumar <aryank@Aryans-Mac-Studio.local >
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: CodeRabbit <noreply@coderabbit.ai >
2026-08-28 12:54:33 -07:00
William Lin
3987b9ddcd
[feat] Align multimodal OpenAI serving APIs ( #1781 )
2026-08-28 10:09:58 -07:00
KyleNeverGivesUp
e9bbaca07d
[perf] Disable every offload path on unified memory, unblocking MiniMax H3 generation on one GB10 ( #1715 )
2026-08-26 15:32:56 -07:00
William Lin
9212f4f218
[ci] make GPU validation change-aware ( #1747 )
2026-08-25 21:26:25 -07:00
Aryan Kumar and Aryan Kumar
6388db815b
[bugfix] FastMetal-QAD MLX support: refuse CUDA QAD trees, use packed mlx_dit config, stream loads ( #1736 ) ( #1758 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-08-25 14:51:40 -07:00
William Lin
f9e3680f11
[perf] Align FastH3 optimized inference profile ( #1748 )
2026-08-23 02:01:03 -07:00
William Lin
13213395b4
[perf] Parallelize MiniMax-H3 VAE over sequence ranks ( #1744 )
2026-08-22 18:05:31 -07:00
William Lin
46afee5998
[bugfix] Classify MiniMax-H3 inference controls in schema inventory ( #1743 )
2026-08-22 17:17:02 -07:00
William Lin
c488fa1211
[perf] Add opt-in packed-varlen FA4 for MiniMax-H3 ( #1742 )
2026-08-22 17:16:47 -07:00
William Lin
d3cff517cd
[perf] Add opt-in regional fullgraph compile for DiT inference ( #1741 )
2026-08-22 12:14:39 -07:00
KyleNeverGivesUp and SolitaryThinker
a63ccce73d
[docs]: add a maintained inference cookbook ( #1290 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-08-21 01:53:44 -05:00
Aryan Kumar and Aryan Kumar
8537dcd6de
[feat]: Apple Silicon MLX runtime — INT8 Wan2.1 and Wan2.2 inference ( #1638 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-08-18 15:08:00 -07:00
Kai
0653f8f3af
[new-model] Add V2A: native MMAudio inference pipeline ( #1622 )
2026-08-09 17:29:27 -07:00
Raghav K and SolitaryThinker
a2bfc7cdb2
[docs] DGX Spark (GB10) performance & tuning guide + reproduction examples ( #1631 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-08-06 14:36:38 -07:00
Kaiqin Kong
e8b0e4c61e
[feat] Add MiniMax H3 ( #1674 )
2026-08-04 13:54:39 -07:00
William Lin
e8812bef0b
[docs]: batched docs cleanup (landing page, links, requirements, nav) ( #1644 )
2026-08-02 18:03:26 -07:00
William Lin
7b094c945b
[refactor]: resolve attention backend once per component at load time ( #1657 )
2026-08-02 15:07:42 -07:00
Suhaan Khurana
05406c5d1b
[misc]: consolidate dataset download scripts under examples/datasets/ ( #1667 )
2026-08-02 14:21:24 -07:00
William Lin
af2934dd6b
[feat]: FA4-FP4 ATTN_QAT_INFER on sm_100/sm_103 + NVFP4 weight purge ( #1647 )
2026-07-27 15:46:52 -07:00
William Lin
1801512818
[docs]: cover all registered models in the support matrix ( #1641 )
2026-07-27 11:13:53 -07:00
William Lin
5ae05b032e
[misc]: add LTX-2 fine-tuning example recipes ( #1645 )
2026-07-27 11:11:49 -07:00
Mac Lee
7a592ff09a
[ci]: cache FastVideo kernel builds in Modal ( #1562 )
2026-07-26 04:21:09 -07:00
Lev Novitskiy and Claude Sonnet 5
8b23984c79
[feat] Add Kandinsky5 QAD training pipeline: data preprocessing, QAT finetune, QAT-aware DMD distillation ( #1601 )
...
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com >
2026-07-26 02:59:21 -07:00
Satyam Srivastava