Satyam Srivastava
0ef47caf86
[bugfix]: select architecture-specific Blackwell kernel targets
...
- Detect GB200 and GB300 as 10.0a and 10.3a
- Build future GB200 CI images with 10.0a
- Add regression tests for detection, cache keys, and build arguments
2026-10-05 15:42:48 -07:00
Satyam Srivastava
e71d01648c
[feat]: add selectable Modal and GB200 Kubernetes GPU CI
...
- Preserve existing CI and add configurable GPU backend routing
- Limit execution to 2 active PRs, 4 GPUs per PR, and 8 GPUs total
- Add persistent admission, cancellation recovery, and backend statuses
- Document deployment and add infrastructure regression tests
2026-10-01 14:44:14 -07:00
e1f3904799
[kernel] sm_100a CUDA backward for VSA block-sparse attention, 128-token blocks ( #1866 )
...
Co-authored-by: Pengcheng Li <pengchengl@ptyche0203.ptyche.clusters.nvidia.com >
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com >
2026-09-29 16:57:22 -07:00
Junda Su
02f1ce11ae
[misc] Move environment var reads into env registry and rename unprefixed variables ( #1897 )
2026-09-29 14:36:16 -07:00
Aryan Kumar and Aryan Kumar
7f03e03dc6
[docs]: FastH3 V2 cookbook serving and MLX install guide ( #1884 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-09-29 13:03:18 -07:00
Junda Su
e3b88bb12a
[feat] Add a typed environment-variable registry, policy doc, and contract test ( #1896 )
2026-09-29 12:50:45 -07:00
Junda Su
cb66acd400
[bugfix] Fix environment-variable bugs in LTX-2 debug logging, HF token lookup, and attention backend reads ( #1895 )
2026-09-29 11:48:31 -07:00
Max LI
dd35763ad6
[bugfix] Fix MLX prompt enhancement sampler compatibility ( #1891 )
2026-09-27 14:53:25 -07:00
Keith
e90be598e5
[perf] MiniMax H3: return uint8 frames from the decode worker ( #1828 )
2026-09-24 18:08:56 -07:00
Lele and 武垚乐
ba5e81083c
[bugfix] Preserve video frames when decoded audio is shorter ( #1857 )
...
Signed-off-by: 武垚乐 <wuyaole@mininglamp.com >
Co-authored-by: 武垚乐 <wuyaole@mininglamp.com >
2026-09-24 17:20:37 -07:00
YZJF
76ce9c7fd6
[bugfix] Reject mismatched model names on image generation routes ( #1881 )
2026-09-24 17:19:29 -07:00
Junda Su
08d99c089e
[perf] Reuse cached VAE offload for H3 conditioning ( #1882 )
2026-09-24 17:18:39 -07:00
Jerry-XY
20751a21aa
[bugfix] Keep the VSA-H3 tile buffer out of the autograd graph ( #1858 )
2026-09-24 17:16:49 -07:00
alanhuangyoo and SolitaryThinker
9dd2a837f4
[bugfix] encoders: keep Qwen2.5-VL importable on transformers 5 ( #1791 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-09-24 17:13:23 -07:00
Kyle Hu
81f3fec7fd
[bugfix]: workers killed by a signal now log the reason ( #1725 )
2026-09-24 17:06:55 -07:00
Raghav K
d265a454bf
[bugfix]: Fall back when large pinned output allocation fails ( #1759 )
2026-09-24 17:05:59 -07:00
c100c66578
[bugfix]: isolate cancelled streaming requests from GPU result readers ( #1848 )
...
Co-authored-by: Gxj230958 <222823329+Gxj230958@users.noreply.github.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-09-24 17:04:59 -07:00
Aryan Kumar
361f919c88
[feat]: add a narrow FastH3 8-step MLX ladder
...
Keep the four-step uniform AdaLN cache, and use explicit DMD rungs only when the snapshot declares its own scheduler shifts.
2026-09-23 11:06:55 -07:00
430e52154e
[bugfix]: Restore exact Qwen3-VL vision interpolation ( #1737 )
...
Co-authored-by: William Lin <8941107+SolitaryThinker@users.noreply.github.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-09-18 05:00:05 -07:00
Keith and SolitaryThinker
c4824c7764
[bugfix] FP8: gate the ROCm _scaled_mm path on CDNA4 (gfx950) instead of the capability tuple ( #1859 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-09-16 19:58:55 -07:00
William Lin
0100218594
[feat] Support the FastH3 8-Step V2 checkpoint: checkpoint-defined shifts, explicit DMD schedule, new example ( #1852 )
2026-09-15 14:13:45 -07:00
Ishan and SolitaryThinker
37d06a832f
[feat] Add fastvideo serve configs for Wan CUDA models ( #1801 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-09-14 18:23:35 -07:00
sudhirpol522
8839ba8d4d
[bugfix] Add OpenAI-compatible image generation endpoint ( #1840 )
2026-09-14 17:55:56 -07:00
sudhirpol522 and SolitaryThinker
61b91220c0
[bugfix] Validate image response format before generation ( #1841 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-09-14 17:01:40 -07:00
Lele
316f3876c2
[bugfix]: allow MiniMax H3 frame padding at the 15-second limit
...
Accept the causal-VAE-aligned 362-frame bucket (15.083 s) for 15-second H3 requests.
- Hoist MINIMAX_H3_MIN/MAX_ALIGNED_FRAMES next to align_num_frames and reuse them in the CUDA stage, the MLX runtime, and the LoRA example so the bound is consistent across entry points.
- State the accepted frame range in the error messages.
- Cover seconds="15" -> 362 at OpenAI admission and the MLX resolve_geometry bound.
- Update the Spark/openai cookbook frame caps from 345 to 362.
Known gaps: no GPU-lane coverage for the 362 bucket (SSIM runs 124 frames; the golden gate is a fixed-geometry fingerprint), and explicit num_frames=360 still hits the pre-existing grid gate.
2026-09-14 16:54:41 -07:00
Yaegaki1Erika
614b59543c
[bugfix]: respect serialized tensor dtype in parquet dataloader ( #1843 )
2026-09-14 16:34:25 -07:00
William Lin
1c14afd559
[docs]: refresh AGENTS.md maps and add Wan SP/I2V and CI test notes ( #1845 )
2026-09-14 16:06:53 -07:00
Yaegaki1Erika
9a3c45779c
[bugfix]: fix Wan I2V DMD conditioning under sequence parallelism ( #1844 )
...
The pipeline pre-sharded only the image conditioning along the temporal axis while the noise input stayed full-length, so concatenation could not match for sp_world_size > 1. WanTransformer3DModel shards the flattened token sequence after patch embedding, so pass full-length mask+latent conditioning and let the transformer shard.
Also reads temporal_compression_ratio from the VAE config, simplifies the conditioning mask, concatenates in the transformer's (bs, c, t, h, w) layout, and adds unit coverage.
Co-authored-by: Yaegaki1Erika <70182590+Yaegaki1Erika@users.noreply.github.com >
2026-09-14 15:58:13 -07:00
Kyle Hu
bfc9c01797
[feat]: convert the MiniMax H3 text encoder to NVFP4 ( #1838 )
2026-09-12 18:48:07 -07:00
Kyle Hu
3a3ad3d209
[feat]: NVFP4 text encoder for MiniMax H3 ( #1837 )
2026-09-12 18:31:59 -07:00
William Lin
556ac7088e
[refactor] Simplify Wan sampling and tests ( #1825 )
2026-09-07 15:57:19 -07:00
Junda Su
e7456f1b75
Add H3 support into Dreamverse ( #1800 )
2026-09-07 13:09:44 -07:00
William Lin
7f83164233
[refactor] Move Wan VAE into the Wan package ( #1824 )
2026-09-05 18:43:55 -07:00
Junda Su
4e52f47d1e
[feat] add MXFP8 support on H3 ( #1796 )
2026-09-05 17:08:58 -07:00
William Lin
e19913f6e9
[refactor] Group Wan transformer and config ( #1823 )
2026-09-05 17:05:32 -07:00
William Lin
2413a57651
Disable old SSIM models ( #1820 )
2026-09-04 21:20:48 -07:00
SYLAR
7bb76b5ec9
[feat] Add native SM103a VSA support ( #1812 )
...
Signed-off-by: lishunyang12 <lishunyang12@163.com >
2026-09-03 15:00:28 -07:00
aaef49bfc6
[feat]: run FastH3 across two DGX Sparks with Ray sequence parallel ( #1803 )
...
Co-authored-by: Kyle <shh075@ucsd.edu >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
Co-authored-by: Satyam Srivastava <srivastavasatyam53@gmail.com >
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-09-01 01:37:23 -07:00
Aryan Kumar and Aryan Kumar
cf6a00b9be
[feat]: add opt-in CUDA TAEH3 preview decode for FastH3 ( #1795 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-08-31 23:34:56 -07:00
Aryan Kumar and Aryan Kumar
26064193e2
[feat] Add an H3 server cookbook and prompt playground ( #1798 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-08-31 22:14:33 -07:00
Aryan Kumar and Aryan Kumar
a28f2bab4b
[feat] Add an optional MLX TAEH3 preview decoder ( #1794 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-08-31 05:08:06 -07:00
Aryan Kumar and Aryan Kumar
f82d8be4bf
[perf] Sequential MiniMax H3 start with GPU-direct DiT load ( #1793 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-08-31 04:20:21 -07:00
Aryan Kumar and Aryan Kumar
8e1775183e
[perf] Speed up exact MiniMax H3 MLX inference ( #1792 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-08-31 04:14:55 -07:00
Suhaan Khurana
29ff16ec96
[feat] Add MiniMax H3 MLX spatial fast mode ( #1789 )
2026-08-30 17:47:02 -07:00
Aryan Kumar and Aryan Kumar
8f9d76a80d
[perf]: dispatch wide-M affine H3 MLX linears through dequant plus dense GEMM ( #1788 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-08-30 14:42:01 -07:00
a4d9a75e2c
[perf] Add MiniMax H3 MLX VSA and SIMD attention ( #1776 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2026-08-30 13:44:54 -07:00
KyleNeverGivesUp
b2db0c0a13
[ci]: seed stable GB10 grad-norm references ( #1756 )
2026-08-30 03:09:18 -07:00
William Lin
a159b63c67
[bugfix] Harden OpenAI serving after post-merge review ( #1782 )
2026-08-28 22:29:24 -07:00
ac48bb3cd1
[feat] Add MiniMax H3 MLX T2VA inference ( #1770 )
...
Co-authored-by: Aryan Kumar <aryank@Aryans-Mac-Studio.local >
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: CodeRabbit <noreply@coderabbit.ai >
2026-08-28 12:54:33 -07:00
William Lin
3987b9ddcd
[feat] Align multimodal OpenAI serving APIs ( #1781 )
2026-08-28 10:09:58 -07:00