Aryan Kumar and Aryan Kumar
7f03e03dc6
[docs]: FastH3 V2 cookbook serving and MLX install guide ( #1884 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-09-29 13:03:18 -07:00
Keith
e90be598e5
[perf] MiniMax H3: return uint8 frames from the decode worker ( #1828 )
2026-09-24 18:08:56 -07:00
Lele and 武垚乐
ba5e81083c
[bugfix] Preserve video frames when decoded audio is shorter ( #1857 )
...
Signed-off-by: 武垚乐 <wuyaole@mininglamp.com >
Co-authored-by: 武垚乐 <wuyaole@mininglamp.com >
2026-09-24 17:20:37 -07:00
YZJF
76ce9c7fd6
[bugfix] Reject mismatched model names on image generation routes ( #1881 )
2026-09-24 17:19:29 -07:00
Raghav K
d265a454bf
[bugfix]: Fall back when large pinned output allocation fails ( #1759 )
2026-09-24 17:05:59 -07:00
c100c66578
[bugfix]: isolate cancelled streaming requests from GPU result readers ( #1848 )
...
Co-authored-by: Gxj230958 <222823329+Gxj230958@users.noreply.github.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-09-24 17:04:59 -07:00
sudhirpol522
8839ba8d4d
[bugfix] Add OpenAI-compatible image generation endpoint ( #1840 )
2026-09-14 17:55:56 -07:00
sudhirpol522 and SolitaryThinker
61b91220c0
[bugfix] Validate image response format before generation ( #1841 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-09-14 17:01:40 -07:00
Lele
316f3876c2
[bugfix]: allow MiniMax H3 frame padding at the 15-second limit
...
Accept the causal-VAE-aligned 362-frame bucket (15.083 s) for 15-second H3 requests.
- Hoist MINIMAX_H3_MIN/MAX_ALIGNED_FRAMES next to align_num_frames and reuse them in the CUDA stage, the MLX runtime, and the LoRA example so the bound is consistent across entry points.
- State the accepted frame range in the error messages.
- Cover seconds="15" -> 362 at OpenAI admission and the MLX resolve_geometry bound.
- Update the Spark/openai cookbook frame caps from 345 to 362.
Known gaps: no GPU-lane coverage for the 362 bucket (SSIM runs 124 frames; the golden gate is a fixed-geometry fingerprint), and explicit num_frames=360 still hits the pre-existing grid gate.
2026-09-14 16:54:41 -07:00
Aryan Kumar and Aryan Kumar
26064193e2
[feat] Add an H3 server cookbook and prompt playground ( #1798 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-08-31 22:14:33 -07:00
William Lin
a159b63c67
[bugfix] Harden OpenAI serving after post-merge review ( #1782 )
2026-08-28 22:29:24 -07:00
William Lin
3987b9ddcd
[feat] Align multimodal OpenAI serving APIs ( #1781 )
2026-08-28 10:09:58 -07:00
Raghav K
fca45bc8e1
[perf] Quantize frames to uint8 on-device before the post-decode D->H copy ( #1362 )
2026-08-20 21:55:55 -05:00
William Lin
9028953625
[misc] yapf pass under CI's interpreter (3.12) + pin hook language_version ( #1702 )
2026-08-08 22:24:17 -07:00
Junda Su
755a4e4470
[new-model] Add LingBot-Video Dense and MoE/refiner T2V inference ( #1595 )
2026-07-18 20:18:16 -07:00
Mac Lee and Satyam Srivastava
6cbff73687
[bugfix]: skip unused output materialization ( #1567 )
...
Co-authored-by: Satyam Srivastava <srivastavasatyam53@gmail.com >
2026-07-16 04:03:07 +00:00
6392bd40a9
[feat] Dreamverse 10/14: Add serving API contracts ( #1333 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com >
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com >
2026-05-14 10:07:01 -07:00
William Lin
c5088670c8
[misc]: empty __init__.py files with no logic ( #1346 )
2026-05-13 13:09:40 -07:00
2aaeee2ab8
[feat] Improve API: streaming router (multi-replica load balancer + ws proxy) ( #1286 )
...
Co-authored-by: Junda (David) Su <90978028+Davids048@users.noreply.github.com >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com >
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com >
2026-05-05 03:00:08 -07:00
eb3a394224
[feat] Improve API: streaming auxiliaries (safety, rewrite, logger, mock) ( #1284 )
...
Co-authored-by: Junda (David) Su <90978028+Davids048@users.noreply.github.com >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com >
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com >
2026-05-05 00:14:34 -07:00
f673423b51
[feat] Improve API: streaming prompt enhancer with LLMProvider abstraction ( #1258 )
...
Co-authored-by: Junda (David) Su <90978028+Davids048@users.noreply.github.com >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com >
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com >
2026-05-04 13:44:40 -07:00
eb0a41528a
[feat] Improve API: streaming server GpuPool + worker subprocess ( #1257 )
...
Co-authored-by: Junda (David) Su <90978028+Davids048@users.noreply.github.com >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com >
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com >
2026-05-04 12:56:31 -07:00
William Lin
95fd29e0cb
[feat] Streaming WebSocket server skeleton (single generator + fMP4) ( #1251 )
2026-04-26 00:33:49 -07:00
William Lin
e0dc5f2b0c
[feat] Add typed LTX-2 continuation state and streaming session store ( #1250 )
2026-04-24 01:28:07 -07:00
William Lin
0e3529869c
[feat] [5/n] Improve API: wire ServeConfig.default_request into OpenAI serving ( #1237 )
2026-04-17 13:26:18 -07:00
William Lin
145a3f166b
[feat] [4/n] Improve API: refactor sampling param and merge with presets ( #1234 )
2026-04-16 14:10:02 -07:00
William Lin
88a5a933ab
[feat] [3/n] Improve API: extend support to cli ( #1226 )
2026-04-14 15:20:47 -07:00
William Lin
c591d6d2a6
[feat] [2/n] Improve API: add initial support in video_generator ( #1220 )
2026-04-06 10:33:54 -07:00
Ajay Anubolu
e63b7d8ac4
[Feat] Added OpenAI-compatible API server and benchmark script ( #1109 )
2026-03-02 17:12:32 -05:00
Ishan and Jinzhe Pan
0aff68f51d
[Feat] Add Stable Diffusion 3.5 ( #1075 )
...
Co-authored-by: Jinzhe Pan <eigensystem1318@gmail.com >
2026-02-10 14:31:36 +08:00
William Lin and ainsley
9370234294
[feat] Add gradio local inference demo ( #847 )
...
Co-authored-by: ainsley <jzhang2765@wisc.edu >
2025-10-26 07:01:33 -07:00
