Loay Rashid and Aryan Kumar
0d05b09c57
[new-model] Add initial Qwen-Image-2.1 inference ( #1918 )
...
Co-authored-by: Aryan Kumar <156166681+aryan5v@users.noreply.github.com >
2026-10-25 17:28:49 +00:00
Aryan Kumar and Aryan Kumar
089a5a55a0
[feat] Cookbook serving, hardware catalog, and landing page ( #1999 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-10-20 09:10:29 -07:00
William Lin
2b164405c3
[bugfix] Accept log_queue in StreamingVideoGenerator.from_fastvideo_args ( #1937 )
...
VideoGenerator.from_config calls from_fastvideo_args with a log_queue keyword
argument. The StreamingVideoGenerator override did not accept it, so
StreamingVideoGenerator.from_pretrained raised TypeError. The override now
accepts log_queue and passes it to the executor through VideoGenerator.__init__.
A new test covers the call.
2026-10-07 15:58:03 -07:00
Wenbo Ji 嵇文博
8d2e1cf328
[bugfix] Skip streaming IPC queues for standard VideoGenerator ( #1902 )
...
MultiprocExecutor created two streaming multiprocessing queues for every
generator, but only StreamingVideoGenerator uses them. Each queue uses POSIX
named semaphores in /dev/shm. When a job epilog deleted these files, spawned
workers failed to start. The executor now creates the queues only when
FastVideoArgs.enable_streaming_ipc_queues is set. StreamingVideoGenerator sets
it on a copy of its arguments in queue mode. Standard generation creates no
streaming semaphores.
2026-10-07 15:33:11 -07:00
Boyang ZHONG
dc72a35f4e
[bugfix] Return individual images for batched image API requests ( #1917 )
...
For n > 1, the image endpoints returned one preview grid instead of n images.
The endpoints now run one model batch, save each decoded sample as its own file,
and return one URL or base64 item for each image. This applies to generations
and edits.
A keyword-only return_samples field (default False) is added to OutputConfig,
SamplingParam and ForwardBatch. Batched image requests set it and do not build
preview frames. The worker keeps the sample tensor for these requests, and
non-output ranks clear the field. Defaults and positional arguments do not
change.
2026-10-07 15:06:02 -07:00
Boyang ZHONG
6275ac2c8e
[bugfix] Validate image parameters before generation and uploads ( #1916 )
...
The image endpoints now validate size, output format and count before they
create output directories, save uploads or start generation. An invalid value
returns HTTP 400. Omitted or null values keep their defaults.
Behavior change: an explicit empty size or output format, and a count outside
1-10, now return HTTP 400. Before, the server replaced them with defaults or
clamped the count.
2026-10-07 14:52:15 -07:00
William Lin
73e878a01c
[bugfix]: fix the MLX server and a GPU-only test leak after the 2026-10-07 merges ( #1931 )
...
- create_app reads distributed_executor_backend with getattr(..., None): the MLX
server passes a SimpleNamespace without it, so since #1746 the server could not
start (28 test_openai_video_client failures). An explicit external_launcher
request is still rejected.
- test_cpu_sdpa patches fastvideo.platforms._current_platform instead of
current_platform. monkeypatch restored the real platform as a module attribute
that shadowed the lazy __getattr__, so later tests that fake _current_platform
(gpu_worker dist timeout, ROCm detection, selector role override) failed on
GPU hosts.
GB200 unit lane, A/B on one tray: main 36 failures, this change 0 (2720 passed).
2026-10-07 14:35:05 -07:00
Boyang ZHONG
3907a69727
[bugfix] Preserve image output formats ( #1915 )
...
The OpenAI image endpoint defaults to a .jpg output path, but the shared
output-path helper treated every non-PNG image path as a directory, so JPEG and
WebP requests were written somewhere other than where the endpoint read them.
Recognized PNG/JPEG/WebP extensions are now preserved, and existing directories
are checked first so a directory named e.g. renders.jpg still receives its
output inside it. Collision handling and filename sanitization are unchanged.
2026-10-07 14:23:15 -07:00
William Lin and Claude Opus 5.5
d1416b5930
[misc]: re-run pre-commit after the 2026-10-07 merges ( #1929 )
...
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 06:13:43 -07:00
8530fdc550
[feat] Add external-launcher executor for multi-node inference ( #1746 )
...
Co-authored-by: Will Lin <willlin@nvidia.com >
Co-authored-by: William Lin <8941107+SolitaryThinker@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 04:46:26 -07:00
3467f8befb
[feat] Add end-to-end MMAudio V2A training, inference, and evaluation ( #1648 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 04:25:00 -07:00
William Lin and Claude Opus 5.5
6d6195a9f1
[feat]: fp8 PV mode for the FA4-FP4 attention path ( #1654 )
...
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 03:36:54 -07:00
6e4813f8b4
[bugfix] use in-process executor for num_gpus=1 ( #1755 ) ( #1879 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-07 02:18:23 -07:00
f06d824054
[feat]: add Kandinsky-6.0 TI2VA and VSR pipelines ( #1924 )
...
Co-authored-by: leffff <levnovitskiy@gmail.com >
Co-authored-by: Kirill <kykozlov@gmail.com >
Co-authored-by: shaoxiongduan <shaoxiongduan@gmail.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-06 10:50:17 -07:00
8444c0897a
[feat] FastH3 Ref2VA PDD inference with reference-video VSA sparsity ( #1907 )
...
Co-authored-by: Davids048 <jundasu@ucsd.edu >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-02 11:28:07 -07:00
Kyle Hu
9491c8638a
[bugfix]: keep the full audio track when saving through the ffmpeg pipe ( #1910 )
2026-10-01 22:22:17 -07:00
Junda Su
02f1ce11ae
[misc] Move environment var reads into env registry and rename unprefixed variables ( #1897 )
2026-09-29 14:36:16 -07:00
Aryan Kumar and Aryan Kumar
7f03e03dc6
[docs]: FastH3 V2 cookbook serving and MLX install guide ( #1884 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-09-29 13:03:18 -07:00
Keith
e90be598e5
[perf] MiniMax H3: return uint8 frames from the decode worker ( #1828 )
2026-09-24 18:08:56 -07:00
Lele and 武垚乐
ba5e81083c
[bugfix] Preserve video frames when decoded audio is shorter ( #1857 )
...
Signed-off-by: 武垚乐 <wuyaole@mininglamp.com >
Co-authored-by: 武垚乐 <wuyaole@mininglamp.com >
2026-09-24 17:20:37 -07:00
YZJF
76ce9c7fd6
[bugfix] Reject mismatched model names on image generation routes ( #1881 )
2026-09-24 17:19:29 -07:00
Raghav K
d265a454bf
[bugfix]: Fall back when large pinned output allocation fails ( #1759 )
2026-09-24 17:05:59 -07:00
c100c66578
[bugfix]: isolate cancelled streaming requests from GPU result readers ( #1848 )
...
Co-authored-by: Gxj230958 <222823329+Gxj230958@users.noreply.github.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-09-24 17:04:59 -07:00
sudhirpol522
8839ba8d4d
[bugfix] Add OpenAI-compatible image generation endpoint ( #1840 )
2026-09-14 17:55:56 -07:00
sudhirpol522 and SolitaryThinker
61b91220c0
[bugfix] Validate image response format before generation ( #1841 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-09-14 17:01:40 -07:00
Aryan Kumar and Aryan Kumar
26064193e2
[feat] Add an H3 server cookbook and prompt playground ( #1798 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-08-31 22:14:33 -07:00
William Lin
a159b63c67
[bugfix] Harden OpenAI serving after post-merge review ( #1782 )
2026-08-28 22:29:24 -07:00
William Lin
3987b9ddcd
[feat] Align multimodal OpenAI serving APIs ( #1781 )
2026-08-28 10:09:58 -07:00
William Lin and shaoxiongduan
a534ba20a0
[feat] Add MiniMax H3 LoRA inference and preview launchers ( #1771 )
...
Co-authored-by: shaoxiongduan <shaoxiongduan@gmail.com >
2026-08-27 14:43:39 -07:00
Raghav K
fca45bc8e1
[perf] Quantize frames to uint8 on-device before the post-decode D->H copy ( #1362 )
2026-08-20 21:55:55 -05:00
Kai
0653f8f3af
[new-model] Add V2A: native MMAudio inference pipeline ( #1622 )
2026-08-09 17:29:27 -07:00
William Lin
e0d702decb
[feat] VSA for MiniMax H3: packed mixed-modality sparse attention ( #1695 )
2026-08-09 13:10:51 -07:00
ryanM154
e59a1ce16a
[bugfix] Report actual package version in fastvideo --version ( #1652 )
2026-07-27 16:32:01 -07:00
Junda Su
755a4e4470
[new-model] Add LingBot-Video Dense and MoE/refiner T2V inference ( #1595 )
2026-07-18 20:18:16 -07:00
Mac Lee and Satyam Srivastava
6cbff73687
[bugfix]: skip unused output materialization ( #1567 )
...
Co-authored-by: Satyam Srivastava <srivastavasatyam53@gmail.com >
2026-07-16 04:03:07 +00:00
d922ab2cbc
[model] Flux2 Klein Port ( #1349 )
...
Co-authored-by: Gnav3852 <63612880+Gnav3852@users.noreply.github.com >
Co-authored-by: Mac Lee <macthecadillac@gmail.com >
2026-06-09 14:55:55 -07:00
Kaiqin Kong and SolitaryThinker
d3a821cdcf
[feat] LoRA controls and integration for Dreamverse ( #1420 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-06-01 18:54:11 -07:00
e8597b7448
[Bugfix] FP4 FA4 installation fix ( #1367 )
...
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-05-19 22:45:24 -07:00
d2ffec5cce
[perf] Dreamverse 14/14: Add LTX2 profile speedups ( #1337 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com >
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com >
2026-05-15 18:10:47 -07:00
6392bd40a9
[feat] Dreamverse 10/14: Add serving API contracts ( #1333 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com >
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com >
2026-05-14 10:07:01 -07:00
Shao Duan
17f07bc313
[feat] eval: async VideoPool + metric streamlines ( #1320 )
2026-05-13 15:57:37 -07:00
William Lin
c5088670c8
[misc]: empty __init__.py files with no logic ( #1346 )
2026-05-13 13:09:40 -07:00
Shao Duan
f6396fb8c6
[feat] Add fastvideo.eval video evaluation suite ( #1305 )
2026-05-07 20:31:15 -07:00
Mook and SolitaryThinker
c17d33bf33
[ci] Replace flaky LTX-2 pixel SSIM with latent-slice cosine regression ( #1253 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-05-05 03:36:58 -07:00
2aaeee2ab8
[feat] Improve API: streaming router (multi-replica load balancer + ws proxy) ( #1286 )
...
Co-authored-by: Junda (David) Su <90978028+Davids048@users.noreply.github.com >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com >
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com >
2026-05-05 03:00:08 -07:00
eb3a394224
[feat] Improve API: streaming auxiliaries (safety, rewrite, logger, mock) ( #1284 )
...
Co-authored-by: Junda (David) Su <90978028+Davids048@users.noreply.github.com >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com >
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com >
2026-05-05 00:14:34 -07:00
f673423b51
[feat] Improve API: streaming prompt enhancer with LLMProvider abstraction ( #1258 )
...
Co-authored-by: Junda (David) Su <90978028+Davids048@users.noreply.github.com >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com >
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com >
2026-05-04 13:44:40 -07:00
eb0a41528a
[feat] Improve API: streaming server GpuPool + worker subprocess ( #1257 )
...
Co-authored-by: Junda (David) Su <90978028+Davids048@users.noreply.github.com >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com >
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com >
2026-05-04 12:56:31 -07:00
William Lin
140bd1a6cf
[misc]: standardize install instructions on uv pip install ( #1279 )
2026-05-02 12:45:50 -07:00
William Lin
c77a76c6af
[feat] Stable Audio Open 1.0: T2A + A2A + RePaint inpainting (native) ( #1260 )
2026-05-01 00:07:11 -07:00
