SolitaryThinker
4a5f0af453
[feat]: NVFP4/FP8 attention benchmark (accuracy, TFLOPS, latency)
2026-07-09 13:07:22 -07:00
SolitaryThinker
73b56f0a63
[feat]: FlashInfer SageAttention3 backend + attention shape logging
...
Adds FLASHINFER_SAGE_ATTN3 wrapping flashinfer's dense SM120 NVFP4
attention (flashinfer-ai/flashinfer#3640 ), falling back to torch SDPA
with one warning when flashinfer/SM120 is unavailable, and an env-gated
JSONL attention shape logger (FASTVIDEO_ATTN_SHAPE_LOG) hooked into the
new backend and SAGE_ATTN_THREE to collect real workload shapes for
SM121 (DGX Spark) kernel tuning.
2026-07-09 12:48:18 -07:00
595f0ea60e
[feat] Add DreamX-World 5B Cam and AR pipelines ( #1538 )
...
Co-authored-by: Suckl <Suckl@users.noreply.github.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-07-07 06:16:18 +00:00
William Lin
a5a6d171e5
[attn] Make FA4 explicit opt-in via FASTVIDEO_FA4 and delete the runtime fallback machinery ( #1540 )
2026-07-04 14:51:00 -07:00
William Lin
b36d0ef085
[infra] Add DGX Spark and multi-architecture CUDA support ( #1447 )
2026-07-03 13:41:43 -07:00
Kevin Lin
82ed9fe58d
[feat] QAD 5090: FP8 linear layer inference ( #1465 )
2026-06-22 18:25:06 -07:00
c3b971488e
[docs] QAD 5090: Add NVFP4 + Attn-QAT inference example and how-to (9/12) ( #1458 )
...
Co-authored-by: William Lin <SolitaryThinker@users.noreply.github.com >
Co-authored-by: Loay Rashid <42599591+loaydatrain@users.noreply.github.com >
Co-authored-by: Kaiqin Kong <k1kong@ucsd.edu >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: alexzms <26690162+alexzms@users.noreply.github.com >
2026-06-16 14:36:50 -07:00
Aryan Kumar and Aryan Kumar
7f539424cb
[feat]: add Lucy Edit inference scaffold ( #1363 )
...
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com >
2026-06-09 15:21:43 -07:00
KUAN-HAO HUANG and SolitaryThinker
019239690b
[perf] Add Adaptive Guidance (CFG gating) for stale-uncond reuse ( #1372 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-05-30 13:58:55 -07:00
Kaiqin Kong and SolitaryThinker
afdb6fbfa5
[feat] Add MatrixGame3.0 ( #1201 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-05-27 21:07:01 +00:00
Raghav K
68179cd752
[docs] Document enable_torch_compile (+ A/B example) ( #1366 )
2026-05-22 00:25:42 -07:00
e8597b7448
[Bugfix] FP4 FA4 installation fix ( #1367 )
...
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-05-19 22:45:24 -07:00
Kaiqin Kong and mergify[bot]
773d44b875
[misc] Rename MatrixGame to MatrixGame2 ( #1357 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-17 22:57:03 -07:00
William Lin
325861fb99
[misc]: PR-1225 sync — housekeeping (1/12) ( #1347 )
2026-05-13 15:21:52 -07:00
b4458e5bae
feat: FP4 Flash Attention 4 for Blackwell GPUs ( #1221 )
...
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-12 17:04:39 -07:00
William Lin
140bd1a6cf
[misc]: standardize install instructions on uv pip install ( #1279 )
2026-05-02 12:45:50 -07:00
William Lin
145a3f166b
[feat] [4/n] Improve API: refactor sampling param and merge with presets ( #1234 )
2026-04-16 14:10:02 -07:00
William Lin
88a5a933ab
[feat] [3/n] Improve API: extend support to cli ( #1226 )
2026-04-14 15:20:47 -07:00
vishruthb
5789955bbe
[feat] add gen3c (cosmos-7b) model and pipeline support ( #1059 )
2026-04-01 11:42:02 +00:00
Ajay Anubolu
02c1c49b75
[CI] Add inference performance regression tests ( #1140 )
2026-03-07 08:26:54 +08:00
Jinzhe Pan
5190c1bb1e
[Doc] add doc for inference architecture ( #1147 )
2026-03-02 13:44:27 -08:00
Zhang Peiyuan
fea556269b
[Misc] Fix memory leakage in VideoGenerator ( #1132 )
2026-02-26 19:51:32 -08:00
Junda (David) Su
e315657066
[docs] [kernel] Migrate to uv ( #1127 )
2026-02-25 14:13:50 -08:00
Zhang Peiyuan and Will Lin
fc80d95d7e
[Misc] Remove STA ( #1124 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-02-23 15:14:42 -08:00
Zhang Peiyuan
128d0b7fc5
[Misc] Remove Teacache ( #1121 )
2026-02-22 16:53:07 -08:00
Zhang Peiyuan
03d9ce2edb
[Misc] Remove StepVideo ( #1118 )
2026-02-21 17:15:42 -08:00
6736dc06a5
Improve Docs ( #1112 )
...
Co-authored-by: Peiyuan Zhang <a1286225768@slurm-h200-204-227.slurm-compute.tenant-slurm.svc.cluster.local >
Co-authored-by: Peiyuan Zhang <a1286225768@slurm-login-0.slurm-login.tenant-slurm.svc.cluster.local >
2026-02-19 14:23:32 -08:00
William Lin
75e193a2c9
[core] Refactor and centralize our registry for models, pipelines, and sampling params ( #1066 )
2026-02-05 14:40:30 -08:00
XOR-op
38a6bd93d3
[chore]: update sageattn3 installation instructions ( #1050 )
2026-01-29 15:45:52 -08:00
XOR-op and Will Lin
e8c854bcf1
[docs] Offloading instruction ( #1022 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-01-26 13:40:28 -08:00
XOR-op
b7f69c2c1d
[feat!] Disable FSDP inference by default ( #1001 )
2026-01-13 14:20:05 -08:00
William Lin
e7f6db9bd1
[docs] Update docs and README ( #975 )
2026-01-04 14:59:19 -06:00
Qi Jia
5285116e73
[docs]: fix various broken links across the documentation ( #979 )
2026-01-01 20:02:39 -06:00
Mihir Jagtap
8f5712629f
[docs] port to mkdocs ( #855 )
2025-11-04 14:31:56 -08:00
SolitaryThinker