SolitaryThinker
4a5f0af453
[feat]: NVFP4/FP8 attention benchmark (accuracy, TFLOPS, latency)
2026-07-09 13:07:22 -07:00
SolitaryThinker
73b56f0a63
[feat]: FlashInfer SageAttention3 backend + attention shape logging
...
Adds FLASHINFER_SAGE_ATTN3 wrapping flashinfer's dense SM120 NVFP4
attention (flashinfer-ai/flashinfer#3640 ), falling back to torch SDPA
with one warning when flashinfer/SM120 is unavailable, and an env-gated
JSONL attention shape logger (FASTVIDEO_ATTN_SHAPE_LOG) hooked into the
new backend and SAGE_ATTN_THREE to collect real workload shapes for
SM121 (DGX Spark) kernel tuning.
2026-07-09 12:48:18 -07:00
William Lin
a5a6d171e5
[attn] Make FA4 explicit opt-in via FASTVIDEO_FA4 and delete the runtime fallback machinery ( #1540 )
2026-07-04 14:51:00 -07:00
William Lin
b36d0ef085
[infra] Add DGX Spark and multi-architecture CUDA support ( #1447 )
2026-07-03 13:41:43 -07:00
Kevin Lin
82ed9fe58d
[feat] QAD 5090: FP8 linear layer inference ( #1465 )
2026-06-22 18:25:06 -07:00
c3b971488e
[docs] QAD 5090: Add NVFP4 + Attn-QAT inference example and how-to (9/12) ( #1458 )
...
Co-authored-by: William Lin <SolitaryThinker@users.noreply.github.com >
Co-authored-by: Loay Rashid <42599591+loaydatrain@users.noreply.github.com >
Co-authored-by: Kaiqin Kong <k1kong@ucsd.edu >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
Co-authored-by: alexzms <26690162+alexzms@users.noreply.github.com >
2026-06-16 14:36:50 -07:00
KUAN-HAO HUANG and SolitaryThinker
019239690b
[perf] Add Adaptive Guidance (CFG gating) for stale-uncond reuse ( #1372 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-05-30 13:58:55 -07:00
Raghav K
68179cd752
[docs] Document enable_torch_compile (+ A/B example) ( #1366 )
2026-05-22 00:25:42 -07:00
e8597b7448
[Bugfix] FP4 FA4 installation fix ( #1367 )
...
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2026-05-19 22:45:24 -07:00
b4458e5bae
feat: FP4 Flash Attention 4 for Blackwell GPUs ( #1221 )
...
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-12 17:04:39 -07:00
William Lin
140bd1a6cf
[misc]: standardize install instructions on uv pip install ( #1279 )
2026-05-02 12:45:50 -07:00
Zhang Peiyuan and Will Lin
fc80d95d7e
[Misc] Remove STA ( #1124 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-02-23 15:14:42 -08:00
Zhang Peiyuan
128d0b7fc5
[Misc] Remove Teacache ( #1121 )
2026-02-22 16:53:07 -08:00
6736dc06a5
Improve Docs ( #1112 )
...
Co-authored-by: Peiyuan Zhang <a1286225768@slurm-h200-204-227.slurm-compute.tenant-slurm.svc.cluster.local >
Co-authored-by: Peiyuan Zhang <a1286225768@slurm-login-0.slurm-login.tenant-slurm.svc.cluster.local >
2026-02-19 14:23:32 -08:00
XOR-op
38a6bd93d3
[chore]: update sageattn3 installation instructions ( #1050 )
2026-01-29 15:45:52 -08:00
Qi Jia
5285116e73
[docs]: fix various broken links across the documentation ( #979 )
2026-01-01 20:02:39 -06:00
Mihir Jagtap
8f5712629f
[docs] port to mkdocs ( #855 )
2025-11-04 14:31:56 -08:00
SolitaryThinker