 William Lin
|
f9e3680f11
|
[perf] Align FastH3 optimized inference profile (#1748)
|
2026-08-23 02:01:03 -07:00 |
|
|
William Lin
|
604e0205a4
|
[perf] Keep odd MiniMax-H3 VSA tiles on sm100a (#1745)
|
2026-08-22 18:29:30 -07:00 |
|
|
William Lin
|
c488fa1211
|
[perf] Add opt-in packed-varlen FA4 for MiniMax-H3 (#1742)
|
2026-08-22 17:16:47 -07:00 |
|
|
William Lin
|
d3cff517cd
|
[perf] Add opt-in regional fullgraph compile for DiT inference (#1741)
|
2026-08-22 12:14:39 -07:00 |
|
|
Junda Su
|
2f3d407406
|
[perf] Optimize MiniMax H3 VAE decoding (#1734)
|
2026-08-21 14:57:32 -07:00 |
|
|
William Lin
|
6d6a10be7a
|
[feat] FastVideo-Minimax-FastH3-Preview few-step example + 64-token-tile VSA-H3 inference path (#1731)
|
2026-08-21 12:40:09 -05:00 |
|
|
|
00338aa9ca
|
[perf] Add FA4 CuTe backward support for VSA-256 (#1639)
Co-authored-by: Hyunsung Lee <hyunsungl@sizigistudios.com>
Co-authored-by: alexzms <3036648523@qq.com>
|
2026-08-19 11:46:49 -07:00 |
|
|
Kai
|
0653f8f3af
|
[new-model] Add V2A: native MMAudio inference pipeline (#1622)
|
2026-08-09 17:29:27 -07:00 |
|
|
William Lin
|
e0d702decb
|
[feat] VSA for MiniMax H3: packed mixed-modality sparse attention (#1695)
|
2026-08-09 13:10:51 -07:00 |
|
|
William Lin
|
b9be2449dc
|
[refactor]: delete the dead global attention-backend override (#1672)
|
2026-08-02 18:00:42 -07:00 |
|
|
William Lin
|
7b094c945b
|
[refactor]: resolve attention backend once per component at load time (#1657)
|
2026-08-02 15:07:42 -07:00 |
|
|
William Lin
|
af2934dd6b
|
[feat]: FA4-FP4 ATTN_QAT_INFER on sm_100/sm_103 + NVFP4 weight purge (#1647)
|
2026-07-27 15:46:52 -07:00 |
|
|
Lev NovitskiyandClaude Sonnet 5
|
8b23984c79
|
[feat] Add Kandinsky5 QAD training pipeline: data preprocessing, QAT finetune, QAT-aware DMD distillation (#1601)
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
|
2026-07-26 02:59:21 -07:00 |
|
|
William Lin
|
bf18371afe
|
[feat] Enable LTX-2 NVFP4 linear and attention QAT fine-tuning (#1626)
|
2026-07-26 02:19:34 -07:00 |
|
|
Adriel FungandSolitaryThinker
|
521dee0e82
|
[perf]: enable per-block torch.compile for LTX2 with persistent cache (#1602)
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
|
2026-07-20 15:59:13 -07:00 |
|
|
|
9709b7513b
|
[feat] Port NVFP4 QAT/QAD to modular train framework (#1619)
Co-authored-by: Peiyuan Zhang <email>
Co-authored-by: Peiyuan <a>
|
2026-07-18 15:01:09 -07:00 |
|
|
William Lin
|
c1abc42782
|
[bugfix]: allow unrestricted head sizes in SDPA (#1596)
|
2026-07-13 16:04:51 -07:00 |
|
|
Raghav K
|
055586703d
|
[perf]: register a real backward for FA2 default + masked/varlen custom ops (training-under-compile) (#1388)
|
2026-07-12 00:45:27 +00:00 |
|
|
|
02e1143f22
|
[feat] Add Kandinsky-5 T2V/I2V pipeline support (#1471)
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com>
Co-authored-by: leffff <levnovitskiy@gmail.com>
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
|
2026-07-07 14:43:30 -07:00 |
|
|
William Lin
|
a5a6d171e5
|
[attn] Make FA4 explicit opt-in via FASTVIDEO_FA4 and delete the runtime fallback machinery (#1540)
|
2026-07-04 14:51:00 -07:00 |
|
|
Mac Lee
|
00ec3e7388
|
[bugfix]: compute VSA topk from padded blocks (#1517)
|
2026-07-03 14:16:51 -07:00 |
|
|
William Lin
|
b36d0ef085
|
[infra] Add DGX Spark and multi-architecture CUDA support (#1447)
|
2026-07-03 13:41:43 -07:00 |
|
|
William Lin
|
b454aa56c3
|
[misc] fix pre-commit (#1500)
|
2026-06-26 12:39:28 -07:00 |
|
|
Utkarsh RanjanandClaude Opus 4.8
|
b57180bf97
|
[bugfix] Warn when a requested attention backend is unsupported by a layer (#1254) (#1486)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-24 15:56:39 -07:00 |
|
|
|
b2ade71467
|
[Bugfix] QAD 5090: Torch.compile and other optimizations (15/12) (#1466)
Co-authored-by: alexzms <3036648523@qq.com>
Co-authored-by: Kaiqin Kong <k1kong@ucsd.edu>
Co-authored-by: William Lin <SolitaryThinker@users.noreply.github.com>
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
|
2026-06-23 01:23:57 -07:00 |
|
|
|
1dee77f4a4
|
[feat] QAD 5090: Wire the Attn-QAT training attention backend (10/12) (#1459)
Co-authored-by: William Lin <SolitaryThinker@users.noreply.github.com>
Co-authored-by: Loay Rashid <42599591+loaydatrain@users.noreply.github.com>
Co-authored-by: Kaiqin Kong <k1kong@ucsd.edu>
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: alexzms <26690162+alexzms@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-17 13:32:56 -07:00 |
|
|
|
19a838f54f
|
[bugfix]: release VSA tile cache during training (#1434)
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-09 15:01:22 -07:00 |
|
|
alexzms
|
be548a78ea
|
[feat] VSA-256 fastpath on Blackwell via FA4 CuTe block-sparse attention (#1354)
|
2026-05-26 12:58:29 -07:00 |
|
|
William Lin
|
ba75ad82db
|
[refactor]: shared attention infra additions for QAT-compat (Attn-QAT 5/12) (#1383)
|
2026-05-23 16:19:24 -07:00 |
|
|
|
2f3ca8aaad
|
[perf]: register FA2/FA3 default flash_attn_func as a torch.library custom op (#1373)
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
|
2026-05-23 00:39:06 -07:00 |
|
|
|
fda02036bc
|
[feat]: Attn-QAT inference + training backends (deadcode) (Attn-QAT 4/12) (#1358)
Co-authored-by: jzhang38 <42993249+jzhang38@users.noreply.github.com>
Co-authored-by: RandNMR73 <99706358+RandNMR73@users.noreply.github.com>
|
2026-05-22 02:59:25 -07:00 |
|
|
|
e8597b7448
|
[Bugfix] FP4 FA4 installation fix (#1367)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
|
2026-05-19 22:45:24 -07:00 |
|
|
|
b4458e5bae
|
feat: FP4 Flash Attention 4 for Blackwell GPUs (#1221)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-05-12 17:04:39 -07:00 |
|
|
alexzmsandmergify[bot]
|
636d3b743e
|
[misc] attention hot-path cleanup + denoising loop hoists (#1272)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-05-10 11:51:10 -07:00 |
|
|
William Lin
|
140bd1a6cf
|
[misc]: standardize install instructions on uv pip install (#1279)
|
2026-05-02 12:45:50 -07:00 |
|
|
William Lin
|
c85f6a477f
|
[docs] add hierarchical AGENTS.md per-directory guidance (#1278)
|
2026-05-02 03:28:18 -07:00 |
|
|
Junda Su
|
40d4930d73
|
[bugfix] Update fa import (#1271)
|
2026-05-02 01:25:22 -07:00 |
|
|
|
f6e65ff668
|
[Feature] Add BSA (Bidirectional Sparse Attention) inference backend (#1174)
Co-authored-by: Satyam Srivastava <satyam53@Mac.lan1>
Co-authored-by: Satyam Srivastava <satyam53@Satyams-MacBook-Air.local>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-04-05 05:00:33 +00:00 |
|
|
alexzms
|
14261bc98c
|
[feat] pre-commit support 120 col num (#1167)
|
2026-03-11 20:19:30 -07:00 |
|
|
XOR-op
|
95066245db
|
[misc] FlashAttention 4 support (#1114)
|
2026-03-07 16:53:43 -08:00 |
|
|
Zhang Peiyuan
|
cd1b7cf139
|
[Refactor] SP Mask --> original seq len; HunyuanVideo 1.5 does not need mask (#1142)
|
2026-03-04 11:44:47 +08:00 |
|
|
Zhang PeiyuanandWill Lin
|
fc80d95d7e
|
[Misc] Remove STA (#1124)
Co-authored-by: Will Lin <wlsaidhi@gmail.com>
|
2026-02-23 15:14:42 -08:00 |
|
|
|
10fc92dba5
|
Upstream LTX2 Training (#1116)
Co-authored-by: RandNMR73 <notomatthew31@gmail.com>
Co-authored-by: JerryZhou54 <zhouw.jerry2017@outlook.com>
Co-authored-by: Davids048 <jundasu@ucsd.edu>
Co-authored-by: Peiyuan Zhang <a1286225768@slurm-h200-204-239.slurm-compute.tenant-slurm.svc.cluster.local>
|
2026-02-21 16:06:55 -08:00 |
|
|
XOR-op
|
38a6bd93d3
|
[chore]: update sageattn3 installation instructions (#1050)
|
2026-01-29 15:45:52 -08:00 |
|
|
alexzms
|
560628709c
|
[Bug Fix] Add autograd wrapper for block-sparse attention in fastvideo-kernel + fix CMake extension linking (#1015)
|
2026-01-16 21:16:43 -08:00 |
|
|
Loay Rashid
|
dea69cf651
|
[New Model] Turbodiffusion (#971)
|
2026-01-02 17:55:56 -06:00 |
|
|
|
551b2d2048
|
[fix]: fix sliding_tile_attn with sdpa(without flash_attn) (#967)
Co-authored-by: roywang <roywang@amd.com>
Co-authored-by: Will Lin <wlsaidhi@gmail.com>
|
2025-12-29 14:19:40 -06:00 |
|
|
William Lin
|
9cd6a86b95
|
[chore] release v0.1.7 (#955)
|
2025-12-27 05:05:37 -06:00 |
|
|
William LinandShreejithSG
|
2f6230abcf
|
[kernel] Reorg and fix fastvideo-kernel (#962)
Co-authored-by: ShreejithSG <shreejithsg@gmail.com>
|
2025-12-26 01:50:24 -06:00 |
|
|
Shreejith SGandWilliam Lin
|
f8bfc76015
|
feat: consolidate attention kernels into unified fastvideo-kernel package (#946)
Co-authored-by: William Lin <SolitaryThinker@users.noreply.github.com>
|
2025-12-24 01:39:51 -06:00 |
|