Wei Zhou
|
fdca8fdbaa
|
[New Model] Hunyuan1.5 (#943)
|
2026-01-22 12:06:38 +00:00 |
|
William Lin
|
6c4cb78192
|
[misc] Allow manual override of Pipeline class through override_pipeline_cls_name (#945)
|
2026-01-22 12:06:38 +00:00 |
|
Loay Rashid
|
2b8c937abe
|
[bugfix] Added VSA Padding logic (#944)
|
2026-01-22 12:06:37 +00:00 |
|
Kaiqin Kong
|
bdbf327aa5
|
[feat] Add Matrix-Game 2.0 (#938)
|
2026-01-22 12:06:37 +00:00 |
|
RandNMR73
|
e332dbb857
|
more scripts
|
2026-01-22 11:51:12 +00:00 |
|
RandNMR73
|
e21848a655
|
add benchmarking script + script changes + fix distillation pipeline
|
2026-01-22 11:43:34 +00:00 |
|
RandNMR73
|
4cd1297078
|
a bunch of changes
|
2026-01-22 06:38:41 +00:00 |
|
RandNMR73
|
8d43721c86
|
5090 example
|
2026-01-13 09:39:55 +00:00 |
|
RandNMR73
|
71ecf4a481
|
fix qat_attn kwargs
|
2026-01-13 09:35:00 +00:00 |
|
RandNMR73
|
654cc4990a
|
change block size to 128x128
|
2026-01-13 09:14:28 +00:00 |
|
RandNMR73
|
d76dfa0df3
|
add inference script with custom weights
|
2026-01-13 08:41:56 +00:00 |
|
RandNMR73
|
3adfb07465
|
try sage3 finetuning with aligned backward pass
|
2026-01-07 01:37:09 +00:00 |
|
RandNMR73
|
30eeec0411
|
try sage3 finetuning again
|
2026-01-05 23:55:01 +00:00 |
|
RandNMR73
|
dbd5bd8357
|
disable delta s
|
2025-12-26 05:50:03 +00:00 |
|
RandNMR73
|
388f6f1ab8
|
set per_block_mean=True and modify api
|
2025-12-26 05:49:09 +00:00 |
|
RandNMR73
|
6c3d8781b7
|
test sage3 inference with smoothing q but no delta s
|
2025-12-26 05:05:37 +00:00 |
|
RandNMR73
|
eb160a2e23
|
modify scripts + launch qat run
|
2025-12-25 09:30:27 +00:00 |
|
RandNMR73
|
a34a6df844
|
update training script
|
2025-12-25 06:33:30 +00:00 |
|
RandNMR73
|
ca3b3985fb
|
6 gpus
|
2025-12-25 03:35:15 +00:00 |
|
RandNMR73
|
efcb3c4058
|
8 gpus
|
2025-12-25 02:00:45 +00:00 |
|
RandNMR73
|
36cdddfa9a
|
bigger batch size + no grad around wrapped_flash_attn
|
2025-12-25 01:36:17 +00:00 |
|
RandNMR73
|
56faaa37bd
|
re-enable delta_s since inference is terrible without it
|
2025-12-25 00:09:36 +00:00 |
|
RandNMR73
|
d0e44170b2
|
disable delta_s
|
2025-12-24 23:55:11 +00:00 |
|
RandNMR73
|
f2eb855c2a
|
change block size back to 64x64
|
2025-12-24 23:36:37 +00:00 |
|
RandNMR73
|
f6080f7cee
|
add sageattn3 inference example
|
2025-12-24 22:59:02 +00:00 |
|
RandNMR73
|
8678798e58
|
add delta_s back
|
2025-12-24 22:58:10 +00:00 |
|
RandNMR73
|
346bbfaf6d
|
revert block size to 128x128
|
2025-12-24 22:42:52 +00:00 |
|
RandNMR73
|
52480b2514
|
adjus quant kernel block size
|
2025-12-24 21:59:04 +00:00 |
|
RandNMR73
|
460df09e20
|
adjust sage3 block size to 64x64
|
2025-12-24 21:49:43 +00:00 |
|
RandNMR73
|
3641487374
|
print sageattn file
|
2025-12-24 20:16:07 +00:00 |
|
RandNMR73
|
8d68a4fd46
|
add SageAttn3 with QAT
|
2025-12-24 09:28:22 +00:00 |
|
RandNMR73
|
7afe836f28
|
5090 testing
|
2025-12-24 06:04:36 +00:00 |
|
RandNMR73
|
3b70702af9
|
fix masking + causal and non-causal logic in qat attn
|
2025-12-23 01:36:49 +00:00 |
|
RandNMR73
|
9bcc41164a
|
checkpoint (qat attn in progress)
|
2025-12-23 01:36:46 +00:00 |
|
Matthew Noto
|
d41912cd7f
|
fix import
|
2025-12-23 01:34:18 +00:00 |
|
Matthew Noto
|
b06c03845b
|
qat attn in progress + refactor nvfp4 utils
|
2025-12-23 01:34:18 +00:00 |
|
Matthew Noto
|
6a7f08e73b
|
fix DeepGEMM path
|
2025-12-23 01:34:18 +00:00 |
|
Matthew Noto
|
fe9e94ed0c
|
fix DeepGEMM path
|
2025-12-23 01:34:18 +00:00 |
|
Matthew Noto
|
2fa6fc102b
|
add inference repo
|
2025-12-23 01:34:15 +00:00 |
|
Matthew Noto
|
9b125520f0
|
nvfp4 utils in progress
|
2025-12-23 01:31:21 +00:00 |
|
Matthew Noto
|
ebdb160af9
|
checkpoint
|
2025-12-23 01:31:21 +00:00 |
|
Peiyuan Zhang
|
b628b5fc7e
|
save
|
2025-12-23 01:31:21 +00:00 |
|
Peiyuan Zhang
|
3a9e4d3b89
|
fake quant done
|
2025-12-23 01:31:21 +00:00 |
|
Matthew Noto
|
c137c9f9c5
|
add real and fake quant precision tests
|
2025-12-23 01:31:21 +00:00 |
|
Peiyuan Zhang
|
18aebfadc7
|
update
|
2025-12-23 01:31:17 +00:00 |
|
Peiyuan Zhang
|
84ed3ceead
|
1005 morning
|
2025-12-23 01:30:18 +00:00 |
|
Peiyuan Zhang
|
130b46634a
|
save
|
2025-12-23 01:30:16 +00:00 |
|
Peiyuan Zhang
|
fa91001127
|
update
|
2025-12-23 01:28:09 +00:00 |
|
Peiyuan Zhang
|
c47be5c795
|
update
|
2025-12-23 01:28:08 +00:00 |
|
Peiyuan Zhang
|
032016f7dd
|
update
|
2025-12-23 01:28:08 +00:00 |
|