Commit Graph
524 Commits
Author SHA1 Message Date
Wei Zhou fdca8fdbaa [New Model] Hunyuan1.5 (#943) 2026-01-22 12:06:38 +00:00
William Lin 6c4cb78192 [misc] Allow manual override of Pipeline class through override_pipeline_cls_name (#945) 2026-01-22 12:06:38 +00:00
Loay Rashid 2b8c937abe [bugfix] Added VSA Padding logic (#944) 2026-01-22 12:06:37 +00:00
Kaiqin Kong bdbf327aa5 [feat] Add Matrix-Game 2.0 (#938) 2026-01-22 12:06:37 +00:00
RandNMR73 e332dbb857 more scripts 2026-01-22 11:51:12 +00:00
RandNMR73 e21848a655 add benchmarking script + script changes + fix distillation pipeline 2026-01-22 11:43:34 +00:00
RandNMR73 4cd1297078 a bunch of changes 2026-01-22 06:38:41 +00:00
RandNMR73 8d43721c86 5090 example 2026-01-13 09:39:55 +00:00
RandNMR73 71ecf4a481 fix qat_attn kwargs 2026-01-13 09:35:00 +00:00
RandNMR73 654cc4990a change block size to 128x128 2026-01-13 09:14:28 +00:00
RandNMR73 d76dfa0df3 add inference script with custom weights 2026-01-13 08:41:56 +00:00
RandNMR73 3adfb07465 try sage3 finetuning with aligned backward pass 2026-01-07 01:37:09 +00:00
RandNMR73 30eeec0411 try sage3 finetuning again 2026-01-05 23:55:01 +00:00
RandNMR73 dbd5bd8357 disable delta s 2025-12-26 05:50:03 +00:00
RandNMR73 388f6f1ab8 set per_block_mean=True and modify api 2025-12-26 05:49:09 +00:00
RandNMR73 6c3d8781b7 test sage3 inference with smoothing q but no delta s 2025-12-26 05:05:37 +00:00
RandNMR73 eb160a2e23 modify scripts + launch qat run 2025-12-25 09:30:27 +00:00
RandNMR73 a34a6df844 update training script 2025-12-25 06:33:30 +00:00
RandNMR73 ca3b3985fb 6 gpus 2025-12-25 03:35:15 +00:00
RandNMR73 efcb3c4058 8 gpus 2025-12-25 02:00:45 +00:00
RandNMR73 36cdddfa9a bigger batch size + no grad around wrapped_flash_attn 2025-12-25 01:36:17 +00:00
RandNMR73 56faaa37bd re-enable delta_s since inference is terrible without it 2025-12-25 00:09:36 +00:00
RandNMR73 d0e44170b2 disable delta_s 2025-12-24 23:55:11 +00:00
RandNMR73 f2eb855c2a change block size back to 64x64 2025-12-24 23:36:37 +00:00
RandNMR73 f6080f7cee add sageattn3 inference example 2025-12-24 22:59:02 +00:00
RandNMR73 8678798e58 add delta_s back 2025-12-24 22:58:10 +00:00
RandNMR73 346bbfaf6d revert block size to 128x128 2025-12-24 22:42:52 +00:00
RandNMR73 52480b2514 adjus quant kernel block size 2025-12-24 21:59:04 +00:00
RandNMR73 460df09e20 adjust sage3 block size to 64x64 2025-12-24 21:49:43 +00:00
RandNMR73 3641487374 print sageattn file 2025-12-24 20:16:07 +00:00
RandNMR73 8d68a4fd46 add SageAttn3 with QAT 2025-12-24 09:28:22 +00:00
RandNMR73 7afe836f28 5090 testing 2025-12-24 06:04:36 +00:00
RandNMR73 3b70702af9 fix masking + causal and non-causal logic in qat attn 2025-12-23 01:36:49 +00:00
RandNMR73 9bcc41164a checkpoint (qat attn in progress) 2025-12-23 01:36:46 +00:00
Matthew Noto d41912cd7f fix import 2025-12-23 01:34:18 +00:00
Matthew Noto b06c03845b qat attn in progress + refactor nvfp4 utils 2025-12-23 01:34:18 +00:00
Matthew Noto 6a7f08e73b fix DeepGEMM path 2025-12-23 01:34:18 +00:00
Matthew Noto fe9e94ed0c fix DeepGEMM path 2025-12-23 01:34:18 +00:00
Matthew Noto 2fa6fc102b add inference repo 2025-12-23 01:34:15 +00:00
Matthew Noto 9b125520f0 nvfp4 utils in progress 2025-12-23 01:31:21 +00:00
Matthew Noto ebdb160af9 checkpoint 2025-12-23 01:31:21 +00:00
Peiyuan Zhang b628b5fc7e save 2025-12-23 01:31:21 +00:00
Peiyuan Zhang 3a9e4d3b89 fake quant done 2025-12-23 01:31:21 +00:00
Matthew Noto c137c9f9c5 add real and fake quant precision tests 2025-12-23 01:31:21 +00:00
Peiyuan Zhang 18aebfadc7 update 2025-12-23 01:31:17 +00:00
Peiyuan Zhang 84ed3ceead 1005 morning 2025-12-23 01:30:18 +00:00
Peiyuan Zhang 130b46634a save 2025-12-23 01:30:16 +00:00
Peiyuan Zhang fa91001127 update 2025-12-23 01:28:09 +00:00
Peiyuan Zhang c47be5c795 update 2025-12-23 01:28:08 +00:00
Peiyuan Zhang 032016f7dd update 2025-12-23 01:28:08 +00:00