Peiyuan Zhang 85553c2717 + fp4 linear + fp4 attn, all with 16-bit bwd

2025-12-20 11:09:33 +00:00

..

lora

[bugfix] [lora] [CI] Fix LoRA alpha scaling factor & Fix LoRA Inference CI (#870)

2025-11-19 01:02:01 -08:00

quantization

[Feature] Remove V1 folder (#642)

2025-07-24 22:43:12 -07:00

__init__.py

[Feature] Remove V1 folder (#642)

2025-07-24 22:43:12 -07:00

activation.py

[Feature] Remove V1 folder (#642)

2025-07-24 22:43:12 -07:00

custom_op.py

[Feature] Remove V1 folder (#642)

2025-07-24 22:43:12 -07:00

fp4linear.py

+ fp4 linear + fp4 attn, all with 16-bit bwd

2025-12-20 11:09:33 +00:00

layernorm.py

[Feat] add ray support (#838)

2025-10-16 23:17:54 -07:00

linear.py

[Feature] Remove V1 folder (#642)

2025-07-24 22:43:12 -07:00

mlp.py

[Feature] Remove V1 folder (#642)

2025-07-24 22:43:12 -07:00

rotary_embedding.py

[feat] Support sequence packing and shard after pachification for USP (#894)

2025-12-19 16:19:46 -06:00

utils.py

[Feature] Remove V1 folder (#642)

2025-07-24 22:43:12 -07:00

visual_embedding.py

[Feature] Add Cosmos2 i2v pipeline (#837)

2025-10-30 20:03:57 -07:00

vocab_parallel_embedding.py

[Feature] Remove V1 folder (#642)

2025-07-24 22:43:12 -07:00