alexzms b867ef7e7c [SP Sharding] Fix SP loss sharding on token axis (thw) with padding; add distributed correctness tests (#1045) ...

Fixes the sequence parallel sharding on t, now SP shards on t*h*w

2026-01-27 22:53:04 -08:00

..

test_hsdp_sp_mismatch_sp2_hsdp_shard4.py

[SP Sharding] Fix SP loss sharding on token axis (thw) with padding; add distributed correctness tests (#1045)

2026-01-27 22:53:04 -08:00

test_hsdp_sp_mismatch_sp4_hsdp_shard2.py

[SP Sharding] Fix SP loss sharding on token axis (thw) with padding; add distributed correctness tests (#1045)

2026-01-27 22:53:04 -08:00

test_sp_shard_latents_and_loss.py

[SP Sharding] Fix SP loss sharding on token axis (thw) with padding; add distributed correctness tests (#1045)

2026-01-27 22:53:04 -08:00