 LinB203
|
6df13b07bb
|
flash-attn train and sample
Former-commit-id: e336565bd5ff2aaf4d0b4ad5f42732e89cd216b3
|
2024-03-09 16:30:09 +08:00 |
|
|
LinB203
|
af49b2a9e9
|
init pos embed
Former-commit-id: 28f8076136ec214c66039ead7547c9b25cfe7bfc
|
2024-03-07 20:01:10 +08:00 |
|
|
LinB203
|
11996dc9b4
|
fixed dit forward
Former-commit-id: 4cd537fab12231f7471107762b02b36217ca42d8
|
2024-03-07 16:41:31 +08:00 |
|
|
LinB203
|
c521999f80
|
attn_mask with bf16
Former-commit-id: d9667a8c15a5344e3c777197fd6badec15dcddbd
|
2024-03-07 13:35:01 +08:00 |
|
|
LinB203
|
193d7ef7a0
|
support latte training
Former-commit-id: d471a9414842f422d1200c2fd3f3ddfcf9e97fd6
|
2024-03-06 20:29:31 +08:00 |
|
|
LinB203
|
5a80da7ec1
|
add vae and fix bug in dit
Former-commit-id: 2dd4254c22ce671d5cd5e7d22a2386b7660fbdc4
|
2024-03-06 19:32:20 +08:00 |
|
|
LinB203
|
cf40ce1e7a
|
add latte
Former-commit-id: 01ba10e5d65c9d2d957472fbe7958e1b07a971e9
|
2024-03-06 15:28:20 +08:00 |
|