 LinB203
|
6dae0b1c0c
|
deepspeed
Former-commit-id: 6179a4b0e7d06caed4201a27679abc64615febe6
|
2024-03-10 15:08:12 +08:00 |
|
|
lb203
|
d6d54da131
|
typo
Former-commit-id: 9e87366e906ed19726c8905afb27b5df4d4e1512
|
2024-03-10 11:15:14 +08:00 |
|
|
LinB203
|
f034826c6d
|
fixed attn_mask in flash-attn
Former-commit-id: 5e2504f429a342b75bc7a9004cee7b3f75582ee3
|
2024-03-10 11:12:12 +08:00 |
|
|
jpthu17
|
75938cfaeb
|
[fix] 2d RoPE init
Former-commit-id: ff5931bae6efa94675b9ef6bc25f1b76217d128e
|
2024-03-09 22:04:15 +08:00 |
|
|
LinB203
|
9a0d0bc843
|
safe dit
Former-commit-id: f407cab7dc0e53257972d430e873f4fd77bb039d
|
2024-03-09 21:53:43 +08:00 |
|
|
LinB203
|
5ebb382d85
|
xformers and flashattn
Former-commit-id: 002cad95253f7da36344237ce8c8410ffb517711
|
2024-03-09 21:52:03 +08:00 |
|
|
jpthu17
|
aef95b043c
|
[feat] Add 2D RoPE
Former-commit-id: ccae80d339e34fb23706827565b5095ae2c2f320
|
2024-03-09 19:53:48 +08:00 |
|
|
LinB203
|
6df13b07bb
|
flash-attn train and sample
Former-commit-id: e336565bd5ff2aaf4d0b4ad5f42732e89cd216b3
|
2024-03-09 16:30:09 +08:00 |
|
|
LinB203
|
af49b2a9e9
|
init pos embed
Former-commit-id: 28f8076136ec214c66039ead7547c9b25cfe7bfc
|
2024-03-07 20:01:10 +08:00 |
|
|
LinB203
|
11996dc9b4
|
fixed dit forward
Former-commit-id: 4cd537fab12231f7471107762b02b36217ca42d8
|
2024-03-07 16:41:31 +08:00 |
|
|
LinB203
|
c521999f80
|
attn_mask with bf16
Former-commit-id: d9667a8c15a5344e3c777197fd6badec15dcddbd
|
2024-03-07 13:35:01 +08:00 |
|
|
LinB203
|
193d7ef7a0
|
support latte training
Former-commit-id: d471a9414842f422d1200c2fd3f3ddfcf9e97fd6
|
2024-03-06 20:29:31 +08:00 |
|
|
LinB203
|
5a80da7ec1
|
add vae and fix bug in dit
Former-commit-id: 2dd4254c22ce671d5cd5e7d22a2386b7660fbdc4
|
2024-03-06 19:32:20 +08:00 |
|
|
LinB203
|
cf40ce1e7a
|
add latte
Former-commit-id: 01ba10e5d65c9d2d957472fbe7958e1b07a971e9
|
2024-03-06 15:28:20 +08:00 |
|