 LinB203
|
b57709108a
|
train 1080p video
Former-commit-id: 74625142ef892f9e7fa459b2f98f2f7ae5b36d6a
|
2024-03-10 18:08:23 +08:00 |
|
|
lb203
|
1f4d4cbdfd
|
Merge pull request #112 from sennnnn/diffusion_deepspeed_fix
🐛 [BUG] Add base config for Latte
Former-commit-id: 825aa78ded6a5436d53d488b2c2250ac41b2bff9
|
2024-03-10 15:29:50 +08:00 |
|
|
sennnnn
|
995454b518
|
Add base config.
Former-commit-id: d37c551a0421d6b73dee26060b517c46d8217e4f
|
2024-03-10 15:24:40 +08:00 |
|
|
LinB203
|
6dae0b1c0c
|
deepspeed
Former-commit-id: 6179a4b0e7d06caed4201a27679abc64615febe6
|
2024-03-10 15:08:12 +08:00 |
|
|
lb203
|
557b062028
|
Merge pull request #110 from sennnnn/diffusion_deepspeed
⭐[Feature] Support deepspeed for latte training.
Former-commit-id: 59e731cb98915a2635547cad904ced7d9fcf73f4
|
2024-03-10 14:48:03 +08:00 |
|
|
sennnnn
|
28b7fc4bae
|
Fix typos.
Former-commit-id: c10330d373466f3c1ab455bfb391569b9175bc3a
|
2024-03-10 13:17:44 +08:00 |
|
|
sennnnn
|
61f9c5bced
|
Add some comments.
Former-commit-id: d5b5bd7743edde6a63dc74457bded0f8c56be1c2
|
2024-03-10 12:23:42 +08:00 |
|
|
sennnnn
|
81c455e878
|
Refactor latte.
Former-commit-id: 7408fd0ee16247afc3d4ba43b8c8e7dfb1091a97
|
2024-03-10 11:25:56 +08:00 |
|
|
sennnnn
|
443bab1364
|
Refactor latte.
Former-commit-id: 304534269f105578097bc16ab497636ad59fd9b2
|
2024-03-10 11:25:50 +08:00 |
|
|
sennnnn
|
bfe4f15694
|
Fix mixed_precision bugs of latte.
Former-commit-id: d70a551972e04d95444d46cdbe2bfb16ad099fcb
|
2024-03-10 11:25:07 +08:00 |
|
|
lb203
|
d6d54da131
|
typo
Former-commit-id: 9e87366e906ed19726c8905afb27b5df4d4e1512
|
2024-03-10 11:15:14 +08:00 |
|
|
LinB203
|
f034826c6d
|
fixed attn_mask in flash-attn
Former-commit-id: 5e2504f429a342b75bc7a9004cee7b3f75582ee3
|
2024-03-10 11:12:12 +08:00 |
|
|
jpthu17
|
75938cfaeb
|
[fix] 2d RoPE init
Former-commit-id: ff5931bae6efa94675b9ef6bc25f1b76217d128e
|
2024-03-09 22:04:15 +08:00 |
|
|
LinB203
|
9a0d0bc843
|
safe dit
Former-commit-id: f407cab7dc0e53257972d430e873f4fd77bb039d
|
2024-03-09 21:53:43 +08:00 |
|
|
LinB203
|
5ebb382d85
|
xformers and flashattn
Former-commit-id: 002cad95253f7da36344237ce8c8410ffb517711
|
2024-03-09 21:52:03 +08:00 |
|
|
jpthu17
|
aef95b043c
|
[feat] Add 2D RoPE
Former-commit-id: ccae80d339e34fb23706827565b5095ae2c2f320
|
2024-03-09 19:53:48 +08:00 |
|
|
LinB203
|
6df13b07bb
|
flash-attn train and sample
Former-commit-id: e336565bd5ff2aaf4d0b4ad5f42732e89cd216b3
|
2024-03-09 16:30:09 +08:00 |
|
|
chialin
|
cd2ffd7229
|
Update latte.py
revise the xformers inputs
Former-commit-id: 60db66c912192c3fbafe55ebe16157514b884e5b
|
2024-03-08 20:02:31 +08:00 |
|
|
LinB203
|
bc4e4f6fa6
|
del use_fp16
Former-commit-id: 5424c0112e04b56d1df30ac76cbc104e848406a3
|
2024-03-08 17:27:22 +08:00 |
|
|
Liu Hanchen
|
2448aa7c8c
|
commit
Former-commit-id: 81359cf67248b6c594ff79f121a8a38558c1cc70
|
2024-03-08 01:04:16 +08:00 |
|
|
LinB203
|
af49b2a9e9
|
init pos embed
Former-commit-id: 28f8076136ec214c66039ead7547c9b25cfe7bfc
|
2024-03-07 20:01:10 +08:00 |
|
|
LinB203
|
11996dc9b4
|
fixed dit forward
Former-commit-id: 4cd537fab12231f7471107762b02b36217ca42d8
|
2024-03-07 16:41:31 +08:00 |
|
|
LinB203
|
c521999f80
|
attn_mask with bf16
Former-commit-id: d9667a8c15a5344e3c777197fd6badec15dcddbd
|
2024-03-07 13:35:01 +08:00 |
|
|
khan-yin
|
94b71a5ea0
|
Merge remote-tracking branch 'upstream/main' into main
Former-commit-id: 7ef9b5e76a91b444f87955c3e0e7ea3d72315396
|
2024-03-07 04:05:06 +00:00 |
|
|
khan-yin
|
e90373b161
|
feat: Incorporating SiT sample
Former-commit-id: 91e2931e412f8c96ef748cb2322ee956309fb6aa
|
2024-03-07 03:40:24 +00:00 |
|
|
LinB203
|
cca84f1c6c
|
denorm fun
Former-commit-id: 05707a07b14295f5e1932d0c10bb84a20a0cd328
|
2024-03-07 10:40:06 +08:00 |
|
|
Kehan Yin
|
3f19169f55
|
Merge branch 'PKU-YuanGroup:main' into main
Former-commit-id: a2dea6886ce90634fb7d1c2e0fbfce95a500eefc
|
2024-03-07 10:04:08 +08:00 |
|
|
LinB203
|
1b99cf2789
|
add sample script
Former-commit-id: 9ce847651bb6dba28c51ce5807e222ae2902a78a
|
2024-03-06 23:23:17 +08:00 |
|
|
LinB203
|
193d7ef7a0
|
support latte training
Former-commit-id: d471a9414842f422d1200c2fd3f3ddfcf9e97fd6
|
2024-03-06 20:29:31 +08:00 |
|
|
khan-yin
|
e47f894f69
|
fix: rename sit model filename
Former-commit-id: f3b2cd7dcf644f680616eee0571db90478fede23
|
2024-03-06 12:08:04 +00:00 |
|
|
khan-yin
|
7cee5443e4
|
fix: remove replicated diffusion module in sit
Former-commit-id: 997cb049185421d303b14d59ab6c0603f1d1a66f
|
2024-03-06 12:06:55 +00:00 |
|
|
Kehan Yin
|
edfe14e9fa
|
Merge branch 'PKU-YuanGroup:main' into main
Former-commit-id: c7d4f9c2cfaa61e3babc711f13a095ed237978b1
|
2024-03-06 19:46:26 +08:00 |
|
|
LinB203
|
5a80da7ec1
|
add vae and fix bug in dit
Former-commit-id: 2dd4254c22ce671d5cd5e7d22a2386b7660fbdc4
|
2024-03-06 19:32:20 +08:00 |
|
|
khan-yin
|
54d3069702
|
[feat]: add sit model
Former-commit-id: 2eda854d6c25254b71d0105a3ed092953a9d6f68
|
2024-03-06 09:52:27 +00:00 |
|
|
kabachuha
|
abffb358f9
|
support for ring attention
Former-commit-id: 0533c73b99217e88da121bd0f68e0949bc88016e
|
2024-03-06 12:24:10 +03:00 |
|
|
kabachuha
|
e1459ff3d0
|
option to use rebased linear attention
Former-commit-id: f1b39b34df5fbdef14ef3f6a0e6d0972a8570445
|
2024-03-06 12:18:03 +03:00 |
|
|
LinB203
|
cf40ce1e7a
|
add latte
Former-commit-id: 01ba10e5d65c9d2d957472fbe7958e1b07a971e9
|
2024-03-06 15:28:20 +08:00 |
|