root
|
de3f7d8a9f
|
prepare release
|
2024-05-25 02:54:40 +00:00 |
|
LinB203
|
5e3a3c6f78
|
mask loss
|
2024-04-27 14:53:23 +08:00 |
|
LinB203
|
e767ef3a2e
|
update dataset
|
2024-04-22 11:10:56 +08:00 |
|
LinB203
|
e92a28ba49
|
fix rope with compress
|
2024-04-21 23:30:46 +08:00 |
|
root
|
8358b3014c
|
compress kv and rope pi
|
2024-04-21 11:44:26 +00:00 |
|
LinB203
|
3287e525c5
|
abs and rope
|
2024-04-17 15:45:54 +00:00 |
|
LinB203
|
c59023066e
|
vae temporal tiling
|
2024-04-16 16:49:43 +00:00 |
|
LinB203
|
f1086e192c
|
img training
|
2024-04-15 12:27:54 +00:00 |
|
LinB203
|
8a6db0b399
|
refactor dynamic training
|
2024-04-14 11:37:16 +00:00 |
|
LinB203
|
8fa3e614a1
|
add 2drope and dynamic training
|
2024-04-14 02:04:14 +00:00 |
|
LinB203
|
1f7edca9fd
|
clean
Former-commit-id: a7f2c1c8b2243587cedd6e152e64298842287095
|
2024-04-08 18:57:06 +08:00 |
|
LinB203
|
e202525517
|
sample pipeline
Former-commit-id: 8964b16c0dd65445a20050c9a0e82d909b55eaff
|
2024-04-04 10:50:29 +08:00 |
|
LinB203
|
8084949b14
|
released v1.0.0
Former-commit-id: 8df5897a4ffc341ced45faf617687fb8ebf1286c
|
2024-04-04 10:46:29 +08:00 |
|
lb203
|
a50abb7b49
|
Update __init__.py
Former-commit-id: 2bdc29d86ebff3d6f29c38ded57c7b0dd1e6bbdb
|
2024-03-28 22:04:27 +08:00 |
|
LinB203
|
c70648b740
|
update model
Former-commit-id: e4e24650376d9dce974b290752efb416d5061983
|
2024-03-28 19:10:24 +08:00 |
|
LinB203
|
6c12429fd2
|
train t2v feature
Former-commit-id: 7f16b162cae0e3533c8ba9aa03186a846d9e02bf
|
2024-03-25 16:25:01 +08:00 |
|
lb203
|
dfef484db5
|
t2v attention_mode
Former-commit-id: 4fd8bd87e0d0a98d5d0a3201d5db9a5ba055b894
|
2024-03-20 23:04:02 +08:00 |
|
LinB203
|
6b51d0ccfd
|
support attention_mode
Former-commit-id: c72f354fbfd948e8cd4b0cc63c157bc4688c7665
|
2024-03-20 22:23:24 +08:00 |
|
LinB203
|
ff36d291d8
|
train with image
Former-commit-id: 209b9a8ad2f19a50e46f9b7ec68dd781898e491a
|
2024-03-19 23:21:57 +08:00 |
|
LinB203
|
085062a53f
|
refactor and fix resume bug
Former-commit-id: 1b1136671b9a7e0b15b70168e2c44dbff04a22e2
|
2024-03-16 22:21:15 +08:00 |
|
LinB203
|
516082e06c
|
resume and compress kv
Former-commit-id: 0af7d58f88c1b65b4089da6f3e5c70456614da7c
|
2024-03-15 22:48:09 +08:00 |
|
LinB203
|
d2a8e64a83
|
del t2v
Former-commit-id: 5daa2952997a29e74e2b5d235001d6d9dabf9ff6
|
2024-03-15 18:43:44 +08:00 |
|
LinB203
|
99a789bd5d
|
del t2v
Former-commit-id: 910398ca297be8a188d59c59c121857666774af1
|
2024-03-14 08:51:10 +08:00 |
|
sennnnn
|
9750ead38b
|
Fix typos.
Former-commit-id: 6add5ee7ef39a973e91b7a7c1b3a4b0980130b88
|
2024-03-12 21:23:44 +08:00 |
|
sennnnn
|
66f085252e
|
merge main branch.
Former-commit-id: 5f78da5eae2b18305bb4a0a6dc7ab771e9b96f60
|
2024-03-12 21:11:56 +08:00 |
|
LinB203
|
0e2a86b2ac
|
clean dit
Former-commit-id: 117ec4196a6f2cd83da223b993b14e28f7a693f8
|
2024-03-11 15:44:53 +08:00 |
|
sennnnn
|
1321e1f977
|
refactor dit for supporting deepspeed.
Former-commit-id: e1909745cb05ea2f28f3a391c194f7656593a236
|
2024-03-11 11:51:46 +08:00 |
|
LinB203
|
b57709108a
|
train 1080p video
Former-commit-id: 74625142ef892f9e7fa459b2f98f2f7ae5b36d6a
|
2024-03-10 18:08:23 +08:00 |
|
lb203
|
1f4d4cbdfd
|
Merge pull request #112 from sennnnn/diffusion_deepspeed_fix
🐛 [BUG] Add base config for Latte
Former-commit-id: 825aa78ded6a5436d53d488b2c2250ac41b2bff9
|
2024-03-10 15:29:50 +08:00 |
|
sennnnn
|
995454b518
|
Add base config.
Former-commit-id: d37c551a0421d6b73dee26060b517c46d8217e4f
|
2024-03-10 15:24:40 +08:00 |
|
LinB203
|
6dae0b1c0c
|
deepspeed
Former-commit-id: 6179a4b0e7d06caed4201a27679abc64615febe6
|
2024-03-10 15:08:12 +08:00 |
|
lb203
|
557b062028
|
Merge pull request #110 from sennnnn/diffusion_deepspeed
⭐[Feature] Support deepspeed for latte training.
Former-commit-id: 59e731cb98915a2635547cad904ced7d9fcf73f4
|
2024-03-10 14:48:03 +08:00 |
|
sennnnn
|
28b7fc4bae
|
Fix typos.
Former-commit-id: c10330d373466f3c1ab455bfb391569b9175bc3a
|
2024-03-10 13:17:44 +08:00 |
|
sennnnn
|
61f9c5bced
|
Add some comments.
Former-commit-id: d5b5bd7743edde6a63dc74457bded0f8c56be1c2
|
2024-03-10 12:23:42 +08:00 |
|
sennnnn
|
81c455e878
|
Refactor latte.
Former-commit-id: 7408fd0ee16247afc3d4ba43b8c8e7dfb1091a97
|
2024-03-10 11:25:56 +08:00 |
|
sennnnn
|
443bab1364
|
Refactor latte.
Former-commit-id: 304534269f105578097bc16ab497636ad59fd9b2
|
2024-03-10 11:25:50 +08:00 |
|
sennnnn
|
bfe4f15694
|
Fix mixed_precision bugs of latte.
Former-commit-id: d70a551972e04d95444d46cdbe2bfb16ad099fcb
|
2024-03-10 11:25:07 +08:00 |
|
lb203
|
d6d54da131
|
typo
Former-commit-id: 9e87366e906ed19726c8905afb27b5df4d4e1512
|
2024-03-10 11:15:14 +08:00 |
|
LinB203
|
f034826c6d
|
fixed attn_mask in flash-attn
Former-commit-id: 5e2504f429a342b75bc7a9004cee7b3f75582ee3
|
2024-03-10 11:12:12 +08:00 |
|
jpthu17
|
75938cfaeb
|
[fix] 2d RoPE init
Former-commit-id: ff5931bae6efa94675b9ef6bc25f1b76217d128e
|
2024-03-09 22:04:15 +08:00 |
|
LinB203
|
9a0d0bc843
|
safe dit
Former-commit-id: f407cab7dc0e53257972d430e873f4fd77bb039d
|
2024-03-09 21:53:43 +08:00 |
|
LinB203
|
5ebb382d85
|
xformers and flashattn
Former-commit-id: 002cad95253f7da36344237ce8c8410ffb517711
|
2024-03-09 21:52:03 +08:00 |
|
jpthu17
|
aef95b043c
|
[feat] Add 2D RoPE
Former-commit-id: ccae80d339e34fb23706827565b5095ae2c2f320
|
2024-03-09 19:53:48 +08:00 |
|
LinB203
|
6df13b07bb
|
flash-attn train and sample
Former-commit-id: e336565bd5ff2aaf4d0b4ad5f42732e89cd216b3
|
2024-03-09 16:30:09 +08:00 |
|
chialin
|
cd2ffd7229
|
Update latte.py
revise the xformers inputs
Former-commit-id: 60db66c912192c3fbafe55ebe16157514b884e5b
|
2024-03-08 20:02:31 +08:00 |
|
LinB203
|
bc4e4f6fa6
|
del use_fp16
Former-commit-id: 5424c0112e04b56d1df30ac76cbc104e848406a3
|
2024-03-08 17:27:22 +08:00 |
|
Liu Hanchen
|
2448aa7c8c
|
commit
Former-commit-id: 81359cf67248b6c594ff79f121a8a38558c1cc70
|
2024-03-08 01:04:16 +08:00 |
|
LinB203
|
af49b2a9e9
|
init pos embed
Former-commit-id: 28f8076136ec214c66039ead7547c9b25cfe7bfc
|
2024-03-07 20:01:10 +08:00 |
|
LinB203
|
11996dc9b4
|
fixed dit forward
Former-commit-id: 4cd537fab12231f7471107762b02b36217ca42d8
|
2024-03-07 16:41:31 +08:00 |
|
LinB203
|
c521999f80
|
attn_mask with bf16
Former-commit-id: d9667a8c15a5344e3c777197fd6badec15dcddbd
|
2024-03-07 13:35:01 +08:00 |
|