 lb203
|
429391840f
|
Merge pull request #121 from sysuyy/add_multi_node_script
[feat]: use accelerate on multi-node
Former-commit-id: 67b01dc1d934d3d86d7ecca00c5dd1a11fd4d22d
|
2024-03-12 14:05:08 +08:00 |
|
|
lb203
|
aa3ff1e9c3
|
Update README.md
Former-commit-id: c5eea8d3492872255a6a34d422230509d1c3531c
|
2024-03-12 13:35:03 +08:00 |
|
|
lb203
|
e0dac4fb40
|
Create train_256.sh
Former-commit-id: bf62151617feb49663f8dfe0c78aa01f41e62092
|
2024-03-12 12:55:41 +08:00 |
|
|
lb203
|
486218b252
|
Update README.md
Former-commit-id: 5717aab628fceba311e284d1bdddeacc4c43c7c5
|
2024-03-12 11:52:28 +08:00 |
|
|
lb203
|
21383acca7
|
Update README.md
Former-commit-id: dd00e04220ff5232c5c4503a095e409471476a51
|
2024-03-12 11:49:20 +08:00 |
|
|
lb203
|
e4949048e0
|
Update README.md
Former-commit-id: 266f9f97ea8f327fdefb2ca959c23d08b7084137
|
2024-03-12 11:47:12 +08:00 |
|
|
lb203
|
c39a13d6b0
|
Merge pull request #120 from touale/main
[fix]: correct attention_mode to attention-mode
Former-commit-id: 6deb9393f771edbf8db8a95e7b9f2107b2682c76
|
2024-03-12 11:00:50 +08:00 |
|
|
sysuyy
|
330e46e9e8
|
[feat]: use accelerate on multi-node
Former-commit-id: 0b12fc31f1d2a63f9da38821174ab63d9b3a2d72
|
2024-03-11 14:45:23 +00:00 |
|
|
touale
|
76e172e08c
|
[fix]: correct attention_mode to attention-mode
Former-commit-id: 9957e2eebb2166b02600c6052fb54908f5d12bad
|
2024-03-11 22:14:34 +08:00 |
|
|
lb203
|
2eba66af88
|
Update README.md
Former-commit-id: c2c64665d4f281e264d87c20cc1cfd38e7e5f168
|
2024-03-11 16:58:01 +08:00 |
|
|
lb203
|
d1c7015eaa
|
Update README.md
Former-commit-id: abb8ed57a29b1f66adec66d854429f36f9199540
|
2024-03-11 16:10:31 +08:00 |
|
|
LinB203
|
0e2a86b2ac
|
clean dit
Former-commit-id: 117ec4196a6f2cd83da223b993b14e28f7a693f8
|
2024-03-11 15:44:53 +08:00 |
|
|
lb203
|
523670a478
|
Merge pull request #117 from sennnnn/resolution_typo
Fix resolution typos
Former-commit-id: b9acfa97f5514513f6c983f3e815300b435d3076
|
2024-03-11 14:32:59 +08:00 |
|
|
sennnnn
|
1365640065
|
Fix resolution typos.
Former-commit-id: 3ad55d28eaf13f9c8fd23912d2691965737527e9
|
2024-03-11 14:26:05 +08:00 |
|
|
lb203
|
59e2407366
|
Merge pull request #97 from HowardLi1984/refiner
[feat]: Caption Refiner
Former-commit-id: 6af3b3689679a99acb741218416dc3a9cde29f45
|
2024-03-11 14:05:35 +08:00 |
|
|
lb203
|
14e217a698
|
Update README.md
Former-commit-id: 1f94f2721f35670aeae8dbfb7c0a5abd06cd2aee
|
2024-03-10 21:37:01 +08:00 |
|
|
lb203
|
d4aa360c50
|
Update README.md
Former-commit-id: 2808edf11005e04aa730971a786d1a4e3bca88b5
|
2024-03-10 21:16:15 +08:00 |
|
|
lb203
|
93b624e62d
|
Update README.md
Former-commit-id: 64d147863368aeef479ad25f2e5463fdcb76de46
|
2024-03-10 20:27:46 +08:00 |
|
|
lb203
|
f423fc7538
|
Update README.md
Former-commit-id: 6d41cfe906f97dbed1cea8c9ed06a1f6dc84308e
|
2024-03-10 20:25:48 +08:00 |
|
|
LinB203
|
a7165b506e
|
clean script
Former-commit-id: 02c61f63a8539a31516b92f5bb7c2d2e428ca7d7
|
2024-03-10 18:34:37 +08:00 |
|
|
lb203
|
740363460f
|
Update README.md
Former-commit-id: 7a62dec060c91b02ca556451266e6f3ef28e03e7
|
2024-03-10 18:27:50 +08:00 |
|
|
lb203
|
aeb3081341
|
Update pyproject.toml
Former-commit-id: 5c379b6e4515ad75b89cdebbc5cd490c9a821d78
|
2024-03-10 18:21:50 +08:00 |
|
|
lb203
|
fb62b8ff7e
|
Update README.md
Former-commit-id: 059d9e863958cfd679dbb8d365de6cd933e284fc
|
2024-03-10 18:20:28 +08:00 |
|
|
lb203
|
74494966bd
|
Update README.md
Former-commit-id: 87636c1dc2275c4da77c6368a0f4425bea15dc12
|
2024-03-10 18:15:21 +08:00 |
|
|
LinB203
|
b57709108a
|
train 1080p video
Former-commit-id: 74625142ef892f9e7fa459b2f98f2f7ae5b36d6a
|
2024-03-10 18:08:23 +08:00 |
|
|
lb203
|
1f4d4cbdfd
|
Merge pull request #112 from sennnnn/diffusion_deepspeed_fix
🐛 [BUG] Add base config for Latte
Former-commit-id: 825aa78ded6a5436d53d488b2c2250ac41b2bff9
|
2024-03-10 15:29:50 +08:00 |
|
|
sennnnn
|
995454b518
|
Add base config.
Former-commit-id: d37c551a0421d6b73dee26060b517c46d8217e4f
|
2024-03-10 15:24:40 +08:00 |
|
|
lb203
|
3d3ea0c818
|
Update README.md
Former-commit-id: 582070d4f97c4a4398dcb9a6699f4ab6e980c812
|
2024-03-10 15:17:18 +08:00 |
|
|
LinB203
|
6dae0b1c0c
|
deepspeed
Former-commit-id: 6179a4b0e7d06caed4201a27679abc64615febe6
|
2024-03-10 15:08:12 +08:00 |
|
|
lb203
|
557b062028
|
Merge pull request #110 from sennnnn/diffusion_deepspeed
⭐[Feature] Support deepspeed for latte training.
Former-commit-id: 59e731cb98915a2635547cad904ced7d9fcf73f4
|
2024-03-10 14:48:03 +08:00 |
|
|
sennnnn
|
28b7fc4bae
|
Fix typos.
Former-commit-id: c10330d373466f3c1ab455bfb391569b9175bc3a
|
2024-03-10 13:17:44 +08:00 |
|
|
sennnnn
|
61f9c5bced
|
Add some comments.
Former-commit-id: d5b5bd7743edde6a63dc74457bded0f8c56be1c2
|
2024-03-10 12:23:42 +08:00 |
|
|
sennnnn
|
f3274235d8
|
Support deepspeed zero2 and zero2_offload for latte training.
Former-commit-id: c87e95dd357e6fa6d6fb2dcfee781bc49c039e13
|
2024-03-10 11:27:33 +08:00 |
|
|
sennnnn
|
81c455e878
|
Refactor latte.
Former-commit-id: 7408fd0ee16247afc3d4ba43b8c8e7dfb1091a97
|
2024-03-10 11:25:56 +08:00 |
|
|
sennnnn
|
443bab1364
|
Refactor latte.
Former-commit-id: 304534269f105578097bc16ab497636ad59fd9b2
|
2024-03-10 11:25:50 +08:00 |
|
|
sennnnn
|
bfe4f15694
|
Fix mixed_precision bugs of latte.
Former-commit-id: d70a551972e04d95444d46cdbe2bfb16ad099fcb
|
2024-03-10 11:25:07 +08:00 |
|
|
sennnnn
|
ee3810a585
|
Decouple mixed_precision and gradient_accumulation to command args.
Former-commit-id: 903d473d1432eb492a87efe184d03439f643b92d
|
2024-03-10 11:24:39 +08:00 |
|
|
lb203
|
d6d54da131
|
typo
Former-commit-id: 9e87366e906ed19726c8905afb27b5df4d4e1512
|
2024-03-10 11:15:14 +08:00 |
|
|
LinB203
|
f034826c6d
|
fixed attn_mask in flash-attn
Former-commit-id: 5e2504f429a342b75bc7a9004cee7b3f75582ee3
|
2024-03-10 11:12:12 +08:00 |
|
|
lb203
|
74ee558f49
|
Merge pull request #107 from jpthu17/fix_2d_RoPE_init_bug
[fix] 2d RoPE init
Former-commit-id: e873ffa66f01268cce600f8da9ad297dc3e8aaaf
|
2024-03-10 10:21:43 +08:00 |
|
|
jpthu17
|
75938cfaeb
|
[fix] 2d RoPE init
Former-commit-id: ff5931bae6efa94675b9ef6bc25f1b76217d128e
|
2024-03-09 22:04:15 +08:00 |
|
|
LinB203
|
9a0d0bc843
|
safe dit
Former-commit-id: f407cab7dc0e53257972d430e873f4fd77bb039d
|
2024-03-09 21:53:43 +08:00 |
|
|
LinB203
|
5ebb382d85
|
xformers and flashattn
Former-commit-id: 002cad95253f7da36344237ce8c8410ffb517711
|
2024-03-09 21:52:03 +08:00 |
|
|
lb203
|
c08f985c8c
|
Update README.md
Former-commit-id: 6630c22baa2340a8b55badd61472daab7177bc63
|
2024-03-09 21:19:47 +08:00 |
|
|
lb203
|
c891f85022
|
Merge pull request #106 from jpthu17/add_2d_RoPE
[feat] Add 2D RoPE
Former-commit-id: 85c46fa0e728c9cfc5af4cf6523a7e6a64f96a93
|
2024-03-09 21:18:17 +08:00 |
|
|
lb203
|
ad54bd8f94
|
Merge pull request #105 from sennnnn/einops_bug
Fix einops bug: module 'keras.backend' has no attribute 'is_tensor'
Former-commit-id: c4f3a3a1172b68a4a34ddfac8ea69be34d11038b
|
2024-03-09 21:13:29 +08:00 |
|
|
jpthu17
|
aef95b043c
|
[feat] Add 2D RoPE
Former-commit-id: ccae80d339e34fb23706827565b5095ae2c2f320
|
2024-03-09 19:53:48 +08:00 |
|
|
sennnnn
|
29e167fecf
|
Fix einops bug: module 'keras.backend' has no attribute 'is_tensor'
Former-commit-id: 849f8ed815295bac78c3c10d319e6731aa26ca02
|
2024-03-09 18:18:26 +08:00 |
|
|
lb203
|
e415e25897
|
Update README.md
Former-commit-id: 513883df1ad853c9a5e7457c364227261df17a83
|
2024-03-09 17:13:18 +08:00 |
|
|
lb203
|
e2b563ab2d
|
Merge pull request #91 from RuslanPeresy/typecheck
[refactor] add static type checking
Former-commit-id: 969dfa6dedaeb64cf776d977b466b14568cc4b1c
|
2024-03-09 16:54:19 +08:00 |
|