Update README.md

Former-commit-id: 9fd88eb8ac5122b0999ccb0071f195aaeb0979a0
This commit is contained in:
lb203
2024-03-06 20:30:57 +08:00
committed by GitHub
parent 193d7ef7a0
commit d3acf63c4e
+5 -5
View File
@@ -43,10 +43,10 @@ Project stages:
- [x] Support variable aspect ratios, resolutions, durations training on [DiT](https://github.com/facebookresearch/DiT).
- [x] Support Dynamic mask input inspired [FiT](https://github.com/whlzy/FiT).
- [x] Add class-conditioning on embeddings.
- [ ] Incorporating [Latte](https://github.com/Vchitect/Latte) as main codebase.
- [x] Incorporating [Latte](https://github.com/Vchitect/Latte) as main codebase.
- [x] Add VAE model, which is borrowed from [Stable Diffusion](https://github.com/CompVis/latent-diffusion).
- [x] Joint dynamic mask input with VAE.
- [ ] Make the codebase ready for the cluster training. Add SLURM scripts.
- [x] Make the codebase ready for the cluster training. Add SLURM scripts.
- [ ] Add sampling script.
- [ ] Incorporating [SiT](https://github.com/willisma/SiT).
@@ -66,8 +66,8 @@ Project stages:
- [ ] Looking for a suitable dataset, welcome to discuss and recommend.
- [ ] Finish data loading, pre-processing utils.
- [ ] Support memory friendly training.
- [ ] Add flash-attention2 from pytorch.
- [ ] Add xformers.
- [x] Add flash-attention2 from pytorch.
- [x] Add xformers.
- [ ] Add accelerate to automatically manage training, e.g. mixed precision training.
- [x] Add gradient checkpoint.
- [ ] Train using the deepspeed engine.
@@ -194,7 +194,7 @@ For more details, please refer to the [Contribution Guidelines](docs/Contributio
* [Positional Interpolation](https://arxiv.org/abs/2306.15595): Extending Context Window of Large Language Models via Positional Interpolation.
## License
* The service is a research preview intended for non-commercial use only. See [LICENSE.txt](LICENSE.txt) for details.
* The service is a research preview intended for non-commercial use only. See [LICENSE](LICENSE) for details.
## Contributors