Update README.md

Former-commit-id: 38e0e290e7a5909706c2cce2e4dd047647134fb8
This commit is contained in:
lb203
2024-03-09 11:49:17 +08:00
committed by GitHub
parent fa401d1d3f
commit a60217616e
+2 -2
View File
@@ -71,7 +71,7 @@ Project stages:
- [x] Joint dynamic mask input with VAE.
- [ ] Add VQVAE from [VQGAN](https://github.com/CompVis/taming-transformers). 🙏 **[Need your contribution]**
- [ ] Make the codebase ready for the cluster training. Add SLURM scripts. 🙏 **[Need your contribution]**
- [x] Refactor VideoGPT. 🤝 Thanks to [@qqingzheng](https://github.com/qqingzheng), [@luo3300612](https://github.com/luo3300612)
- [x] Refactor VideoGPT. 🤝 Thanks to [@qqingzheng](https://github.com/qqingzheng), [@luo3300612](https://github.com/luo3300612), [@sennnnn](https://github.com/sennnnn)
- [x] Add sampling script.
- [ ] Add DDP sampling script. ⌛ [WIP]
- [x] Incorporate [SiT](https://github.com/willisma/SiT). 🤝 Thanks to [@khan-yin](https://github.com/khan-yin)
@@ -103,7 +103,7 @@ Project stages:
- [ ] Finish data loading, and pre-processing utils. ⌛ [WIP]
- [ ] Support memory friendly training.
- [x] Add flash-attention2 from pytorch.
- [x] Add xformers.
- [x] Add xformers. 🤝 Thanks to [@jialin-zhao](https://github.com/jialin-zhao)
- [x] Support mixed precision training.
- [x] Add gradient checkpoint.
- [x] Support for ReBased and Ring attention. 🤝 Thanks to [@kabachuha](https://github.com/kabachuha)