diff --git a/README.md b/README.md index c5f79b73a..d7c6b37fc 100644 --- a/README.md +++ b/README.md @@ -71,7 +71,7 @@ Project stages: - [x] Joint dynamic mask input with VAE. - [ ] Add VQVAE from [VQGAN](https://github.com/CompVis/taming-transformers). 🙏 **[Need your contribution]** - [ ] Make the codebase ready for the cluster training. Add SLURM scripts. 🙏 **[Need your contribution]** -- [x] Refactor VideoGPT. 🤝 Thanks to [@qqingzheng](https://github.com/qqingzheng), [@luo3300612](https://github.com/luo3300612) +- [x] Refactor VideoGPT. 🤝 Thanks to [@qqingzheng](https://github.com/qqingzheng), [@luo3300612](https://github.com/luo3300612), [@sennnnn](https://github.com/sennnnn) - [x] Add sampling script. - [ ] Add DDP sampling script. ⌛ [WIP] - [x] Incorporate [SiT](https://github.com/willisma/SiT). 🤝 Thanks to [@khan-yin](https://github.com/khan-yin) @@ -103,7 +103,7 @@ Project stages: - [ ] Finish data loading, and pre-processing utils. ⌛ [WIP] - [ ] Support memory friendly training. - [x] Add flash-attention2 from pytorch. - - [x] Add xformers. + - [x] Add xformers. 🤝 Thanks to [@jialin-zhao](https://github.com/jialin-zhao) - [x] Support mixed precision training. - [x] Add gradient checkpoint. - [x] Support for ReBased and Ring attention. 🤝 Thanks to [@kabachuha](https://github.com/kabachuha)