From a60217616e78639b1cd3b83087fd81a7f6ada89d Mon Sep 17 00:00:00 2001 From: lb203 <62638829+LinB203@users.noreply.github.com> Date: Sat, 9 Mar 2024 11:49:17 +0800 Subject: [PATCH] Update README.md Former-commit-id: 38e0e290e7a5909706c2cce2e4dd047647134fb8 --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index c5f79b73a..d7c6b37fc 100644 --- a/README.md +++ b/README.md @@ -71,7 +71,7 @@ Project stages: - [x] Joint dynamic mask input with VAE. - [ ] Add VQVAE from [VQGAN](https://github.com/CompVis/taming-transformers). 🙏 **[Need your contribution]** - [ ] Make the codebase ready for the cluster training. Add SLURM scripts. 🙏 **[Need your contribution]** -- [x] Refactor VideoGPT. 🤝 Thanks to [@qqingzheng](https://github.com/qqingzheng), [@luo3300612](https://github.com/luo3300612) +- [x] Refactor VideoGPT. 🤝 Thanks to [@qqingzheng](https://github.com/qqingzheng), [@luo3300612](https://github.com/luo3300612), [@sennnnn](https://github.com/sennnnn) - [x] Add sampling script. - [ ] Add DDP sampling script. ⌛ [WIP] - [x] Incorporate [SiT](https://github.com/willisma/SiT). 🤝 Thanks to [@khan-yin](https://github.com/khan-yin) @@ -103,7 +103,7 @@ Project stages: - [ ] Finish data loading, and pre-processing utils. ⌛ [WIP] - [ ] Support memory friendly training. - [x] Add flash-attention2 from pytorch. - - [x] Add xformers. + - [x] Add xformers. 🤝 Thanks to [@jialin-zhao](https://github.com/jialin-zhao) - [x] Support mixed precision training. - [x] Add gradient checkpoint. - [x] Support for ReBased and Ring attention. 🤝 Thanks to [@kabachuha](https://github.com/kabachuha)