Update README.md
Former-commit-id: 38e0e290e7a5909706c2cce2e4dd047647134fb8
This commit is contained in:
@@ -71,7 +71,7 @@ Project stages:
|
||||
- [x] Joint dynamic mask input with VAE.
|
||||
- [ ] Add VQVAE from [VQGAN](https://github.com/CompVis/taming-transformers). 🙏 **[Need your contribution]**
|
||||
- [ ] Make the codebase ready for the cluster training. Add SLURM scripts. 🙏 **[Need your contribution]**
|
||||
- [x] Refactor VideoGPT. 🤝 Thanks to [@qqingzheng](https://github.com/qqingzheng), [@luo3300612](https://github.com/luo3300612)
|
||||
- [x] Refactor VideoGPT. 🤝 Thanks to [@qqingzheng](https://github.com/qqingzheng), [@luo3300612](https://github.com/luo3300612), [@sennnnn](https://github.com/sennnnn)
|
||||
- [x] Add sampling script.
|
||||
- [ ] Add DDP sampling script. ⌛ [WIP]
|
||||
- [x] Incorporate [SiT](https://github.com/willisma/SiT). 🤝 Thanks to [@khan-yin](https://github.com/khan-yin)
|
||||
@@ -103,7 +103,7 @@ Project stages:
|
||||
- [ ] Finish data loading, and pre-processing utils. ⌛ [WIP]
|
||||
- [ ] Support memory friendly training.
|
||||
- [x] Add flash-attention2 from pytorch.
|
||||
- [x] Add xformers.
|
||||
- [x] Add xformers. 🤝 Thanks to [@jialin-zhao](https://github.com/jialin-zhao)
|
||||
- [x] Support mixed precision training.
|
||||
- [x] Add gradient checkpoint.
|
||||
- [x] Support for ReBased and Ring attention. 🤝 Thanks to [@kabachuha](https://github.com/kabachuha)
|
||||
|
||||
Reference in New Issue
Block a user