67 lines
3.3 KiB
Markdown
67 lines
3.3 KiB
Markdown
<div align="center">
|
|
|
|
# ComfyUI FLOAT
|
|
|
|
[](https://www.python.org/downloads/release/python-31012/)
|
|
[](https://arxiv.org/abs/2412.01064)
|
|
[](https://creativecommons.org/licenses/by-nc-sa/4.0/deed.en)
|
|
|
|
</div>
|
|
|
|
This project provides a ComfyUI wrapper of [FLOAT](https://github.com/deepbrainai-research/float) for Generative Motion Latent Flow Matching for Audio-driven Talking Portrait
|
|
|
|
<div align="center">
|
|
<video src="https://github.com/user-attachments/assets/36626b4a-d3e5-4db9-87a7-ca0e949daee0" />
|
|
</div>
|
|
|
|
|
|
## ⭐ Support
|
|
If you like my projects and wish to see updates and new features, please consider supporting me. It helps a lot!
|
|
|
|
[](https://github.com/yuvraj108c/ComfyUI-Depth-Anything-Tensorrt)
|
|
[](https://github.com/yuvraj108c/ComfyUI-Upscaler-Tensorrt)
|
|
[](https://github.com/yuvraj108c/ComfyUI-Dwpose-Tensorrt)
|
|
[](https://github.com/yuvraj108c/ComfyUI-Rife-Tensorrt)
|
|
|
|
[](https://github.com/yuvraj108c/ComfyUI-Whisper)
|
|
[](https://github.com/yuvraj108c/ComfyUI_InvSR)
|
|
[](https://github.com/yuvraj108c/ComfyUI-FLOAT)
|
|
[](https://github.com/yuvraj108c/ComfyUI-Thera)
|
|
[](https://github.com/yuvraj108c/ComfyUI-Video-Depth-Anything)
|
|
[](https://github.com/yuvraj108c/ComfyUI-PiperTTS)
|
|
|
|
[](https://www.buymeacoffee.com/yuvraj108cZ)
|
|
[](https://paypal.me/yuvraj108c)
|
|
---
|
|
|
|
## 🚀 Installation
|
|
|
|
```bash
|
|
git clone https://github.com/yuvraj108c/ComfyUI-FLOAT.git
|
|
cd ./ComfyUI-FLOAT
|
|
pip install -r requirements.txt
|
|
```
|
|
|
|
## ☀️ Usage
|
|
|
|
- Load [example workflow](float_workflow.json)
|
|
- Upload driving image and audio, click queue
|
|
- Models autodownload to `/ComfyUI/models/float`
|
|
|
|
## Citation
|
|
```bibtex
|
|
@article{ki2024float,
|
|
title={FLOAT: Generative Motion Latent Flow Matching for Audio-driven Talking Portrait},
|
|
author={Ki, Taekyung and Min, Dongchan and Chae, Gyeongsu},
|
|
journal={arXiv preprint arXiv:2412.01064},
|
|
year={2024}
|
|
}
|
|
```
|
|
|
|
## Acknowledgments
|
|
Thanks to [simplepod.ai](https://simplepod.ai/) for providing GPU servers
|
|
|
|
## License
|
|
|
|
[Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0)](https://creativecommons.org/licenses/by-nc-sa/4.0/)
|