ComfyUI-TangoFlux

ComfyUI Custom Nodes for "TangoFlux: Super Fast and Faithful Text to Audio Generation with Flow Matching". These nodes, adapted from the official implementations, generates high-quality 44.1kHz audio up to 30 seconds using just a text promptproduction.

Installation

1. Navigate to your ComfyUI's custom_nodes directory:

cd ComfyUI/custom_nodes

2. Clone this repository:

git clone https://github.com/LucipherDev/ComfyUI-TangoFlux

3. Install requirements:

cd ComfyUI-TangoFlux
python install.py

Or Install via ComfyUI Manager

Check out some demos from the official demo page

Example Workflow

Usage

All the necessary models should be automatically downloaded when the TangoFluxLoader node is used for the first time.

Models can also be downloaded using the install.py script

Manual Download:

• Download TangoFlux from here and put everything in models/tangoflux (make sure to include the config files)
• Download text encoders from here and put everything in models/text_encoders/google-flan-t5-large (make sure to include the config files)

The nodes can be found in "TangoFlux" category as TangoFluxLoader, TangoFluxSampler, TangoFluxVAEDecodeAndPlay.

Citation

@misc{hung2024tangofluxsuperfastfaithful,
      title={TangoFlux: Super Fast and Faithful Text to Audio Generation with Flow Matching and Clap-Ranked Preference Optimization}, 
      author={Chia-Yu Hung and Navonil Majumder and Zhifeng Kong and Ambuj Mehrish and Rafael Valle and Bryan Catanzaro and Soujanya Poria},
      year={2024},
      eprint={2412.21037},
      archivePrefix={arXiv},
      primaryClass={cs.SD},
      url={https://arxiv.org/abs/2412.21037}, 
}