ComfyUI-FunAudioLLM

Comfyui custom node for FunAudioLLM include CosyVoice and SenseVoice

Features

CosyVoice

• CosyVoice Version: 2024-10-04
• Support SFT,Zero-shot,Cross-lingual,Instruct
• Support CosyVoice-300M-25Hz in zero-shot and cross-lingual
• Support SFT's 25Hz(unoffical)
• Save and load speaker model in zero-shot

  
  

SenseVoice

• SenseVoice Version: 2024-10-04
• Support SenseVoice-Small
• Support Punctuation segment (need turn off use_fast_mode)

  
  

How use

apt update
apt install ffmpeg

## in ComfyUI/custom_nodes
git clone https://github.com/SpenserCai/ComfyUI-FunAudioLLM
cd ComfyUI-FunAudioLLM
pip install -r requirements.txt

Windows

In windows need use conda to install pynini

conda install -c conda-forge pynini=2.1.6
pip install -r requirements.txt

MacOS

If meet error when you install

brew install openfst
export CPPFLAGS="-I/opt/homebrew/include"
export LDFLAGS="-L/opt/homebrew/lib"
pip install -r requirements.txt

If your network is unstable, you can pre-download the model from the following sources and place it in the appropriate directory.

• CosyVoice-300M -> ComfyUI/models/CosyVoice/CosyVoice-300M
• CosyVoice-300M-25Hz -> ComfyUI/models/CosyVoice/CosyVoice-300M-25Hz
• CosyVoice-300M-SFT -> ComfyUI/models/CosyVoice/CosyVoice-300M-SFT
• CosyVoice-300M-SFT-25Hz -> ComfyUI/models/CosyVoice/CosyVoice-300M-SFT-25Hz
• CosyVoice-300M-Instruct -> ComfyUI/models/CosyVoice/CosyVoice-300M-Instruct
• SenseVoiceSmall -> ComfyUI/models/SenseVoice/SenseVoiceSmall

WorkFlow