A custom node for ComfyUI that integrates VoxCPM, a novel tokenizer-free TTS system for context-aware speech generation and true-to-life voice cloning.

Report Bug · Request Feature

▷ About The Project

VoxCPM is a novel tokenizer-free Text-to-Speech system that redefines realism in speech synthesis by modeling speech in a continuous space. Built on the MiniCPM-4 backbone, it excels at generating highly expressive speech and performing accurate zero-shot voice cloning.

This custom node handles everything from model downloading and memory management to audio processing, allowing you to generate high-quality speech directly from a text script and optional reference audio files.

❖ VoxCPM2

Voice Design: Generate voices from natural language descriptions (e.g., "warm female voice", "deep male voice")
Controllable Voice Cloning: Clone voices with style control instructions
Ultimate Cloning: Combine reference audio (identity) with prompt audio (prosody) for most accurate reproduction
48kHz Audio: Higher fidelity output compared to v1.5
30 Languages: Multilingual support including English, Chinese, Japanese, Korean, and more
Reference Audio Mode: Clone voices without needing transcripts

❖ VoxCPM1.5

High-Fidelity Audio: Supports 44.1kHz sampling rate, preserving high-frequency details
LoRA Support: Load fine-tuned LoRA checkpoints to apply specific voice styles
Native LoRA Training: Train your own voice styles directly within ComfyUI
Context-Aware Expressive Speech: Model understands text context for appropriate prosody
True-to-Life Voice Cloning: Clone timbre, accent, and emotional tone from short samples
Zero-Shot TTS: Generate high-quality speech without any reference audio
Automatic Model Management: Models downloaded automatically and managed efficiently

(back to top)

▓ Getting Started

The easiest way to install is via ComfyUI Manager. Search for ComfyUI-VoxCPM and click "Install".

Alternatively, to install manually:

Clone the Repository: Navigate to your ComfyUI/custom_nodes/ directory and clone this repository:

git clone https://github.com/wildminder/ComfyUI-VoxCPM.git

Install Dependencies: Open a terminal or command prompt, navigate into the cloned ComfyUI-VoxCPM directory, and install the required Python packages:

cd ComfyUI-VoxCPM
pip install -r requirements.txt

Start/Restart ComfyUI: Launch ComfyUI. The VoxCPM nodes will appear under the audio/tts category. The first time you use a node, it will automatically download the selected model to your ComfyUI/models/tts/VoxCPM/ folder.

▓ Models

Model	Parameters	Sampling Rate	Languages	Description	Hugging Face Link
VoxCPM2	2B	48kHz	30+	New! Voice design, reference cloning, multilingual	openbmb/VoxCPM2
VoxCPM1.5	800M	44.1kHz	2	Recommended for v1. LoRA support, improved fidelity	openbmb/VoxCPM1.5
VoxCPM-0.5B	640M	16kHz	2	Original version	openbmb/VoxCPM-0.5B

(back to top)

▓ Available Nodes

Unified TTS Node

VoxCPM TTS - Single unified node supporting both VoxCPM1.5 and VoxCPM2 with all features:

Basic TTS synthesis (zero-shot)
Voice Design from natural language descriptions (VoxCPM2)
Voice Cloning from reference audio (VoxCPM2) or prompt audio + text
Ultimate Cloning combining reference + prompt audio (VoxCPM2)
LoRA support for custom voice styles

░ Training Nodes

VoxCPM Train Config - Configure LoRA training parameters
VoxCPM Dataset Maker - Create training datasets from audio files
VoxCPM LoRA Trainer - Train custom LoRA models

(back to top)

▓ Usage

Basic TTS (Zero-Shot)

Add the VoxCPM TTS node to your graph
Select a model (VoxCPM2 recommended)
Enter text in the text field
Generate!

Voice Cloning (VoxCPM1.5 style)

Add a Load Audio node with your reference audio
Connect to prompt_audio input
Provide the exact transcript in prompt_text
Generate!

Voice Design (VoxCPM2 only)

Use the VoxCPM TTS node with a VoxCPM2 model
Enter voice description in control_instruction: "warm female voice", "deep male voice with slight rasp"
Enter text to synthesize
Generate!

Reference Cloning (VoxCPM2 only)

Use the VoxCPM TTS node with a VoxCPM2 model
Connect reference audio to reference_audio (no transcript needed!)
Optionally add style instructions in control_instruction
Generate!

Ultimate Cloning (VoxCPM2 only)

For maximum fidelity, combine reference audio (identity) with prompt audio (prosody):

Use the VoxCPM TTS node with a VoxCPM2 model
Connect reference audio to reference_audio
Connect prompt audio to prompt_audio with transcript in prompt_text
Generate!

Note

Denoising: The original VoxCPM library includes a built-in denoiser (ZipEnhancer). This feature is disabled by default to keep dependencies light.

(back to top)

⚙️ Advanced Generation Parameters

All generation nodes expose advanced parameters for fine-tuning output quality:

Diffusion Parameters

Parameter	Default	Range	Description
`temperature`	1.0	0.1-2.0	Sampling temperature. Lower = more stable/consistent, Higher = more varied/expressive
`sway_sampling_coef`	1.0	0.0-2.0	Sway sampling coefficient. Affects sampling trajectory in diffusion
`use_cfg_zero_star`	True	-	CFG-Zero* optimization for better quality guidance
`cfg_value`	2.0	0.1-10.0	Guidance scale. Higher = more adherence to voice description/reference
`inference_timesteps`	10	1-100	Number of diffusion steps. More steps = higher quality but slower

VAD Parameters (VoxCPM2 only)

Voice Activity Detection parameters for trimming silence from reference/prompt audio:

Parameter	Default	Range	Description
`trim_silence`	False	-	Enable VAD-based silence trimming
`max_silence_ms`	200.0	0-1000	Maximum silence to keep at boundaries (ms)
`top_db`	35.0	10-60	Silence detection threshold (dB). Lower = more aggressive trimming

Tip

For noisy reference audio, enable trim_silence and reduce top_db (e.g., 25-30) for more aggressive silence removal.

(back to top)

LoRA Support (Inference & Training)

VoxCPM fully supports LoRA technology for fine-tuning voice styles. Works with both VoxCPM1.5 and VoxCPM2.

Inference

To use a pre-trained LoRA:

Place your .safetensors LoRA files in ComfyUI/models/loras/
Refresh the node, then select your file in the lora_name dropdown

Training

Train custom LoRA models directly within ComfyUI using the training nodes.

👉 Click here for the full LoRA Training Guide

(back to top)

🎤 Voice Design Examples (VoxCPM2)

The Voice Design feature allows you to create voices from natural language descriptions:

Description	Result
`warm female voice`	Soft, gentle female voice
`deep male voice`	Low-pitched male voice
`cheerful young girl`	Energetic, high-pitched voice
`professional announcer`	Clear, authoritative voice
`whispering voice`	Quiet, intimate speech

You can combine descriptions: "warm female voice with slight British accent"

(back to top)

🎤 Achieving High-Quality Voice Clones

For best voice cloning results with prompt_audio + prompt_text:

Provide a Verbatim Transcript - The prompt_text must be word-for-word match
Punctuation Matters - Use accurate punctuation for proper intonation
Audio Length - 5-15 seconds of continuous, clear speech works best

Warning

prompt_text is the exact transcript, not a description of the voice.

(back to top)

⚠️ Risks and Limitations

Potential for Misuse: Voice cloning could be misused for deepfakes. Users must not use it to infringe upon rights of individuals or for illegal purposes.
Technical Limitations: May exhibit instability with very long or complex inputs.
Language Support: VoxCPM1.5 is primarily Chinese and English. VoxCPM2 supports 30+ languages.
This node is released for research and development purposes. Please use it responsibly.

(back to top)

License

The VoxCPM model and its components are subject to the Apache-2.0 License provided by OpenBMB.

(back to top)

Acknowledgments

OpenBMB & ModelBest for creating and open-sourcing the incredible VoxCPM project.
The ComfyUI team for their powerful and extensible platform.

(back to top)

══════════════════════════════════