BobRandomNumber-ComfyUI-DiaTTS/README.md

ComfyUI Dia TTS Nodes

This node pack integrates the Nari-Labs Dia 1.6b text-to-speech model into ComfyUI using the safetensors file nari-labs provided.

Dia allows generating dialogue with speaker tags ([S1], [S2]) and non-verbal sounds ((laughs), etc.).

It requires a CUDA-enabled GPU.

Note: This version is specifically configured for the nari-labs/Dia-1.6B model architecture.

Installation

1. Ensure you have a CUDA-enabled GPU and the necessary NVIDIA drivers installed.
2. Download the Dia-1.6B model safetensors file from Hugging Face:
   • Direct Download URL: https://huggingface.co/nari-labs/Dia-1.6B/blob/main/model.safetensors
3. Place the downloaded .safetensors file into the diffusion_models directory (e.g., ComfyUI/models/diffusion_models/).
4. You might want to rename it to Dia-1.6B.safetensors for clarity.
5. Navigate to your ComfyUI/custom_nodes/ directory.
6. Clone this repository:

   git clone https://github.com/BobRandomNumber/ComfyUI-DiaTest.git
   

   Alternatively, download the ZIP and extract it into custom_nodes.
7. Install the required dependencies:
   • Activate ComfyUI's Python environment (e.g., source ./venv/bin/activate).
   • Navigate to the node directory: cd ComfyUI/custom_nodes/ComfyUI-DiaTest
   • Install requirements: pip install -r requirements.txt
8. Restart ComfyUI.

Nodes

Dia 1.6b Loader (DiaLoader)

Loads the Dia-1.6B TTS model from a local .safetensors file located in your diffusion_models directorie. Loads the model weights and the required DAC codec onto the GPU.

Inputs:

• ckpt_name: Dropdown list of found .safetensors files within your diffusion_models directorie. Select the file corresponding to the Dia-1.6B model.

Outputs:

• dia_model: A custom DIA_MODEL object containing the loaded Dia model instance, ready for the DiaGenerate node.

Dia TTS Generate (DiaGenerate)

Generates audio using a pre-loaded Dia model provided by the DiaLoader node. Displays a progress bar during generation.

Inputs:

• dia_model: The DIA_MODEL output from the DiaLoader node.
• text: The main text transcript to generate audio for. Use [S1], [S2] for speaker turns and parentheses for non-verbals like (laughs).
• max_tokens: Maximum number of audio tokens to generate (controls length).
• cfg_scale: Classifier-Free Guidance scale.
• temperature: Sampling temperature.
• top_p: Nucleus sampling probability.
• cfg_filter_top_k: Top-K filtering applied during CFG.
• speed_factor: Adjusts the speed of the generated audio (1.0 = original speed).
• seed: Random seed for reproducibility.

Outputs:

• audio: The generated audio (AUDIO format: {'waveform': tensor[B,C,T], 'sample_rate': sr}), ready to be saved or previewed. Sample rate is 44100 Hz.

Usage Example

1. Add the Dia 1.6b Loader node from the audio/DiaTest category.

2. Select your Dia model file (e.g., dia-1.6B.safetensors) from the ckpt_name dropdown.

3. Add the Dia TTS Generate node (also from audio/DiaTest).

4. Connect the dia_model output of the Loader node to the dia_model input of the Generate node.

5. Enter your dialogue script into the text input on the Generate node.

   Control speaker dialogue via [S1] and [S2] ect., tags.

   Add tags like (laughs), (clears throat), (sighs), (gasps), (coughs), (singing), (sings), (mumbles), (beep), (groans), (sniffs), (claps), (screams), (inhales), (exhales), (applause), (burps), (humming), (sneezes), (chuckle), (whistles)

   These verbal tags will be recognized, but may result in unexpected output.

6. Adjust generation parameters on the Generate node as needed.

7. Connect the audio output of the Generate node to a SaveAudio or PreviewAudio node.

8. Queue the prompt.

Notes

• This node pack requires a CUDA-enabled GPU.
• Only the .safetensors weights file is required.
• The first run of the nodes descript-audio-codec may take slightly longer. Subsequent runs will be faster.
• Dependencies descript-audio-codec must be installed via requirements.txt.