- **New Official 8-bit Quantized Model**: VibeVoice-Large-Q8
- Released on HuggingFace: [FabioSarracino/VibeVoice-Large-Q8](https://huggingface.co/FabioSarracino/VibeVoice-Large-Q8)
- Model size: 11.6GB (38% reduction from 18.7GB full precision)
- VRAM usage: ~12GB (40% reduction from ~20GB)
- **Perfect audio quality**: Identical to full precision model - no quality degradation
- **Selective quantization approach**: audio-critical components (diffusion head, VAE, connectors) kept at full precision
- Optimized for 12GB VRAM GPUs (RTX 3060, 4070 Ti, etc.)
- Solves the common 8-bit "noise problem" by carefully selecting which components to quantize
- **Added 8-bit Dynamic LLM Quantization**
- New "8bit" option in `quantize_llm` parameter for both Single and Multiple Speaker nodes
- Options now: "full precision" (default), "4bit", "8bit"
- Dynamically quantizes only the LLM component for non-quantized models
- Skips all audio-critical components (diffusion_head, acoustic/semantic connectors, tokenizers)
- Provides good balance between quality and VRAM savings
- Requires CUDA GPU and bitsandbytes library
- Automatically ignored for pre-quantized models
Fabio Sarracino
2d29a48624