diodiogod
89d12285b5
Implemented Step Audio EditX integration with the following components: Engine Implementation: - Bundled Step Audio EditX reference code in step_audio_editx_impl/ - Created engine wrapper (step_audio_editx.py) with clone/edit methods - Created adapter (step_audio_editx_adapter.py) for unified interface - Created processor (step_audio_editx_processor.py) for TTS Suite integration Model Management: - Created downloader (step_audio_editx_downloader.py) for: - Main Step-Audio-EditX model (3B LLM + CosyVoice vocoder) - Step-Audio-Tokenizer files (linguistic_tokenizer.npy, speech_tokenizer_v1.onnx) - FunASR-Paraformer model with correct config for bundled funasr_detach - Fixed FunASR config to use bundled class names (ParaformerStreaming, WavFrontendOnline, SpecAugLFR) - Added auto-download for all required models on first use - Updated unified_model_interface.py to auto-download Step-Audio-EditX components Node Configuration: - Created Step Audio EditX engine config node - Registered in nodes.py and unified TTS text node Known Issues: - LLM generation hangs during inference despite: - torch.no_grad() wrapper - torch.cuda.synchronize() - Eager attention mode (Step1ForCausalLM doesn't support SDPA) - Reduced max_new_tokens - Removed logits processor - Model loads successfully, all components initialized correctly - Issue appears to be with transformers.generate() call itself - Requires further investigation of Step1ForCausalLM compatibility Files Modified: - nodes.py: Added Step Audio EditX registration - requirements.txt: Added FunASR dependencies - utils/models/unified_model_interface.py: Added Step Audio EditX factory - Various Step Audio EditX implementation files Model Downloads: - Step-Audio-EditX: 7GB (3B LLM + vocoder) - FunASR-Paraformer: 881MB (from custom HF repo with fixed config) - Step-Audio-Tokenizer: Bundled with main model download
15 lines
536 B
Python
15 lines
536 B
Python
"""
|
|
Step Audio EditX Engine for TTS Audio Suite
|
|
|
|
A powerful 3B-parameter LLM-based audio model specialized in expressive audio editing.
|
|
Features zero-shot voice cloning and advanced emotion/style/speed editing capabilities.
|
|
"""
|
|
|
|
from .step_audio_editx import StepAudioEditXEngine
|
|
from .step_audio_editx_downloader import StepAudioEditXDownloader
|
|
|
|
# Expose bundled step_audio_editx_impl module for direct access
|
|
from . import step_audio_editx_impl
|
|
|
|
__all__ = ['StepAudioEditXEngine', 'StepAudioEditXDownloader', 'step_audio_editx_impl']
|