M5-TTS.AXERA
accelerated text-to-speech and voice cloning on AX650 NPU
2 min read
The model is an optimized version of the compact M5-TTS-50M-VoiceClone model (50M parameters), adapted to run on hardware accelerators and boards featuring the AX650 NPU. The system handles zero-shot (without prior fine-tuning) text-to-speech synthesis and voice cloning across six languages (including Chinese and English) with streaming support. The output is a high-quality audio file or stream with minimal latency. The development targets embedded systems and edge AI, where high operating speeds on specialized hardware are required without the need for powerful GPUs.
Key features
- Hardware acceleration: Full execution on AX650 NPU chips (6 axmodel files, Pulsar2 8.0 quantization with U16/S8 and SmoothQuant).
- Voice cloning: Support for zero-shot speech generation from a short reference audio recording (up to 4.8 seconds).
- Multilingual support: Support for Chinese, English, German, French, Japanese, and Korean.
- Low latency: Streaming mode delivers the first audio chunk (TTFA) starting from 0.37 seconds in the C++ implementation.
What you can do
- Run on an AX650 board: Deploy a local voice assistant or auto-responder system on embedded hardware.
- Clone voices: Synthesize phrases in different languages using a short reference voice sample and precise transcript text.
- Use streaming mode: Integrate real-time speech generation with a minimal RTF (0.48–0.58).
- Build a C++ or Python app: Use ready-to-run scripts and SDKs to embed the model into your own projects.
Example
import sys; sys.path.insert(0, "python")
from m5_ax import M5AX, write_wav
tts = M5AX("models", "models/assets")
wav = tts.synthesize("你好,欢迎使用我们的语音合成模型。",
"samples/aslp_default_voice.wav",
"猪携带该疾病,然后通过蚊子传染给人类。")
write_wav("out.wav", wav, tts.sr)
print(tts.last_timing) # ttft / ttfa / rtfRead more
DetailsSupported platforms: AX650N (tested), other AX650 boards.
Performance: RTF 0.48–0.58 in C++ (for long phrases), offline and streaming modes.
Hardware requirements: AX650 board with AXEngine 2.12 SDK and Pulsar2 8.0.
License: Apache-2.0.










Comments