VieNeu-TTS v3 Turbo
Fast Speech Synthesis System
2 min readupdated
VieNeu-TTS v3 Turbo is the next generation of an open-source speech synthesis and voice cloning system built from scratch for Vietnamese. The model supports instant voice cloning from a short audio clip (3–8 seconds), stable real-time streaming with time-to-first-audio starting at 115 ms, and experimental non-verbal cues and emotions like laughter or sighs. It is optimized to run on both consumer GPUs (via PyTorch with batching) and standard CPUs via ONNX Runtime. This tool is well suited for voice assistant developers and content creators producing podcasts, audiobooks, and social media videos.
Key features
- 25 built-in voices — stable presets covering three major dialect regions with distinct vocal tones.
- Blazing speed — RTF around 0.02 in batch mode on an RTX 3060 GPU, supporting up to 16 parallel streams.
- Emotion tags — support for inline cues like [cười] (laughter) or [thở dài] (sigh) directly in the text.
- OpenAI-compatible API — a ready-to-use server for easy integration via standard SDKs and tools like LiveKit.
- LoRA support — fine-tune the model on your own voices and reading styles using included scripts.
What you can do
- Generate studio-grade voiceovers for podcasts, lectures, or videos using the built-in voice presets.
- Clone any voice from a short 3–8 second audio sample with automatic noise reduction.
- Deploy your own local speech server with streaming compatible with the OpenAI SDK.
- Fine-tune the model for a unique speaking style using the included LoRA scripts.
Example
from vieneu import Vieneu
vieneu = Vieneu()
audio = vieneu.infer("[cười] Xin chào các bạn, đây là tổng hợp giọng nói tự nhiên!", voice="Hải Đăng")
vieneu.save(audio, "output.wav")
Read more
Details• Sample rate: 48 kHz (high-fidelity audio)
• Performance: RTF ≈ 0.01–0.02 on GPU, RTF ≈ 0.5 on CPU
• Requirements: consumer GPU (recommended for maximum acceleration) or CPU
• Architecture: MOSS-Audio-Tokenizer-Nano codec and sea-g2p phonemizer










Comments