AksharaVP-17M
ultra-lightweight 17.6M-parameter TTS with voice cloning
2 min readupdated
AksharaVP-17M by sourojitdotcom is a compact TTS (text-to-speech) model that synthesizes Telugu, Hindi, and Indian English at a 24 kHz sample rate. Under the hood, it combines an 8-layer transformer (15M parameters), a 4-step flow-matching latent frame generator, and Kyutai's Mimi decoder (2.6M parameters) — all packed into a single checkpoint with no external vocoders or phonemizers. Compared to larger alternatives like Hima TTS nano and Meta MMS-TTS, its main advantage is its tiny footprint (35.3 MB in f16 GGUF) paired with zero-shot voice cloning (copying a speaker's timbre from a few seconds of audio without fine-tuning). It is a practical fit for mobile, local, and browser-based apps running without a GPU.
Key features
- Ultra-small footprint: just 17.6M parameters in the main checkpoint (plus 9.7M for the optional voice cloning encoder), making it one of the lightest multilingual TTS models available.
- Fast CPU inference: generates speech 2.6–2.9x faster than real time on a single standard CPU thread, and up to 5.5x faster on four threads.
- 12 voices and zero-shot cloning: ships with 12 built-in voices, and adding
clone_encoder.safetensorslets you clone any voice from an audio clip of up to 5 seconds, including cross-lingual transfer. - Runs right in the browser: ported to ONNX Runtime Web (WebAssembly) to run entirely client-side without sending audio to a server.
What you can do
- Embed offline voiceovers for notifications, articles, or navigation into mobile and desktop apps with tight memory budgets.
- Deploy a client-side voice interface directly on a web page via WebAssembly with zero server GPU costs.
- Personalize speech in bots or local assistants by cloning a target voice from a short, few-second reference clip.
Example
from aksharavp_tts import AksharaVP
tts = AksharaVP(".")Read more
DetailsBenchmarks (FLEURS dev, 100 utterances): CER (character error rate) is 6.04% on Telugu, 4.57% on Hindi, and 4.37% on Indian English.
UTMOS naturalness score (1–5 scale): 2.64 (te), 2.73 (hi), 3.19 (en) — speech is intelligible, though flatter than larger TTS models.
Hardware and formats: requires no GPU; available in safetensors, f32 GGUF (70.6 MB), and nearly bit-identical f16 GGUF (35.3 MB).
Limitations: supports only the three listed languages (Telugu, Hindi, English) and trails heavier models in intonation naturalness.










Comments