Speakilo / OneVoice On-Device Model Set
a local voice translator for Snapdragon 8 Gen 2
2 min readupdated
A ready-to-use set of models for offline (on-device) speech recognition, translation, and synthesis right on your smartphone with no cloud calls. Built by Vantuk for Qualcomm Snapdragon 8 Gen 2 (SM8550) mobile processors, the pipeline splits the workload between the NPU (Hexagon HTP v73 via QNN SDK) and the CPU (via Sherpa-ONNX and llama.cpp). Unlike standalone models, this bundle packs the entire voice processing loop for English, Korean, and Vietnamese into a single 1.877 GB archive. It is built for Android developers creating offline translators and voice assistants.
Key features
- Full 5-stage pipeline: spoken language identification (Spoken LID powered by
ecapa-lid), automatic speech recognition (ASR), source readiness check, machine translation, and text-to-speech (TTS). - Hybrid hardware execution: heavy stages like language ID and voice decoding are offloaded to the NPU (QNN HTP v73), while quantized ASR models and the LLM translator run on the CPU.
- Multilingual stack (EN, KO, VI): includes
SenseVoiceINT8 for English and Korean, streaming Korean ASR,gipformerINT8 for Vietnamese, and theHy-MT2-1.8B-Q4_0-enviko32ktranslation model. - Local voice synthesis: uses Piper family models (
piper-en-lessac,piper-ko-kss,piper-vi-vais1000) with eSpeak-NG support and CPU fallback.
What you can do
- Embed a real-time offline dialogue translator into an Android app for Snapdragon 8 Gen 2 devices.
- Reuse individual converted modules from the pack (such as QNN builds of Piper TTS or
ecapa-lid) to accelerate your own voice bots on a mobile NPU. - Benchmark
llama.cpp+ KleidiAI (with+dotprod+i8mminstructions) alongside Sherpa-ONNX on mobile ARM processors.
Example
A typical pipeline run from the model card: incoming audio first passes through ecapa-lid on the NPU to detect the language, gets transcribed via SenseVoice or gipformer on the CPU, is translated by the GGUF-formatted Hy-MT2-1.8B model, and is finally voiced in the target language by the hybrid Piper synthesizer.
Read more
DetailsTarget hardware: Qualcomm Hexagon HTP v73 (
soc_model = 43, htp_arch = 73, QNN SDK 2.51.0).Repository contents: 388 files totaling 1.877 GB.
Inference stack: QNN HTP v73, Sherpa-ONNX,
llama.cpp with KleidiAI optimizations (+dotprod+i8mm), and eSpeak-NG for phonemization.









Comments