StreamVoice speech models
compact speech recognition models for mobile devices
2 min readupdated
A collection of lightweight automatic speech recognition (ASR) models built on the NVIDIA FastConformer architecture (115 million parameters) for the StreamVoice Android app. Optimized for the ggml format and quantized to 5 bits (q5_0), they run efficiently on mobile hardware while preserving punctuation and capitalization. The repository includes separate model files for multiple languages, including Russian, English, and several other European languages. This release is aimed at mobile developers and hobbyists who need fast, offline audio transcription.
Key features
- Multilingual support: Includes separate files for Russian, Arabic, French, German, and other languages.
- ggml optimization: Original NeMo model weights are converted to ggml format with q5_0 quantization for mobile chips.
- Compact footprint: At 115M parameters, the models deliver high accuracy with minimal resource overhead.
- Punctuation restoration: Automatically adds punctuation and capitalization to transcriptions.
What you can do
- Integrate into Android apps: Load the model files into the StreamVoice mobile app or similar ggml-compatible ASR clients.
- Run offline transcription: Transcribe Russian voice notes and audio messages locally without sending data to the cloud.
- Benchmark performance: Test the inference speed of 5-bit quantized FastConformer models on mobile hardware.
Example
These models are designed for use inside the StreamVoice Android app rather than standard Hugging Face Python scripts. You work directly with prebuilt binary files using the .bin extension (for example, streamvoice-asr-ru-q5_0.bin for Russian).
Read more
Details• Base models: NVIDIA FastConformer Hybrid Large PC (CC-BY-4.0 license).
• Architecture: 115M parameters, converted from NeMo to ggml format using a TDT decoder.
• Quantization: 5-bit (q5_0); 4-bit quantization was skipped due to accuracy degradation.
• Limitations: No additional fine-tuning was performed; the files are tailored specifically for the app's mobile engine.










Comments