sava-telephony
fine-tune of the SAVA streaming model for telephone lines
2 min readupdated
The model is based on the SAVA architecture (25.5 million parameters, Mamba-2 and sliding-window attention) by Inworld and is optimized for low-quality audio over telephone lines. The original SAVA loses accuracy on telephony, so this fine-tune was trained on simulated telephone lines (8 kHz, codecs, and filtering). As a result, end-of-turn detection accuracy on a simulated landline increased from 89.5% to 93.0%, and on mobile (GSM) from 88.5% to 92.4%. The model is useful for developers of voice assistants, bots, and telephony systems who need fast real-time speech and pause detection.
Key features
- Fine-tune for telephony: significantly better than the original at recognizing speech and pauses through telephone communication channels and codecs.
- ONNX and quantization: PyTorch weights, standard ONNX, and an 8-bit quantized ONNX version of only 27 MB are available.
- High speed: a single 40 ms frame is processed on one CPU thread of an Apple M4 Max in 1.2–1.5 ms.
- Compatibility: fully retains the original streaming interface and architecture of the upstream model.
What you can do
- Integration into a voice bot: embed the model into a call processing pipeline to quickly determine when the interlocutor has finished speaking.
- Audio stream processing: connect inference via ONNX Runtime to handle real-time calls with upsampling to 16 kHz.
- Hardware optimization: use the 8-bit quantized version
sava-telephony-int8.onnxto reduce memory consumption on the server.
Example
import numpy as np
import onnxruntime as ort
session = ort.InferenceSession("sava-telephony-int8.onnx", providers=["CPUExecutionProvider"])
state = np.zeros((1, 798707), dtype=np.float32)
def step(frame: np.ndarray) -> tuple[float, float]:
global state
_, lookahead, turn, state = session.run(None, {"pcm": frame[None], "state": state})
sigmoid = lambda x: 1.0 / (1.0 + np.exp(-x))
return float(sigmoid(lookahead[0, 0])), float(sigmoid(turn[0, 0, 0]))
Read more
Details• Architecture: Mamba-2 and sliding-window attention, 25.5 million parameters.
• Accuracy (End-of-turn): wideband 93.5%, landline 93.0%, mobile 92.4%.
• Formats: safetensors (102 MB), ONNX (103 MB), INT8 ONNX (27 MB).
• Input data: 16 kHz mono float32 (8 kHz calls require prior upsampling).
• Limitations: improvement measured on simulated lines; testing on your own real calls is recommended.










Comments