fiato
a tiny speech synthesizer that can sigh
2 min readupdated
A compact English TTS (text-to-speech) model weighing in at just 4.5M parameters — 727 times smaller than its teacher model, Maya-1. It generates 24 kHz mono audio in two voices — female (F1) and male (M1) — and supports inline emotion tags right inside the text. Instead of a heavy neural vocoder, the model uses a lightweight classical synthesizer, generating audio 150 times faster than real time on a standard laptop CPU. Ideal for developers building local offline apps, games, and web services that need instant voiceovers without a GPU or the cloud.
Key features
- Supports three expressive inline reactions right in the text: a sigh (
), an exhale (), and a sharp gasp of surprise (). - Built on the tiny-voca architecture: combines a transformer encoder with a source-filter synthesizer (a classic pulse-and-noise generator passed through an acoustic filter) instead of a neural vocoder.
- Ships with a ready-to-use ONNX Runtime build and runs locally right inside a browser tab without sending any text to a server.
- Offers flexible controls for speech rate, pitch shift, and intonation pitch range.
What you can do
- Embed it into a browser web app or extension for instant, fully client-side English text-to-speech.
- Voice NPC dialogue in indie games or visual novels on local hardware, adding
andtags for natural delivery. - Run it as an ultra-fast offline speech synthesizer for voice assistants on GPU-less devices.
Example
python -m fiato.infer \
--checkpoint fiato-model/fiato.pt \
--voice F1 \
--text "Well, I guess we should start over." \
--output hello.wav
Read more
DetailsTrained via distillation on 23.7 hours of synthetic speech generated by Maya-1 (104,000 steps on a single Nvidia L40S, total budget just $18.27).
WER (word error rate measured with Whisper small.en): 0.0% on validation, 0.6% on test, and 1.0% on unseen sentences.
Speed: ~150x real-time on 4 threads of an Apple M3 Max CPU.
Limitations: US English only, two fixed voices with no voice cloning, no streaming or laughter, and foreign names may be mispronounced. Licensed under Apache-2.0.










Comments