chatty-tts-316m
Expressive speech synthesis with laughter and emotion support on a laptop
2 min read
The model is based on the 24-layer Pocket TTS architecture by Kyutai and fine-tuned for conversational English with the ability to add non-verbal tags to text. Its main feature is the ability to laugh in the right places via a command or change tone using special tokens. The model runs right on CPU hardware (for example, on a MacBook with an M2 chip faster than real-time) and consumes about 1.8 GB of memory. It is useful for bot developers and local voice synthesis enthusiasts who need lively dialogue without heavy GPUs.
Key features
- Support for tags like
to insert laughter at the beginning or end of a sentence. - Runs on a standard CPU, delivering speeds slightly above real-time on an Apple M2.
- 316 million parameters with a memory footprint of about 1.8 GB.
- Availability of stylistic tokens to set intonation (for example,
[amused]).
What you can do
- Voice lines for a local conversational assistant or chatbot with lively emotions and laughter.
- Test speech generation locally via Python scripts or a Colab environment.
- Experiment with sampling step settings and classifier-free guidance (CFG).
Example
uvx hf download mktj/chatty-tts-316m --local-dir chatty-tts && cd chatty-tts
uv sync
uv run generate.py "That's the funniest thing I've heard all week. " --out out.wav
Read more
DetailsBenchmarks: up to 3–4 successful laughter triggers out of 10 on standard settings.
Hardware: Apple M2 processor (16 GB), about 1.8 GB VRAM/RAM.
Limitations: English language only, sentence-by-sentence generation separately, non-commercial license (CC BY-NC-SA 4.0).
Training details: 2,000 steps on the Expresso and NonverbalTTS datasets with the addition of 27 new tokens.










Comments