Pocket TTS language deltas - multilingual delta packages for the speech synthesis engine
2 min readupdated
The repository contains language deltas (small weight changes relative to the base model) for the Kyutai Pocket TTS engine, used in the Frankenstein v2 engine of the mynah-s2s project. Each update is a delta for the English base model in two architectural variants (24-layer and 6-layer). The development makes it possible to adapt compact text-to-speech synthesis to different languages, including Russian, French, German, Spanish, and others. The set will be useful for developers of voice assistants and local speech recognition and generation systems.
Key features
- Support for multiple languages, including Russian, German, French, Japanese, and Turkish.
- Availability of variants with different quantization precision: int4, int8, and bf16.
- Support for two architectural model families: 24-layer (24l) and 6-layer (6l).
- Integration with the Frankenstein v2 engine of the mynah-s2s project.
What you can do
- Integrate language packages into Pocket TTS-based projects for voiceover in Russian or other languages.
- Adjust model precision and size to available resources using int4 or int8 formats.
- Test multilingual sessions using the base Kyutai Pocket TTS weights.
Example
An example of using the package structure and manifests is described in the documentation of the mynah-s2s repository and Frankenstein v2 engine, which connect JSON language files and weight deltas for the selected language.
Read more
DetailsModel size: from 67.1 MB (int4, 6l) to 660.4 MB (bf16, 24l)
Backend: Kyutai Pocket TTS (base model terms agreement required)
License: CC-BY-4.0, CC-BY-SA-4.0, or MIT depending on the package










Comments