Chatterbox-Persian-TTS
Persian TTS without G2P
2 min readupdated
This model is a full fine-tune of the Chatterbox Multilingual architecture, trained on a large 417-hour Persian speech dataset. It takes raw Persian text directly as input, skipping phonetic segmentation and G2P (grapheme-to-phoneme) systems altogether. Built for developers and researchers, it delivers high-quality Persian text-to-speech alongside short-sample voice cloning.
Key features
- Full fine-tune of the base model on 417 hours of Persian speech (roughly 109,000 audio clips).
- Direct processing of raw Persian text without external G2P modules.
- Built-in voice cloning from a clean 5–10 second audio reference.
- Stable generation defaults using lower temperature to cut down on artifacts.
What you can do
- Generate natural Persian speech from text using the ready-to-run Google Colab notebook.
- Build a voice assistant or text-to-speech bot for Persian.
- Clone a speaker's vocal timbre from a short reference recording.
Example
import torch
from chatterbox.mtl_tts import ChatterboxMultilingualTTS, punc_norm
from safetensors.torch import load_file
model = ChatterboxMultilingualTTS.from_pretrained(device="cuda")
sd = load_file("t3_persian_v1.safetensors")
model.t3.load_state_dict(
{k[3:] if k.startswith("t3.") else k: v for k, v in sd.items()},
strict=False,
)
model.t3.to("cuda").eval()
wav = model.generate(
punc_norm("سلام، امروز هوا خوب است."),
language_id=None,
audio_prompt_path="ref.wav",
temperature=0.6,
repetition_penalty=1.5,
)
Read more
DetailsBenchmarks (CER): 0.01–0.09 on natural text, and 0.038–0.062 on harder tests containing punctuation and numbers.
Output sample rate: 16 kHz.
License: MIT.
Limitations: Occasional hallucinations and repetitions can occur, requiring a re-run.










Comments