Hilbert-LoRA-V3
a voice adapter for OmniVoice
1 min readupdated
This adapter (a lightweight add-on for a base model) brings the voice of sardonic podcast commentator Hilbert to the OmniVoice speech generator. Trained on podcast lines using LoRA (a weight fine-tuning method), it lets you synthesize English speech with his signature delivery without needing a reference audio clip—ideal for custom audio content and character voiceovers.
Key features
- Built on the OmniVoice model and uses the peft library.
- Trained on a dataset of 450 episodes featuring the character's actual lines.
- Uses resemble-enhance processing to restore high frequencies.
What you can do
- Generate English voice lines in his signature cynical style.
- Integrate the adapter into text-to-speech pipelines for creative and podcast projects.
Example
import torch
from omnivoice import OmniVoice
from omnivoice.utils.lora import load_lora_adapter
model = OmniVoice.from_pretrained("k2-fsa/OmniVoice", device_map="cuda:0", dtype=torch.float16)
model = load_lora_adapter(model, "")
audio = model.generate(text="I've read the press release so you don't have to.", language="English",
num_step=32, guidance_scale=2.0, denoise=True, postprocess_output=True)[0]
Read more
DetailsTraining parameters: r 32, alpha 64, lr 1e-4, 1200 steps on an L40S GPU.
License: CC-BY-NC-4.0 (non-commercial use only).
Base model: OmniVoice (k2-fsa/OmniVoice).










Comments