Haru-4B
Multilingual full-duplex voice dialogue model
2 min readupdated
Haru-4B is a low-latency pretrained base model designed for continuous full-duplex live conversation, enabling it to listen and speak simultaneously like a phone call. Built on a Qwen3.5-4B text backbone with approximately 5.27 billion parameters, it supports nine languages, including Russian. It is ideal for researchers and developers building real-time interactive voice assistants, bots, and applications.
Key features
- Native full-duplex at 7.5 Hz. Every 133 ms, the model receives an audio frame from the user and generates its own audio and text frame without mutual waiting.
- Continuous audio in a single sampling step. Audio is represented as a 64-dimensional latent vector per frame, generated by a small MLP (multilayer perceptron, a feedforward neural network) head with MeanFlow sampling.
- Character and voice control. A text prompt defines the character's persona, while a short reference audio clip determines the desired voice.
- Multilingual support. Full support for English, Spanish, Portuguese, German, French, Chinese, Japanese, Russian, and Korean.
What you can do
- Launch a local web server. Set up a demo on an NVIDIA GPU using the official PyTorch repository for real-time conversation with the model.
- Build a macOS app. Use the MLX implementation for native performance on Apple Silicon Macs.
- Integrate into server solutions. Configure a service plugin using vLLM-Omni for rapid deployment.
- Clone voices. Assign a custom voice to the model using a clean reference audio clip ranging from 3 seconds to 3 minutes in length.
Example
Running the server to converse with the model in the project repository:
git clone [https://github.com/higurashi-ai/Haru](https://github.com/higurashi-ai/Haru) && cd Haru
pip install -e ./haru
python -m haru.server --hf-repo higurashi-ai/Haru-4BRead more
DetailsBackbone: Qwen3.5-4B text model, 32 layers, hidden state size 2560
Audio: VibeVoice acoustic tokenizer (24 kHz, 3200 samples per latent)
Audio head: 4-layer MLP with MeanFlow (1 sampling step)
Requirements: NVIDIA GPU with approximately 12 GB VRAM
License: Apache License 2.0










Comments