univ_full_eres2conformer_xl
flagship model for speaker verification and recognition
2 min read
The new univ_full_eres2conformer_xl model from the FlaxSpeaker library solves the task of voice identification and verification from audio recordings. It is built on the ERes2Conformer (XL) architecture with catp pooling (Attentive Temporal Pooling — a weighted averaging mechanism for temporal features in speech) and trained on a massive universal dataset of 12,193 speakers and 1.7 million clean utterances. The model outputs a compact 256-dimensional feature vector (embedding), which can be used to accurately determine whether a voice belongs to a specific person. The model is useful for developers of voice systems, biometric services, and audio analysis applications.
Key features
- High accuracy: low Equal Error Rate (EER) on the VoxCeleb1 and LibriSpeech benchmarks.
- Audio frontend: uses 80-dimensional mel-spectrograms with Voice Activity Detection (VAD) and Cepstral Mean and Variance Normalization (CMVN).
- Multi-corpus training: the training set includes VoxCeleb, CN-Celeb, and LibriSpeech with noise and speed perturbation augmentations.
- Efficiency: contains about 64.3 million parameters in inference mode and supports export to TFLite.
What you can do
- Speaker verification: compare two audio recordings to check if the same person is speaking.
- Embedding extraction: get a vector representation of a voice from a FLAC or WAV file for clustering or search.
- Biometric protection: apply the model in voice-based access control systems for mobile or server applications.
- Pipeline integration: use the
flaxspeakerlibrary in Python scripts for streaming or file audio processing.
Example
Code example for loading the model and verifying a voice via the Python API:
from flaxspeaker import load_pretrained
model = load_pretrained("wq2012/univ_full_eres2conformer_xl")
emb = model.extract_embedding("path/to/utterance.flac")
score = model.verify("path/to/enroll.flac", "path/to/test.flac")
print(f"Embedding shape: {emb.shape}, Verification score: {score:.4f}")
Read more
DetailsBenchmarks: VoxCeleb1-O EER 0.44%, LibriSpeech test-clean EER 0.52% (single-utterance mode).
Parameters: 64,376,300 inference parameters (encoder + scoring heads).
Training: 145,000 gradient descent steps with a batch size of 512, seed 42.
Requirements:
flaxspeaker >= 0.7.0 library, JAX/Flax support.









Comments