Splitwave models
separate songs into vocals and instrumentals right in your browser
2 min readupdated
A collection of optimized ONNX models for splitting audio tracks into vocals, instrumentals, lead vocals, and backing vocals locally on the user's machine via WebGPU or WebAssembly. The repository includes four proven models from UVR, viperx, and aufr33: heavyweight, high-accuracy BS-RoFormer and Mel-Band RoFormer in fp16, alongside fast UVR-MDX-NET models in their original fp32 precision. The main difference from the original checkpoints is adapting the RoFormer architecture to work within WebGPU limits without losing computational accuracy, allowing them to run without a heavy backend. This release is useful for web audio app developers, karaoke services, and musicians.
Key features
- WebGPU and WebAssembly ready: frequency band splitting in RoFormer is restructured to fit browser rendering limits while preserving the original math.
- Two modes for different tasks: RoFormer models deliver maximum separation quality, while lightweight MDX-Net models prioritize fast processing.
- Mixed precision (fp16/fp32): RoFormer weights are converted to fp16 for a smaller footprint, while normalization layers and positional tables remain in fp32 to maintain quality.
- Integrity verification: includes a
manifest.jsonfile with file sizes and SHA-256 hashes to verify downloaded weights inside your app.
What you can do
- Embed into a web service: launch an online tool for creating backing tracks or extracting acapellas where all processing runs client-side with zero server GPU costs.
- Build browser-based karaoke: chain vocal separation and lead-vocal removal models (
mel_roformer_karaoke_fp16.onnxormdx_kara_2.onnx) to isolate backing vocals only. - Offer quality presets: let users toggle between a fast preview using MDX-Net and a high-quality final render with BS-RoFormer.
Example
The RoFormer models take an 8-second stereo STFT spectrogram chunk of shape [1, 2050, 801, 2] (with n_fft 2048 and hop 441) and output a complex mask, which is multiplied by the original spectrum before running the inverse STFT in your application.
Read more
DetailsSeparation quality: BS-RoFormer (ep 317) achieves an SDR of 12.98, and Mel-Band RoFormer karaoke scores an SDR of 10.20.
Included models:
bs_roformer_fp16.onnx and mel_roformer_karaoke_fp16.onnx (fp16), mdx_voc_ft.onnx and mdx_kara_2.onnx (fp32).Licensing: distributed under the original authors' terms (Ultimate Vocal Remover team, viperx, and aufr33).










Comments