Dettato evidence repairer
error correction for music-to-MIDI transcription
2 min readupdated
This model serves as the second stage of KobiMusic's Dettato multi-instrument audio-to-MIDI (digital sheet music format) transcription system. It takes notes detected by the base dettato transcriber along with its internal states (feature vectors) and fixes transcription errors—removing false positives, shifting note onsets and offsets, and restoring missed notes. Built on a compact 4.9M-parameter transformer, it processes audio in 8-second windows, analyzing each note as an individual token. It is well suited for musicians, arrangers, and developers building tools for automated music transcription.
Key features
- Internal feature awareness: alongside pitch, velocity, and duration, the model reads a 769-value vector containing onset/offset probabilities and hidden states from the base transcriber.
- Fine-grained timing adjustments: predicts note retention probability, shifts onsets in 5 ms steps within a ±0.5 s window, and refines note durations.
- Missed note recovery: evaluates two insertion slots per note, adding missed pitches at a probability of 0.6 or higher while filtering out duplicates within 30 ms.
- Lightweight architecture: 9 layers with a hidden dimension of 192 and 6 attention heads, using rotary position embeddings over onset time and pitch.
What you can do
- Clean up raw transcriptions: pair it with the base
dettatocheckpoint to strip out false positives and sharpen note endings in raw MIDI output. - Run the full Dettato pipeline: invoke it via the
dettatoCLI to automatically split audio into MIDI tracks, followed by instrument grouping (dettato-grouper) and drum separation (dettato-drums).
Example
from dettato.audio import load
from dettato.evidence import EvidenceRepairer
from dettato.transcriber import Transcriber
t = Transcriber.from_pretrained("cuda")
rep = EvidenceRepairer.from_pretrained("cuda")
notes, original, info = rep(t, load("song.mp3").at(16000))Read more
DetailsBenchmarks (9 datasets, including Slakh2100): overall composite score improved from 56.65 to 56.95 (+0.30; onset gain +0.38, offset gain +1.96, frame score -1.14 due to shortened sustained notes).
Limitations: handles pitched notes only without instrument assignments, requires the base
dettato checkpoint, and passes windows denser than 4,096 notes per 8 s unchanged.Training and license: trained on internal synthetic data with no benchmark leakage; released under the Apache-2.0 license.










Comments