2008:Real-time Audio to Score Alignment (a.k.a Score Following)
Contents
Title
Real-time Audio to Score Alignment, also known as Score Following
Description
Score Following is the real-time alignment of an incoming music signal to the music score. The music signal can be symbolic (MIDI) or audio, but we will concentrate here on audio following, unless there are some candidates who'd want their symbolic followers to be evaluated and can propose reference data.
This page describes a proposal for evaluation of score following systems. Discussion of the evaluation procedures on the Score Following contest planning list will be documented on the Score Following page. A full digest of the discussions is available to subscribers from the Score Following contest planning list archives.
Submissions will be required to estimate alignment precision according to the indexed times. In order for your system to participate, please specify the type of alignment (monophonic, polyphonic), type of training and realtime performance, also separated into two domains (upon enough submissions) for symbolic and audio systems. Note that we also do accept systems that don't run in real-time in practice, as soon as their algorithm is on-line, i.e. without making use of global knowledge of the input.
Evolution
This year's changes are proposed here and on the list, and are currently under discussion. Proposed changes are mainly about the score and reference file formats and the evaluation metrics:
- the proposed new score and reference file format is described here: Score File Format
- evaluation metrics will more closely reflect the different approaches and applications of score following
See the details of last year's proposal on the MIREX 2006 Wiki
Title
Real-time Audio to Score Alignment, also known as Score Following
Description
Score Following is the real-time alignment of an incoming music signal to the music score. The music signal can be symbolic (MIDI) or audio, but we will concentrate here on audio following, unless there are some candidates who'd want their symbolic followers to be evaluated and can propose reference data.
This page describes a proposal for evaluation of score following systems. Discussion of the evaluation procedures on the Score Following contest planning list will be documented on the Score Following page. A full digest of the discussions is available to subscribers from the Score Following contest planning list archives.
Submissions will be required to estimate alignment precision according to the indexed times. In order for your system to participate, please specify the type of alignment (monophonic, polyphonic), type of training and realtime performance, also separated into two domains (upon enough submissions) for symbolic and audio systems. Note that we also do accept systems that don't run in real-time in practice, as soon as their algorithm is on-line, i.e. without making use of global knowledge of the input.
Evolution
This year's changes are proposed here and on the list, and are currently under discussion. Proposed changes are mainly about the score and reference file formats and the evaluation metrics:
- the proposed new score and reference file format is described here: Score File Format
- evaluation metrics will more closely reflect the different approaches and applications of score following
See the details of last year's proposal on the MIREX 2006 Wiki
Evaluation procedures
Evaluation procedure consists of running score followers on a database of aligned audio to score where the database contains score, and performance audio (for system call) and a reference alignment (for evaluations) -- See below for details.
I/O Format
During evaluation, each system will be called in command line with probably something like the following format:
doScofo.sh "/path/to/audiofile.wav" "/path/to/midi_score_file.wav" "/path/to/result/filename.txt"
The stdout and stderr will be logged.
