Difference between revisions of "Query by Tapping"
From MIREX Wiki
(Created page with '== Description == == Participation in previous years == {| border="1" cellpadding="5" cellspacing="0" |- style="background: yellow" | '''Year'''…') |
|||
| (One intermediate revision by the same user not shown) | |||
| Line 1: | Line 1: | ||
== Description == | == Description == | ||
| + | |||
| + | The main purpose of QBT (Query by Tapping) is to evaluate MIR system in retrieving ground-truth MIDI files by tapping the onset of music notes to the microphone. This task provides query files in wave format as well as the corresponding human-label onset time in symbolic format. For this year's QBT task, we have two corpora for evaluation: | ||
| + | |||
| + | * Roger Jang's [http://mirlab.org/dataSet/public/MIR-QBT.rar MIR-QBT]: This dataset contains both wav files (recorded via microphone) and onset files (human-labeled onset time). | ||
| + | * Show Hsiao's [http://mirlab.org/dataSet/public/QBT_symbolic.rar QBT_symbolic]: This dataset contains only onset files (obtained from the user's tapping on keyboard). | ||
| + | |||
| + | === Subtask 1: QBT with symbolic input === | ||
| + | * '''Test database''': About 150 ground-truth monophonic MIDI files in MIR-QBT. | ||
| + | * '''Query files''': About 800 text files of onset time to retrieve target MIDIs in MIR_QBT. These onset files can help participant concentrate on similarity matching instead of onset detection. All onset files cannot guarantee to have perfect detection result from original wav query files. | ||
| + | * '''Evaluation''': Return top 10 candidates for each query file. 1 point is scored for a hit in the top 10 and 0 is scored otherwise (Top-10 hit rate). | ||
| + | |||
| + | === Subtask 2: QBT with wave input === | ||
| + | * '''Test database''': About 150 ground-truth monophonic MIDI files in MIR-QBT. | ||
| + | * '''Query files''': About 800 wave files of tapping recordings to retrieve MIDIs in MIR-QBT. | ||
| + | * '''Evaluation''': Return top 10 candidates for each query file. 1 point is scored for a hit in the top 10 and 0 is scored otherwise (Top-10 hit rate). | ||
Latest revision as of 15:30, 4 June 2010
Contents
Description
The main purpose of QBT (Query by Tapping) is to evaluate MIR system in retrieving ground-truth MIDI files by tapping the onset of music notes to the microphone. This task provides query files in wave format as well as the corresponding human-label onset time in symbolic format. For this year's QBT task, we have two corpora for evaluation:
- Roger Jang's MIR-QBT: This dataset contains both wav files (recorded via microphone) and onset files (human-labeled onset time).
- Show Hsiao's QBT_symbolic: This dataset contains only onset files (obtained from the user's tapping on keyboard).
Subtask 1: QBT with symbolic input
- Test database: About 150 ground-truth monophonic MIDI files in MIR-QBT.
- Query files: About 800 text files of onset time to retrieve target MIDIs in MIR_QBT. These onset files can help participant concentrate on similarity matching instead of onset detection. All onset files cannot guarantee to have perfect detection result from original wav query files.
- Evaluation: Return top 10 candidates for each query file. 1 point is scored for a hit in the top 10 and 0 is scored otherwise (Top-10 hit rate).
Subtask 2: QBT with wave input
- Test database: About 150 ground-truth monophonic MIDI files in MIR-QBT.
- Query files: About 800 wave files of tapping recordings to retrieve MIDIs in MIR-QBT.
- Evaluation: Return top 10 candidates for each query file. 1 point is scored for a hit in the top 10 and 0 is scored otherwise (Top-10 hit rate).
Participation in previous years
| Year | Participating Algorithms | URL |
| 2009 | 3 | https://www.music-ir.org/mirex/wiki/2009:Query-by-Tapping_Results |
| 2008 | 5 | https://www.music-ir.org/mirex/wiki/2008:Query-by-Tapping_Results |
