2008:Query by Tapping

Overview

The main purpose of QBT(Query by Tapping) task is to evaluate MIR system in retrieval ground-truth MIDI files by the tapping rhythm. Prof. J-S Roger Jang has record 272 query rhythm files(15 seconds rhythm excerpts in mono WAV format) to retrieve a 6892 MIDI files collection. Evaluation database can be download soon.

Task description

Classic QBSH evaluation:

• Test database: 6892 ground-truth mono MIDI files.
• Quries: 272 query files to retrieve 105 known target drawn from 6892 collection. So far, 1~6 human assessors have listened and tapped query rhythm for each target songs.
• Evaluation: Mean Reciprocal rank. Return top 20 candidates for each query file.

Data processing proposal for calling formats

Indexing the MIDIs collection

Indexing_exe <var1> <var2>

where

<var1>==<directory_of_MIDIs> 
<var2>==<indexing_files_output_and_working_directory>

Running for the query files

Running_exe <var3> <var4><var5>

where

<var3>==<directory_of_indexed_file> 
<var4>==<directory_of_query_rhythm_files> 
<var5>==<answer_file_output_directory> 

Data processing for output answer file formats

The answer file for each run would look like:

Q001:0003,0567,0999,<insert X more responses>,XXXX
Q002:0103,0567,0998,<insert X more responses>,XXXX
Q00X:0002,0567,0999,<insert X more responses>,XXXX

Each line represents to each of the queries in a given task run.

Submission closing date

22th August 2008.

Interested Participants

• Shu-Jen Hsiao(show.cs95g at nctu.edu.tw)