2006:Audio Cover Song Identification Results

From MIREX Wiki
Revision as of 18:06, 25 September 2006 by Admin (talk | contribs) (Friedman Test Multiple Comparisons Results (p=0.05))

Introduction

These are the results for the 2006 running of the Audio Cover Song Identification task. For background information about this task set please refer to the Audio Cover Song page.

General Legend

Team ID

CS = Christian Sailer (1)
DE = Dan Ellis (1)
KL1 = Kyogu Lee 1 (1)
KL2 = Kyogu Lee 2 (1)
KWL = Kris West (Likely) (2)
KWT = Kris West (Trans) (2)
LR = Thomas Lidy and Andreas Rauber (2)
TP = Tim Pohle (2)

(1) Denotes submissions specifically designed to detect cover song variants.
(2) Denotes submissions not-specifically designed to detect cover song variants (See Audio Music Similarity and Retrieval Results).

Calculating Summary Measures

MRR = Mean Reciprocal Rank. Reciprocal rank is the reciprocal of the rank of the first correctly identified cover for each query (1/rank). These values are averaged for each cover song group as well as overall.

Overall Summary Results

file /nema-raid/www/mirex/results/coversong_overall.csv not found

Friedman Test with Multiple Comparisons Results (p=0.05)

file /nema-raid/www/mirex/results/cover_song_sum_friedman.csv not found file /nema-raid/www/mirex/results/audiocover_friedman_mrr.csv not found

Mean Reciprocal Rank (MRR) Results

file /nema-raid/www/mirex/results/coversong_mrr.csv not found

Raw Results

The total number of correctly identified covers for each query, and the maximum number of covers identified for each cover song group. file /nema-raid/www/mirex/results/coversong_results.csv not found