Difference between revisions of "2007:Audio Cover Song Identification Results"
(→Number of Correct Covers at Rank X Returned in Top Ten) |
|||
| Line 34: | Line 34: | ||
[[Image:2007 cover friedmans 1.png]] | [[Image:2007 cover friedmans 1.png]] | ||
| + | ==Individual Results Files== | ||
| + | ===Average Precision Scores for Each Query== | ||
| + | '''EC''' = [https://www.music-ir.org/mirex2007/results/cover.labrosa.eval.csv Daniel P. W. Ellis, Courtenay V. Cotton]<br /> | ||
| + | '''IM''' = [https://www.music-ir.org/mirex2007/results/cover.imirsel.eval.csv IMIRSEL M2K]<br/> | ||
| + | '''JB''' = [https://www.music-ir.org/mirex2007/results/cover.bello.eval.csv Juan Bello] <br/> | ||
| + | '''JEC''' = [https://www.music-ir.org/mirex2007/results/cover.jensen.eval.csv Jesper H├╕jvang Jensen, Daniel P. W. Ellis, Mads G. Christensen, S├╕ren Holdt]<br /> | ||
| + | '''KL1''' = [https://www.music-ir.org/mirex2007/results/cover.klee1.eval.csv Kyogu Lee 1]<br /> | ||
| + | '''KL2''' = [https://www.music-ir.org/mirex2007/results/cover.klee2.eval.csv Kyogu Lee 2]<br /> | ||
| + | '''KP''' = [https://www.music-ir.org/mirex2007/results/cover.metlab.eval.csv Youngmoo E. Kim, Daniel Perelstein] <br /> | ||
| + | '''SG''' = [https://www.music-ir.org/mirex2007/results/cover.serra.eval.csv Joan Serrà, Emilia Gómez]<br /> | ||
| + | |||
| + | ===Ranks of the Ten Cover Songs Returned for Each Query=== | ||
| + | |||
[[Category: Results]] | [[Category: Results]] | ||
Revision as of 18:11, 16 September 2007
This is a placeholder template
Contents
Introduction
These are the results for the 2007 running of the Audio Cover Song Identification task. For background information about this task set please refer to the Audio Cover Song Identification page.
Each system was given a collection of 1000 songs which included of 30 different classes (sets) of cover songs where each class/set was represented by 11 different versions of a particular song. Each of the 330 cover songs were used as queries and the systems were required to return 10 results for each query. Systems were evaluated on the number of the songs from the same class/set as the query that were returned in the list of 10 results for each query.
General Legend
Team ID
EC = Daniel P. W. Ellis, Courtenay V. Cotton
IM = IMIRSEL M2K
JB = Juan Bello
JEC = Jesper H├╕jvang Jensen, Daniel P. W. Ellis, Mads G. Christensen, S├╕ren Holdt
KL1 = Kyogu Lee 1
KL2 = Kyogu Lee 2
KP = Youngmoo E. Kim, Daniel Perelstein
SG = Joan Serrà, Emilia Gómez
Overall Summary Results
file /nema-raid/www/mirex/results/cover.overall.stats.csv not found Detailed Average Precision results, and rank lists can be found on the Audio Cover Song Identification Results - Details page
Number of Correct Covers at Rank X Returned in Top Ten
file /nema-raid/www/mirex/results/cover.rank.distributions.csv not found
The Friedman test was run in MATLAB against the Average Precision summary data over the 30 song groups.
Command: [c,m,h,gnames] = multcompare(stats, 'ctype', 'tukey-kramer','estimate', 'friedman', 'alpha', 0.05);
file /nema-raid/www/mirex/results/cover.friedmans.summary.csv not found
file /nema-raid/www/mirex/results/cover.friedmans.details.csv not found
Individual Results Files
=Average Precision Scores for Each Query
EC = Daniel P. W. Ellis, Courtenay V. Cotton
IM = IMIRSEL M2K
JB = Juan Bello
JEC = Jesper H├╕jvang Jensen, Daniel P. W. Ellis, Mads G. Christensen, S├╕ren Holdt
KL1 = Kyogu Lee 1
KL2 = Kyogu Lee 2
KP = Youngmoo E. Kim, Daniel Perelstein
SG = Joan Serrà, Emilia Gómez
