Difference between revisions of "2009:Audio Cover Song Identification Results"

From MIREX Wiki
(→‎Team ID)
(→‎Results)
Line 30: Line 30:
  
 
===Mixed===
 
===Mixed===
 +
 +
'''Summary results'''
 +
<csv>/cover/coversong.mixed.summary.csv</csv>
 +
 +
'''Number of Correct Covers at Rank X Returned in Top Ten'''
 +
<csv>cover/coversong.toptendist.mixed.csv</csv>
  
 
===Mazurakas===
 
===Mazurakas===
 +
 +
'''Summary results'''
 +
<csv>/cover/coversong.mazurka.summary.csv</csv>
 +
 +
'''Number of Correct Covers at Rank X Returned in Top Ten'''
 +
<csv>cover/coversong.toptendist.mazurka.csv</csv>
 +
 +
===Run Times===
 +
 +
 +
===Friedman's Test for Significant Differences===
 +
The Friedman test was run in MATLAB against the Average Precision summary data over the 30 song groups.<br /> Command: [c,m,h,gnames] = multcompare(stats, 'ctype', 'tukey-kramer','estimate', 'friedman', 'alpha', 0.05);
 +
 +
<csv>cover/coversong.friedman.anova.csv</csv>
 +
 +
<csv>cover/coversong.friedman.csv</csv>
 +
 +
[[Image:coversong.friedman.png]]
 +
 +
===Average Performance per Query Group===
 +
These are the arithmetic means of the average precisions within each of the 30 query groups.
 +
 +
<csv>cover/cover.mapquerygroup.v2.csv</csv>
 +
 +
==Individual Results Files==
 +
 +
[[/results/cover/RE.mix.avgprec.txt]]
 +
[[/results/cover/RE.mix.ranklist.txt]]
 +
 +
[[/results/cover/SZA.mix.avgprec.txt]]
 +
[[/results/cover/SZA.mix.ranklist.txt]]
 +
 +
[[/results/cover/TA.mix.avgprec.txt]]
 +
[[/results/cover/TA.mix.ranklist.txt]]
 +
 +
 +
[[/results/cover/RE.maz.avgprec.txt]]
 +
[[/results/cover/RE.maz.ranklist.txt]]
 +
 +
[[/results/cover/SZA.maz.avgprec.txt]]
 +
[[/results/cover/SZA.maz.ranklist.txt]]
 +
 +
[[/results/cover/TA.maz.avgprec.txt]]
 +
[[/results/cover/TA.maz.ranklist.txt]]
 +
 +
 +
[[Category: Results]]

Revision as of 15:16, 9 October 2009

Introduction

General Legend

Team ID

ML1 Mathieu Lagrange

ML2 Mathieu Lagrange

RE1 Suman Ravuri

RE2 Suman Ravuri

SZA1 Joan Serr`a1,2, Massimiliano Zanin3, and Ralph G. Andrzejak2

SZA2 Joan Serr`a1,2, Massimiliano Zanin3, and Ralph G. Andrzejak2

TA1 Teppo E. Ahonen

TA2 Teppo E. Ahonen


Results

Mixed

Summary results file /nema-raid/www/mirex/results//cover/coversong.mixed.summary.csv not found

Number of Correct Covers at Rank X Returned in Top Ten file /nema-raid/www/mirex/results/cover/coversong.toptendist.mixed.csv not found

Mazurakas

Summary results file /nema-raid/www/mirex/results//cover/coversong.mazurka.summary.csv not found

Number of Correct Covers at Rank X Returned in Top Ten file /nema-raid/www/mirex/results/cover/coversong.toptendist.mazurka.csv not found

Run Times

Friedman's Test for Significant Differences

The Friedman test was run in MATLAB against the Average Precision summary data over the 30 song groups.
Command: [c,m,h,gnames] = multcompare(stats, 'ctype', 'tukey-kramer','estimate', 'friedman', 'alpha', 0.05);

file /nema-raid/www/mirex/results/cover/coversong.friedman.anova.csv not found

file /nema-raid/www/mirex/results/cover/coversong.friedman.csv not found

File:Coversong.friedman.png

Average Performance per Query Group

These are the arithmetic means of the average precisions within each of the 30 query groups.

file /nema-raid/www/mirex/results/cover/cover.mapquerygroup.v2.csv not found

Individual Results Files

/results/cover/RE.mix.avgprec.txt /results/cover/RE.mix.ranklist.txt

/results/cover/SZA.mix.avgprec.txt /results/cover/SZA.mix.ranklist.txt

/results/cover/TA.mix.avgprec.txt /results/cover/TA.mix.ranklist.txt


/results/cover/RE.maz.avgprec.txt /results/cover/RE.maz.ranklist.txt

/results/cover/SZA.maz.avgprec.txt /results/cover/SZA.maz.ranklist.txt

/results/cover/TA.maz.avgprec.txt /results/cover/TA.maz.ranklist.txt

Retrieved from "https://music-ir.org/mirex/w/index.php?title=2009:Audio_Cover_Song_Identification_Results&oldid=5287"