2007:Audio Cover Song Identification Results - Revision history

Singh14: /* Ranks of the Ten Cover Songs Returned for Each Query */

2010-07-23T22:35:31Z

‎Ranks of the Ten Cover Songs Returned for Each Query

Singh14: /* Average Precision Scores for Each Query */

2010-07-23T22:34:50Z

‎Average Precision Scores for Each Query

Singh14: /* Team ID */

2010-07-23T22:33:56Z

‎Team ID

IMIRSELBot: Robot: Automated text replacement (-mirex/abs/ +mirex/abstracts/)

2010-05-14T03:51:02Z

Robot: Automated text replacement (-mirex/abs/ +mirex/abstracts/)

IMIRSELBot: Robot: Automated text replacement (-mirex2007/results +mirex/results/2007)

2010-05-14T01:25:14Z

Robot: Automated text replacement (-mirex2007/results +mirex/results/2007)

IMIRSELBot: Robot: Automated text replacement (-\[http://www.music-ir.org/mirex/(200[5-9])/abs/ +[http://www.music-ir.org/mirex/abs/\1/)

2010-05-14T01:22:53Z

Robot: Automated text replacement (-\[http://www.music-ir.org/mirex/(200[5-9])/abs/ +[http://www.music-ir.org/mirex/abs/\1/)

IMIRSELBot: Robot: Automated text replacement (-]*)> +2007/)

2010-05-14T00:40:30Z

Robot: Automated text replacement (-<csv([^>]*)> +<csv\1>2007/)

IMIRSELBot: Robot: Automated text replacement (-\[\[([A-Z][^:]+)\]\] +2007:\1)

2010-05-13T18:18:00Z

Robot: Automated text replacement (-\[\[([A-Z][^:]+)\]\] +2007:\1)

JDownie: /* Team ID */

2008-09-07T22:04:32Z

‎Team ID

JDownie at 22:02, 7 September 2008

2008-09-07T22:02:52Z

@@ Line 58: / Line 58: @@
 '''IM''' = [https://www.music-ir.org/mirex/results/2007/cover.imirsel.eval.debug.csv IMIRSEL M2K]<br/>
 '''JB''' = [https://www.music-ir.org/mirex/results/2007/cover.bello.eval.debug.csv Juan Bello] <br/>
-'''JEC''' = [https://www.music-ir.org/mirex/results/2007/cover.jensen.eval.debug.csv Jesper H├╕jvang Jensen, Daniel P. W. Ellis, Mads G. Christensen, S├╕ren Holdt]<br />
+'''JEC''' = [https://www.music-ir.org/mirex/results/2007/cover.jensen.eval.debug.csv Jesper Højvang Jensen, Daniel P. W. Ellis, Mads G. Christensen, Søren Holdt]<br />
 '''KL1''' = [https://www.music-ir.org/mirex/results/2007/cover.klee1.eval.debug.csv Kyogu Lee 1]<br />
 '''KL2''' = [https://www.music-ir.org/mirex/results/2007/cover.klee2.eval.debug.csv Kyogu Lee 2]<br />
 '''KP''' = [https://www.music-ir.org/mirex/results/2007/cover.metlab.eval.debug.csv Youngmoo E. Kim, Daniel Perelstein] <br />
-'''SG''' = [https://www.music-ir.org/mirex/results/2007/cover.serra.eval.debug.csv Joan Serr├á, Emilia G├│mez]<br />
+'''SG''' = [https://www.music-ir.org/mirex/results/2007/cover.serra.eval.debug.csv Joan Serrà, Emilia Gómez]<br />
 [[Category: Results]]

@@ Line 48: / Line 48: @@
 '''IM''' = [https://www.music-ir.org/mirex/results/2007/cover.imirsel.eval.csv IMIRSEL M2K]<br/>
 '''JB''' = [https://www.music-ir.org/mirex/results/2007/cover.bello.eval.csv Juan Bello] <br/>
-'''JEC''' = [https://www.music-ir.org/mirex/results/2007/cover.jensen.eval.csv Jesper H├╕jvang Jensen, Daniel P. W. Ellis, Mads G. Christensen, S├╕ren Holdt]<br />
+'''JEC''' = [https://www.music-ir.org/mirex/results/2007/cover.jensen.eval.csv Jesper Højvang Jensen, Daniel P. W. Ellis, Mads G. Christensen, Søren Holdt]<br />
 '''KL1''' = [https://www.music-ir.org/mirex/results/2007/cover.klee1.eval.csv Kyogu Lee 1]<br />
 '''KL2''' = [https://www.music-ir.org/mirex/results/2007/cover.klee2.eval.csv Kyogu Lee 2]<br />
 '''KP''' = [https://www.music-ir.org/mirex/results/2007/cover.metlab.eval.csv Youngmoo E. Kim, Daniel Perelstein] <br />
-'''SG''' = [https://www.music-ir.org/mirex/results/2007/cover.serra.eval.csv Joan Serr├á, Emilia G├│mez]<br />
+'''SG''' = [https://www.music-ir.org/mirex/results/2007/cover.serra.eval.csv Joan Serrà, Emilia Gómez]<br />
 ===Ranks of the Ten Cover Songs Returned for Each Query===

@@ Line 10: / Line 10: @@
 '''IM''' = IMIRSEL M2K<br/>
 '''JB''' = [https://www.music-ir.org/mirex/abstracts/2007/CS_bello.pdf Juan Bello] <br/>
-'''JEC''' = [https://www.music-ir.org/mirex/abstracts/2007/CS_jensen.pdf Jesper H├╕jvang Jensen, Daniel P. W. Ellis, Mads G. Christensen, S├╕ren Holdt]<br />
+'''JEC''' = [https://www.music-ir.org/mirex/abstracts/2007/CS_jensen.pdf Jesper Højvang Jensen, Daniel P. W. Ellis, Mads G. Christensen, Søren Holdt]<br />
 '''KL1''' = Kyogu Lee 1<br />
 '''KL2''' = Kyogu Lee 2<br />
 '''KP''' = [https://www.music-ir.org/mirex/abstracts/2007/CS_kim.pdf Youngmoo E. Kim, Daniel Perelstein] <br />
-'''SG''' = [https://www.music-ir.org/mirex/abstracts/2007/CS_serra.pdf Joan Serr├á, Emilia G├│mez]<br />
+'''SG''' = [https://www.music-ir.org/mirex/abstracts/2007/CS_serra.pdf Joan Serrà, Emilia Gómez]<br />
 ==Overall Summary Results==

@@ Line 7: / Line 7: @@
 ===General Legend===
 ====Team ID====
-'''EC''' = [https://www.music-ir.org/mirex/abs/2007/CS_ellis.pdf Daniel P. W. Ellis, Courtenay V. Cotton]<br />
+'''EC''' = [https://www.music-ir.org/mirex/abstracts/2007/CS_ellis.pdf Daniel P. W. Ellis, Courtenay V. Cotton]<br />
 '''IM''' = IMIRSEL M2K<br/>
-'''JB''' = [https://www.music-ir.org/mirex/abs/2007/CS_bello.pdf Juan Bello] <br/>
+'''JB''' = [https://www.music-ir.org/mirex/abstracts/2007/CS_bello.pdf Juan Bello] <br/>
-'''JEC''' = [https://www.music-ir.org/mirex/abs/2007/CS_jensen.pdf Jesper H├╕jvang Jensen, Daniel P. W. Ellis, Mads G. Christensen, S├╕ren Holdt]<br />
+'''JEC''' = [https://www.music-ir.org/mirex/abstracts/2007/CS_jensen.pdf Jesper H├╕jvang Jensen, Daniel P. W. Ellis, Mads G. Christensen, S├╕ren Holdt]<br />
 '''KL1''' = Kyogu Lee 1<br />
 '''KL2''' = Kyogu Lee 2<br />
-'''KP''' = [https://www.music-ir.org/mirex/abs/2007/CS_kim.pdf Youngmoo E. Kim, Daniel Perelstein] <br />
+'''KP''' = [https://www.music-ir.org/mirex/abstracts/2007/CS_kim.pdf Youngmoo E. Kim, Daniel Perelstein] <br />
-'''SG''' = [https://www.music-ir.org/mirex/abs/2007/CS_serra.pdf Joan Serr├á, Emilia G├│mez]<br />
+'''SG''' = [https://www.music-ir.org/mirex/abstracts/2007/CS_serra.pdf Joan Serr├á, Emilia G├│mez]<br />
 ==Overall Summary Results==

@@ Line 45: / Line 45: @@
 ==Individual Results Files==
 ===Average Precision Scores for Each Query===
-'''EC''' = [https://www.music-ir.org/mirex2007/results/cover.labrosa.eval.csv Daniel P. W. Ellis, Courtenay V. Cotton]<br />
+'''EC''' = [https://www.music-ir.org/mirex/results/2007/cover.labrosa.eval.csv Daniel P. W. Ellis, Courtenay V. Cotton]<br />
-'''IM''' = [https://www.music-ir.org/mirex2007/results/cover.imirsel.eval.csv IMIRSEL M2K]<br/>
+'''IM''' = [https://www.music-ir.org/mirex/results/2007/cover.imirsel.eval.csv IMIRSEL M2K]<br/>
-'''JB''' = [https://www.music-ir.org/mirex2007/results/cover.bello.eval.csv Juan Bello] <br/>
+'''JB''' = [https://www.music-ir.org/mirex/results/2007/cover.bello.eval.csv Juan Bello] <br/>
-'''JEC''' = [https://www.music-ir.org/mirex2007/results/cover.jensen.eval.csv Jesper H├╕jvang Jensen, Daniel P. W. Ellis, Mads G. Christensen, S├╕ren Holdt]<br />
+'''JEC''' = [https://www.music-ir.org/mirex/results/2007/cover.jensen.eval.csv Jesper H├╕jvang Jensen, Daniel P. W. Ellis, Mads G. Christensen, S├╕ren Holdt]<br />
-'''KL1''' = [https://www.music-ir.org/mirex2007/results/cover.klee1.eval.csv Kyogu Lee 1]<br />
+'''KL1''' = [https://www.music-ir.org/mirex/results/2007/cover.klee1.eval.csv Kyogu Lee 1]<br />
-'''KL2''' = [https://www.music-ir.org/mirex2007/results/cover.klee2.eval.csv Kyogu Lee 2]<br />
+'''KL2''' = [https://www.music-ir.org/mirex/results/2007/cover.klee2.eval.csv Kyogu Lee 2]<br />
-'''KP''' = [https://www.music-ir.org/mirex2007/results/cover.metlab.eval.csv Youngmoo E. Kim, Daniel Perelstein] <br />
+'''KP''' = [https://www.music-ir.org/mirex/results/2007/cover.metlab.eval.csv Youngmoo E. Kim, Daniel Perelstein] <br />
-'''SG''' = [https://www.music-ir.org/mirex2007/results/cover.serra.eval.csv Joan Serr├á, Emilia G├│mez]<br />
+'''SG''' = [https://www.music-ir.org/mirex/results/2007/cover.serra.eval.csv Joan Serr├á, Emilia G├│mez]<br />
 ===Ranks of the Ten Cover Songs Returned for Each Query===
-'''EC''' = [https://www.music-ir.org/mirex2007/results/cover.labrosa.eval.debug.csv Daniel P. W. Ellis, Courtenay V. Cotton]<br />
+'''EC''' = [https://www.music-ir.org/mirex/results/2007/cover.labrosa.eval.debug.csv Daniel P. W. Ellis, Courtenay V. Cotton]<br />
-'''IM''' = [https://www.music-ir.org/mirex2007/results/cover.imirsel.eval.debug.csv IMIRSEL M2K]<br/>
+'''IM''' = [https://www.music-ir.org/mirex/results/2007/cover.imirsel.eval.debug.csv IMIRSEL M2K]<br/>
-'''JB''' = [https://www.music-ir.org/mirex2007/results/cover.bello.eval.debug.csv Juan Bello] <br/>
+'''JB''' = [https://www.music-ir.org/mirex/results/2007/cover.bello.eval.debug.csv Juan Bello] <br/>
-'''JEC''' = [https://www.music-ir.org/mirex2007/results/cover.jensen.eval.debug.csv Jesper H├╕jvang Jensen, Daniel P. W. Ellis, Mads G. Christensen, S├╕ren Holdt]<br />
+'''JEC''' = [https://www.music-ir.org/mirex/results/2007/cover.jensen.eval.debug.csv Jesper H├╕jvang Jensen, Daniel P. W. Ellis, Mads G. Christensen, S├╕ren Holdt]<br />
-'''KL1''' = [https://www.music-ir.org/mirex2007/results/cover.klee1.eval.debug.csv Kyogu Lee 1]<br />
+'''KL1''' = [https://www.music-ir.org/mirex/results/2007/cover.klee1.eval.debug.csv Kyogu Lee 1]<br />
-'''KL2''' = [https://www.music-ir.org/mirex2007/results/cover.klee2.eval.debug.csv Kyogu Lee 2]<br />
+'''KL2''' = [https://www.music-ir.org/mirex/results/2007/cover.klee2.eval.debug.csv Kyogu Lee 2]<br />
-'''KP''' = [https://www.music-ir.org/mirex2007/results/cover.metlab.eval.debug.csv Youngmoo E. Kim, Daniel Perelstein] <br />
+'''KP''' = [https://www.music-ir.org/mirex/results/2007/cover.metlab.eval.debug.csv Youngmoo E. Kim, Daniel Perelstein] <br />
-'''SG''' = [https://www.music-ir.org/mirex2007/results/cover.serra.eval.debug.csv Joan Serr├á, Emilia G├│mez]<br />
+'''SG''' = [https://www.music-ir.org/mirex/results/2007/cover.serra.eval.debug.csv Joan Serr├á, Emilia G├│mez]<br />
 [[Category: Results]]

@@ Line 17: / Line 17: @@
 ==Overall Summary Results==
-<csv>cover.overall.stats.csv</csv>
+<csv>2007/cover.overall.stats.csv</csv>
 ===Runtimes===
@@ Line 24: / Line 24: @@
 Where runtimes were not properly reported, file timestamps have been used to approximate a runtime.
-<csv>cover.runtimes.csv</csv>
+<csv>2007/cover.runtimes.csv</csv>
 ===Number of Correct Covers at Rank X Returned in Top Ten===
-<csv>cover.rank.distributions.csv</csv>
+<csv>2007/cover.rank.distributions.csv</csv>
 ===Friedman's Test for Significant Differences===
 The Friedman test was run in MATLAB against the Average Precision summary data over the 30 song groups.<br /> Command: [c,m,h,gnames] = multcompare(stats, 'ctype', 'tukey-kramer','estimate', 'friedman', 'alpha', 0.05);
-<csv>cover.friedmans.summary.csv</csv>
+<csv>2007/cover.friedmans.summary.csv</csv>
-<csv>cover.friedmans.details.csv</csv>
+<csv>2007/cover.friedmans.details.csv</csv>
 [[Image:2007 cover friedmans 1.png]]
@@ Line 41: / Line 41: @@
 These are the arithmetic means of the average precisions within each of the 30 query groups.
-<csv>cover.avg.prec.by.groups.csv</csv>
+<csv>2007/cover.avg.prec.by.groups.csv</csv>
 ==Individual Results Files==

@@ Line 1: / Line 1: @@
 ==Introduction==
-These are the results for the 2007 running of the Audio Cover Song Identification task. For background information about this task set please refer to the [[Audio Cover Song Identification]] page.
+These are the results for the 2007 running of the Audio Cover Song Identification task. For background information about this task set please refer to the [[2007:Audio Cover Song Identification]] page.
 Each system was given a collection of 1000 songs which included of 30 different classes (sets) of cover songs where each class/set was represented by 11 different versions of a particular song. Each of the 330 cover songs were used as queries and the systems were required to return 10 results for each query. Systems were evaluated on the number of the songs from the same class/set as the query that were returned in the list of 10 results for each query. Average precision, which looks at the entire per-query rank-ordered list of all songs in the collection, is a new metric explored this year.