2007:Audio Music Similarity and Retrieval Results - Revision history

Singh14: /* Team ID */

2010-07-26T16:44:02Z

‎Team ID

Singh14: /* Team ID */

2010-07-26T15:02:37Z

‎Team ID

IMIRSELBot: Robot: Automated text replacement (-mirex/abs/ +mirex/abstracts/)

2010-05-14T03:51:33Z

Robot: Automated text replacement (-mirex/abs/ +mirex/abstracts/)

IMIRSELBot: Robot: Automated text replacement (-mirex2007/results +mirex/results/2007)

2010-05-14T01:25:24Z

Robot: Automated text replacement (-mirex2007/results +mirex/results/2007)

IMIRSELBot: Robot: Automated text replacement (-\[http://www.music-ir.org/mirex/(200[5-9])/abs/ +[http://www.music-ir.org/mirex/abs/\1/)

2010-05-14T01:23:24Z

Robot: Automated text replacement (-\[http://www.music-ir.org/mirex/(200[5-9])/abs/ +[http://www.music-ir.org/mirex/abs/\1/)

IMIRSELBot: Robot: Automated text replacement (-]*)> +2007/)

2010-05-14T00:41:11Z

Robot: Automated text replacement (-<csv([^>]*)> +<csv\1>2007/)

IMIRSELBot: Robot: Automated text replacement (-\[\[([A-Z][^:]+)\]\] +2007:\1)

2010-05-13T18:19:10Z

Robot: Automated text replacement (-\[\[([A-Z][^:]+)\]\] +2007:\1)

MertBay: /* Team ID */

2007-12-17T17:34:35Z

‎Team ID

MertBay: /* Anonymized Metadata */

2007-10-04T21:47:35Z

‎Anonymized Metadata

MertBay: /* Raw Scores */

2007-10-04T21:47:07Z

‎Raw Scores

@@ Line 27: / Line 27: @@
 '''PC''' = [https://www.music-ir.org/mirex/abstracts/2007/AS_paradzinets.pdf Aliaksandr Paradzinets, Liming Chen]<br />
 '''PS''' = [https://www.music-ir.org/mirex/abstracts/2007/AS_pohle.pdf Tim Pohle, Dominik Schnitzer]<br />
-'''TL1''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel I├▒esta 1]<br />
+'''TL1''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel Iñesta 1]<br />
-'''TL2''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel I├▒esta 2]<br />
+'''TL2''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel Iñesta 2]<br />
 ====Broad Categories====

@@ Line 27: / Line 27: @@
 '''PC''' = [https://www.music-ir.org/mirex/abstracts/2007/AS_paradzinets.pdf Aliaksandr Paradzinets, Liming Chen]<br />
 '''PS''' = [https://www.music-ir.org/mirex/abstracts/2007/AS_pohle.pdf Tim Pohle, Dominik Schnitzer]<br />
-'''TL1''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, Jos├⌐ Manuel I├▒esta 1]<br />
+'''TL1''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel I├▒esta 1]<br />
-'''TL2''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, Jos├⌐ Manuel I├▒esta 2]<br />
+'''TL2''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel I├▒esta 2]<br />
 ====Broad Categories====

@@ Line 17: / Line 17: @@
 ====General Legend====
 =====Team ID=====
-'''BK1''' = [https://www.music-ir.org/mirex/abs/2007/AS_bosteels.pdf Klaas Bosteels, Etienne E. Kerre 1]<br />
+'''BK1''' = [https://www.music-ir.org/mirex/abstracts/2007/AS_bosteels.pdf Klaas Bosteels, Etienne E. Kerre 1]<br />
-'''BK2''' = [https://www.music-ir.org/mirex/abs/2007/AS_bosteels.pdf Klaas Bosteels, Etienne E. Kerre 2]<br />
+'''BK2''' = [https://www.music-ir.org/mirex/abstracts/2007/AS_bosteels.pdf Klaas Bosteels, Etienne E. Kerre 2]<br />
-'''CB1''' = [https://www.music-ir.org/mirex/abs/2007/AS_bastuck.pdf Christoph Bastuck 1]<br />
+'''CB1''' = [https://www.music-ir.org/mirex/abstracts/2007/AS_bastuck.pdf Christoph Bastuck 1]<br />
-'''CB2''' = [https://www.music-ir.org/mirex/abs/2007/AS_bastuck.pdf Christoph Bastuck 2]<br />
+'''CB2''' = [https://www.music-ir.org/mirex/abstracts/2007/AS_bastuck.pdf Christoph Bastuck 2]<br />
-'''CB3''' = [https://www.music-ir.org/mirex/abs/2007/AS_bastuck.pdf Christoph Bastuck 3]<br />
+'''CB3''' = [https://www.music-ir.org/mirex/abstracts/2007/AS_bastuck.pdf Christoph Bastuck 3]<br />
-'''GT''' = [https://www.music-ir.org/mirex/abs/2007/AI_CC_GC_MC_AS_tzanetakis.pdf George Tzanetakis] <br />
+'''GT''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_tzanetakis.pdf George Tzanetakis] <br />
-'''LB''' = [https://www.music-ir.org/mirex/abs/2007/AS_barrington.pdf Luke Barrington, Douglas Turnbull, David Torres, Gert Lanskriet]<br />
+'''LB''' = [https://www.music-ir.org/mirex/abstracts/2007/AS_barrington.pdf Luke Barrington, Douglas Turnbull, David Torres, Gert Lanskriet]<br />
-'''ME''' = [https://www.music-ir.org/mirex/abs/2007/AI_CC_GC_MC_AS_mandel.pdf Michael I. Mandel, Daniel P. W. Ellis]<br />
+'''ME''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_mandel.pdf Michael I. Mandel, Daniel P. W. Ellis]<br />
-'''PC''' = [https://www.music-ir.org/mirex/abs/2007/AS_paradzinets.pdf Aliaksandr Paradzinets, Liming Chen]<br />
+'''PC''' = [https://www.music-ir.org/mirex/abstracts/2007/AS_paradzinets.pdf Aliaksandr Paradzinets, Liming Chen]<br />
-'''PS''' = [https://www.music-ir.org/mirex/abs/2007/AS_pohle.pdf Tim Pohle, Dominik Schnitzer]<br />
+'''PS''' = [https://www.music-ir.org/mirex/abstracts/2007/AS_pohle.pdf Tim Pohle, Dominik Schnitzer]<br />
-'''TL1''' = [https://www.music-ir.org/mirex/abs/2007/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, Jos├⌐ Manuel I├▒esta 1]<br />
+'''TL1''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, Jos├⌐ Manuel I├▒esta 1]<br />
-'''TL2''' = [https://www.music-ir.org/mirex/abs/2007/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, Jos├⌐ Manuel I├▒esta 2]<br />
+'''TL2''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, Jos├⌐ Manuel I├▒esta 2]<br />
 ====Broad Categories====

@@ Line 69: / Line 69: @@
 ===Anonymized Metadata===
-[https://www.music-ir.org/mirex2007/results/anonymizedAudioSim07metaData.csv Anonymized Metadata]<br />
+[https://www.music-ir.org/mirex/results/2007/anonymizedAudioSim07metaData.csv Anonymized Metadata]<br />
 ===Raw Scores===
 The raw data derived from the Evalutron 6000 human evaluations are located on the [[2007:Audio Music Similarity and Retrieval Raw Data]] page.

@@ Line 17: / Line 17: @@
 ====General Legend====
 =====Team ID=====
-'''BK1''' = [https://www.music-ir.org/mirex/2007/abs/AS_bosteels.pdf Klaas Bosteels, Etienne E. Kerre 1]<br />
+'''BK1''' = [https://www.music-ir.org/mirex/abs/2007/AS_bosteels.pdf Klaas Bosteels, Etienne E. Kerre 1]<br />
-'''BK2''' = [https://www.music-ir.org/mirex/2007/abs/AS_bosteels.pdf Klaas Bosteels, Etienne E. Kerre 2]<br />
+'''BK2''' = [https://www.music-ir.org/mirex/abs/2007/AS_bosteels.pdf Klaas Bosteels, Etienne E. Kerre 2]<br />
-'''CB1''' = [https://www.music-ir.org/mirex/2007/abs/AS_bastuck.pdf Christoph Bastuck 1]<br />
+'''CB1''' = [https://www.music-ir.org/mirex/abs/2007/AS_bastuck.pdf Christoph Bastuck 1]<br />
-'''CB2''' = [https://www.music-ir.org/mirex/2007/abs/AS_bastuck.pdf Christoph Bastuck 2]<br />
+'''CB2''' = [https://www.music-ir.org/mirex/abs/2007/AS_bastuck.pdf Christoph Bastuck 2]<br />
-'''CB3''' = [https://www.music-ir.org/mirex/2007/abs/AS_bastuck.pdf Christoph Bastuck 3]<br />
+'''CB3''' = [https://www.music-ir.org/mirex/abs/2007/AS_bastuck.pdf Christoph Bastuck 3]<br />
-'''GT''' = [https://www.music-ir.org/mirex/2007/abs/AI_CC_GC_MC_AS_tzanetakis.pdf George Tzanetakis] <br />
+'''GT''' = [https://www.music-ir.org/mirex/abs/2007/AI_CC_GC_MC_AS_tzanetakis.pdf George Tzanetakis] <br />
-'''LB''' = [https://www.music-ir.org/mirex/2007/abs/AS_barrington.pdf Luke Barrington, Douglas Turnbull, David Torres, Gert Lanskriet]<br />
+'''LB''' = [https://www.music-ir.org/mirex/abs/2007/AS_barrington.pdf Luke Barrington, Douglas Turnbull, David Torres, Gert Lanskriet]<br />
-'''ME''' = [https://www.music-ir.org/mirex/2007/abs/AI_CC_GC_MC_AS_mandel.pdf Michael I. Mandel, Daniel P. W. Ellis]<br />
+'''ME''' = [https://www.music-ir.org/mirex/abs/2007/AI_CC_GC_MC_AS_mandel.pdf Michael I. Mandel, Daniel P. W. Ellis]<br />
-'''PC''' = [https://www.music-ir.org/mirex/2007/abs/AS_paradzinets.pdf Aliaksandr Paradzinets, Liming Chen]<br />
+'''PC''' = [https://www.music-ir.org/mirex/abs/2007/AS_paradzinets.pdf Aliaksandr Paradzinets, Liming Chen]<br />
-'''PS''' = [https://www.music-ir.org/mirex/2007/abs/AS_pohle.pdf Tim Pohle, Dominik Schnitzer]<br />
+'''PS''' = [https://www.music-ir.org/mirex/abs/2007/AS_pohle.pdf Tim Pohle, Dominik Schnitzer]<br />
-'''TL1''' = [https://www.music-ir.org/mirex/2007/abs/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, Jos├⌐ Manuel I├▒esta 1]<br />
+'''TL1''' = [https://www.music-ir.org/mirex/abs/2007/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, Jos├⌐ Manuel I├▒esta 1]<br />
-'''TL2''' = [https://www.music-ir.org/mirex/2007/abs/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, Jos├⌐ Manuel I├▒esta 2]<br />
+'''TL2''' = [https://www.music-ir.org/mirex/abs/2007/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, Jos├⌐ Manuel I├▒esta 2]<br />
 ====Broad Categories====

@@ Line 48: / Line 48: @@
 '''NB''': The results for BK2 were interpolated from partial data due to a runtime error.
-<csv>ams07_overall_summary2.csv</csv>
+<csv>2007/ams07_overall_summary2.csv</csv>
@@ Line 55: / Line 55: @@
 The Friedman test was run in MATLAB against the Fine summary data over the 100 queries.<br />
 Command: [c,m,h,gnames] = multcompare(stats, 'ctype', 'tukey-kramer','estimate', 'friedman', 'alpha', 0.05);
-<csv>ams07_sum_friedman_fine.csv</csv>
+<csv>2007/ams07_sum_friedman_fine.csv</csv>
-<csv>ams07_detail_friedman_fine.csv</csv>
+<csv>2007/ams07_detail_friedman_fine.csv</csv>
 [[Image:2007 ams broad scores friedmans.png]]
@@ Line 63: / Line 63: @@
 These are the mean FINE scores per query assigned by Evalutron graders. The FINE scores for the 5 candidates returned per algorithm, per query, have been averaged. Values are bounded between 0.0 and 10.0. A perfect score would be 10. Genre labels have been included for reference.
-<csv>ams07_fine_by_query_with_genre.csv</csv>
+<csv>2007/ams07_fine_by_query_with_genre.csv</csv>
 These are the mean BROAD scores per query assigned by Evalutron graders. The BROAD scores for the 5 candidates returned per algorithm, per query, have been averaged. Values are bounded between 0 (not similar) and 2 (very similar). A perfect score would be 2. Genre labels have been included for reference.
-<csv>ams07_broad_by_query_with_genre.csv</csv>
+<csv>2007/ams07_broad_by_query_with_genre.csv</csv>
 ===Anonymized Metadata===

@@ Line 1: / Line 1: @@
 [[Category: Results]]
 ==Introduction==
-These are the results for the 2007 running of the Audio Music Similarity and Retrieval task set. For background information about this task set please refer to the [[Audio Music Similarity and Retrieval]] page.
+These are the results for the 2007 running of the Audio Music Similarity and Retrieval task set. For background information about this task set please refer to the [[2007:Audio Music Similarity and Retrieval]] page.
 Each system was given 7000 songs chosen from IMIRSEL's "uspop", "uscrap" and "american" "classical" and "sundry" collections. Each system then returned a 7000x7000 distance matrix. 100 songs were randomly selected from the 10 genre groups (10 per genre) as queries and the first 5 most highly ranked songs out of the 7000 were extracted for each query (after filtering out the query itself, returned results from the same artist were also omitted). Then, for each query, the returned results (candidates) from all participants were grouped and were evaluated by human graders using the Evalutron 6000 grading system. Each individual query/candidate set was evaluated by a single grader. For each query/candidate pair, graders provided two scores. Graders were asked to provide 1 categorical score with 3 categories: NS,SS,VS as explained below, and one fine score (in the range from 0 to 10).  A description and analysis is provided below.
@@ Line 72: / Line 72: @@
 ===Raw Scores===
-The raw data derived from the Evalutron 6000 human evaluations are located on the [[Audio Music Similarity and Retrieval Raw Data]] page.
+The raw data derived from the Evalutron 6000 human evaluations are located on the [[2007:Audio Music Similarity and Retrieval Raw Data]] page.