2010:Audio Music Similarity and Retrieval Results - Revision history

Kahyun Choi: /* Team ID */

2012-05-03T20:59:52Z

‎Team ID

Bfields: /* Team ID */

2010-09-15T13:47:56Z

‎Team ID

Dbogdanov: /* Reports */

2010-08-05T11:53:44Z

‎Reports

Dbogdanov: /* Reports */

2010-08-05T11:53:24Z

‎Reports

Dbogdanov: /* Team ID */

2010-08-05T10:55:22Z

‎Team ID

Dbogdanov: /* Team ID */

2010-08-05T10:54:53Z

‎Team ID

Kriswest: /* BROAD Scores */

2010-08-04T00:24:21Z

‎BROAD Scores

Kriswest: /* FINE Scores */

2010-08-04T00:24:05Z

‎FINE Scores

Kriswest: /* Introduction */

2010-08-04T00:22:43Z

‎Introduction

AndreasEhmann at 19:40, 3 August 2010

2010-08-03T19:40:51Z

@@ Line 37: / Line 37: @@
 	|-
 	! TLN2
-	| Post-Processing 1 of Marsyas similarity results ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2010/TLN1.pdf PDF] || [http://www.cs.uvic.ca/~gtzan George Tzanetakis], [http://recherche.ircam.fr/equipes/analyse-synthese/home.html Mathieu Lagrange], [http://sness.net Steven Ness]
+	| Post-Processing 1 of Marsyas similarity results ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2010/TLN2.pdf PDF] || [http://www.cs.uvic.ca/~gtzan George Tzanetakis], [http://recherche.ircam.fr/equipes/analyse-synthese/home.html Mathieu Lagrange], [http://sness.net Steven Ness]
 	|-
 	! TLN3

@@ Line 22: / Line 22: @@
 	|-
 	! PS1
-	| PS09 ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2010/PS1.pdf PDF] || [http://www.cp.jku.at/ Tim Pohle], [http://www.cp.jku.at/ Dominik Schnitzer]
+	| PS09 ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2009/PS.pdf PDF] || [http://www.cp.jku.at/ Tim Pohle], [http://www.cp.jku.at/ Dominik Schnitzer]
 	|-
 	! PSS1

@@ Line 103: / Line 103: @@
 '''PS1''' = [https://music-ir.org/mirex/results/2010/ams/statistics/PS1/report.txt Tim Pohle, Dominik Schnitzer]<br />
 '''PSS1''' = [https://music-ir.org/mirex/results/2010/ams/statistics/PSS1/report.txt Tim Pohle, Klaus Seyerlehner, Dominik Schnitzer]<br />
-'''RZ1''' = [https://music-ir.org/mirex/results/2010/ams/statistics/RZ1/report.txt Dmitry Rainer Zufall]<br />
+'''RZ1''' = [https://music-ir.org/mirex/results/2010/ams/statistics/RZ1/report.txt Rainer Zufall]<br />
 '''SSPK2''' = [https://music-ir.org/mirex/results/2010/ams/statistics/SSPK2/report.txt Klaus Seyerlehner, Markus Schedl, Tim Pohle, Peter Knees]<br />
 '''TLN1''' = [https://music-ir.org/mirex/results/2010/ams/statistics/TLN1/report.txt George Tzanetakis, Mathieu Lagrange, Steven Ness]<br />

@@ Line 100: / Line 100: @@
 === Reports ===
-'''BWL1''' = [https://music-ir.org/mirex/results/2010/ams/statistics/BWL1/report.txt Dmitry Bogdanov, Nicolas Wack, Cyril Laurier]<br />
+'''BWL1''' = [https://music-ir.org/mirex/results/2010/ams/statistics/BWL1/report.txt Dmitry Bogdanov, Joan Serrà, Nicolas Wack, Perfecto Herrera]<br />
 '''PS1''' = [https://music-ir.org/mirex/results/2010/ams/statistics/PS1/report.txt Tim Pohle, Dominik Schnitzer]<br />
 '''PSS1''' = [https://music-ir.org/mirex/results/2010/ams/statistics/PSS1/report.txt Tim Pohle, Klaus Seyerlehner, Dominik Schnitzer]<br />
@@ Line 108: / Line 108: @@
 '''TLN2''' = [https://music-ir.org/mirex/results/2010/ams/statistics/TLN2/report.txt George Tzanetakis, Mathieu Lagrange, Steven Ness]<br />
 '''TLN3''' = [https://music-ir.org/mirex/results/2010/ams/statistics/TLN3/report.txt George Tzanetakis, Mathieu Lagrange, Steven Ness]<br />
 == Run Times ==
 <csv>2010/ams/audiosim.runtime.csv</csv>

@@ Line 19: / Line 19: @@
 	|-
 	! BWL1
-	| MTG-AMS ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2010/BWL1.pdf PDF] || [http://mtg.upf.edu Dmitry Bogdanov], [http://mtg.upf.edu Nicolas Wack], [http://mtg.upf.edu Perfecto Herrera]
+	| MTG-AMS ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2010/BWL1.pdf PDF] || [http://mtg.upf.edu Dmitry Bogdanov], [http://mtg.upf.edu Joan Serrà], [http://mtg.upf.edu Nicolas Wack], [http://mtg.upf.edu Perfecto Herrera]
 	|-
 	! PS1

@@ Line 86: / Line 86: @@
 These are the mean BROAD scores per query assigned by Evalutron graders. The BROAD scores for the 5 candidates returned per algorithm, per query, have been averaged. Values are bounded between 0 (not similar) and 2 (very similar). A perfect score would be 2. Genre labels have been included for reference.
-<csv p=3>2010/ams/cat_scores.csv</csv>
+<csv p=1>2010/ams/cat_scores.csv</csv>
 ===Raw Scores===

@@ Line 81: / Line 81: @@
 These are the mean FINE scores per query assigned by Evalutron graders. The FINE scores for the 5 candidates returned per algorithm, per query, have been averaged. Values are bounded between 0 and 100. A perfect score would be 100. Genre labels have been included for reference.
-<csv p=3>2010/ams/fine_scores.csv</csv>
+<csv p=1>2010/ams/fine_scores.csv</csv>
 ====BROAD Scores====

@@ Line 2: / Line 2: @@
 These are the results for the 2010 running of the Audio Music Similarity and Retrieval task set. For background information about this task set please refer to the Audio Music Similarity and Retrieval page.
-Each system was given 7000 songs chosen from IMIRSEL's "uspop", "uscrap" and "american" "classical" and "sundry" collections. Each system then returned a 7000x7000 distance matrix. 100 songs were randomly selected from the 10 genre groups (10 per genre) as queries and the first 5 most highly ranked songs out of the 7000 were extracted for each query (after filtering out the query itself, returned results from the same artist were also omitted). Then, for each query, the returned results (candidates) from all participants were grouped and were evaluated by human graders using the Evalutron 6000 grading system. Each individual query/candidate set was evaluated by a single grader. For each query/candidate pair, graders provided two scores. Graders were asked to provide 1 categorical '''BROAD''' score with 3 categories: NS,SS,VS as explained below, and one '''FINE''' score (in the range from 0 to 10). A description and analysis is provided below.
+Each system was given 7000 songs chosen from IMIRSEL's "uspop", "uscrap" and "american" "classical" and "sundry" collections. Each system then returned a 7000x7000 distance matrix. 100 songs were randomly selected from the 10 genre groups (10 per genre) as queries and the first 5 most highly ranked songs out of the 7000 were extracted for each query (after filtering out the query itself, returned results from the same artist were also omitted). Then, for each query, the returned results (candidates) from all participants were grouped and were evaluated by human graders using the Evalutron 6000 grading system. Each individual query/candidate set was evaluated by a single grader. For each query/candidate pair, graders provided two scores. Graders were asked to provide 1 categorical '''BROAD''' score with 3 categories: NS,SS,VS as explained below, and one '''FINE''' score (in the range from 0 to 100). A description and analysis is provided below.
 The systems read in 30 second audio clips as their raw data. The same 30 second clips were used in the grading stage.

@@ Line 34: / Line 34: @@
 	|-
 	! TLN1
 	| Post-Processing 1 of Marsyas similarity results ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2010/TLN1.pdf PDF] || [http://www.cs.uvic.ca/~gtzan George Tzanetakis], [http://recherche.ircam.fr/equipes/analyse-synthese/home.html Mathieu Lagrange], [http://sness.net Steven Ness]
 	|-
-	! TLN2
+	! TLN3
 	| Post-Processing 2 of Marsyas similarity results ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2010/TLN2.pdf PDF] || [http://www.cs.uvic.ca/~gtzan George Tzanetakis], [http://recherche.ircam.fr/equipes/analyse-synthese/home.html Mathieu Lagrange], [http://sness.net Steven Ness]
 	|}