2007:Symbolic Melodic Similarity Results - Revision history

Kahyun Choi: /* Raw Scores */

2011-12-20T04:12:12Z

‎Raw Scores

Jdownie at 20:32, 30 July 2010

2010-07-30T20:32:15Z

Jdownie at 20:31, 30 July 2010

2010-07-30T20:31:13Z

Singh14: /* Team ID */

2010-07-26T14:56:13Z

‎Team ID

IMIRSELBot: Robot: Automated text replacement (-mirex/abs/ +mirex/abstracts/)

2010-05-14T03:52:22Z

Robot: Automated text replacement (-mirex/abs/ +mirex/abstracts/)

IMIRSELBot: Robot: Automated text replacement (-\[http://www.music-ir.org/mirex/(200[5-9])/abs/ +[http://www.music-ir.org/mirex/abs/\1/)

2010-05-14T01:24:03Z

Robot: Automated text replacement (-\[http://www.music-ir.org/mirex/(200[5-9])/abs/ +[http://www.music-ir.org/mirex/abs/\1/)

IMIRSELBot: Robot: Automated text replacement (-]*)> +2007/)

2010-05-14T00:46:30Z

Robot: Automated text replacement (-<csv([^>]*)> +<csv\1>2007/)

IMIRSELBot: Robot: Automated text replacement (-\[\[([A-Z][^:]+)\]\] +2007:\1)

2010-05-13T18:21:50Z

Robot: Automated text replacement (-\[\[([A-Z][^:]+)\]\] +2007:\1)

MertBay: /* Team ID */

2007-12-17T17:35:43Z

‎Team ID

MertBay: /* Run Times */

2007-09-17T23:05:34Z

‎Run Times

@@ Line 71: / Line 71: @@
 ==Raw Scores==
-The raw data derived from the Evalutron 6000 human evaluations are located on the [[2007:Symbolic Melodic Similarity Raw Data]] page.
+The raw data derived from the Evalutron 6000 human evaluations are located on the 2007:Symbolic Melodic Similarity Raw Data page.
 [[Category: Results]]

@@ Line 24: / Line 24: @@
 ====Team ID====
 '''FHAR''' = [https://www.music-ir.org/mirex/abstracts/2007/SMS_ferraro.pdf Pascal Ferraro, Pierre Hanna, Julien Allali, Matthias Robine]<br />
-'''GAR1''' = [https://www.music-ir.org/mirex/abstracts/2007/QBSH_SMS_gomez.pdf Carlos Gómez begin_of_the_skype_highlighting     end_of_the_skype_highlighting, Soraya Abad-Mota, Edna Ruckhaus 1]<br />
+'''GAR1''' = [https://www.music-ir.org/mirex/abstracts/2007/QBSH_SMS_gomez.pdf Carlos Gómez begin_of_the_skype_highlighting     end_of_the_skype_highlighting begin_of_the_skype_highlighting     end_of_the_skype_highlighting, Soraya Abad-Mota, Edna Ruckhaus 1]<br />
 '''GAR2''' = [https://www.music-ir.org/mirex/abstracts/2007/QBSH_SMS_gomez.pdf Carlos Gómez, Soraya Abad-Mota, Edna Ruckhaus 2]<br />
 '''AP1''' = [https://www.music-ir.org/mirex/abstracts/2007/SMS_pinto.pdf Alberto Pinto 1]<br />
@@ Line 62: / Line 62: @@
 <csv>2007/SMS07_errors_norm.csv</csv>
 ===Friedman Test with Multiple Comparisons Results (p=0.05)===
-The Friedman test was run in MATLAB against the Fine summary data over the 100 queries.<br />
+The Friedman test was run in MATLAB against the Fine summary data over the 30 queries.<br />
 Command: [c,m,h,gnames] = multcompare(stats, 'ctype', 'tukey-kramer','estimate', 'friedman', 'alpha', 0.05);
 <csv>2007/sms07_sum_friedman_fine.csv</csv>

@@ Line 19: / Line 19: @@
 '''Total number of unique query/candidate pairs graded''' = 799<br />
 '''Average number of query/candidate pairs evaluated per grader: 133 <br />
-'''Number of queries''' = 6 (perfect) with each perfect query error-mutated 4 different ways = 30<br />
+'''Number of queries''' = 5 (perfect) with each perfect query error-mutated 4 different ways = 30<br />
 ===General Legend===
 ====Team ID====
 '''FHAR''' = [https://www.music-ir.org/mirex/abstracts/2007/SMS_ferraro.pdf Pascal Ferraro, Pierre Hanna, Julien Allali, Matthias Robine]<br />
-'''GAR1''' = [https://www.music-ir.org/mirex/abstracts/2007/QBSH_SMS_gomez.pdf Carlos Gómez, Soraya Abad-Mota, Edna Ruckhaus 1]<br />
+'''GAR1''' = [https://www.music-ir.org/mirex/abstracts/2007/QBSH_SMS_gomez.pdf Carlos Gómez begin_of_the_skype_highlighting     end_of_the_skype_highlighting, Soraya Abad-Mota, Edna Ruckhaus 1]<br />
 '''GAR2''' = [https://www.music-ir.org/mirex/abstracts/2007/QBSH_SMS_gomez.pdf Carlos Gómez, Soraya Abad-Mota, Edna Ruckhaus 2]<br />
 '''AP1''' = [https://www.music-ir.org/mirex/abstracts/2007/SMS_pinto.pdf Alberto Pinto 1]<br />

@@ Line 24: / Line 24: @@
 ====Team ID====
 '''FHAR''' = [https://www.music-ir.org/mirex/abstracts/2007/SMS_ferraro.pdf Pascal Ferraro, Pierre Hanna, Julien Allali, Matthias Robine]<br />
-'''GAR1''' = [https://www.music-ir.org/mirex/abstracts/2007/QBSH_SMS_gomez.pdf Carlos G├│mez, Soraya Abad-Mota, Edna Ruckhaus 1]<br />
+'''GAR1''' = [https://www.music-ir.org/mirex/abstracts/2007/QBSH_SMS_gomez.pdf Carlos Gómez, Soraya Abad-Mota, Edna Ruckhaus 1]<br />
-'''GAR2''' = [https://www.music-ir.org/mirex/abstracts/2007/QBSH_SMS_gomez.pdf Carlos G├│mez, Soraya Abad-Mota, Edna Ruckhaus 2]<br />
+'''GAR2''' = [https://www.music-ir.org/mirex/abstracts/2007/QBSH_SMS_gomez.pdf Carlos Gómez, Soraya Abad-Mota, Edna Ruckhaus 2]<br />
 '''AP1''' = [https://www.music-ir.org/mirex/abstracts/2007/SMS_pinto.pdf Alberto Pinto 1]<br />
 '''AP2''' = [https://www.music-ir.org/mirex/abstracts/2007/SMS_pinto.pdf Alberto Pinto 2]<br />

@@ Line 23: / Line 23: @@
 ===General Legend===
 ====Team ID====
-'''FHAR''' = [https://www.music-ir.org/mirex/abs/2007/SMS_ferraro.pdf Pascal Ferraro, Pierre Hanna, Julien Allali, Matthias Robine]<br />
+'''FHAR''' = [https://www.music-ir.org/mirex/abstracts/2007/SMS_ferraro.pdf Pascal Ferraro, Pierre Hanna, Julien Allali, Matthias Robine]<br />
-'''GAR1''' = [https://www.music-ir.org/mirex/abs/2007/QBSH_SMS_gomez.pdf Carlos G├│mez, Soraya Abad-Mota, Edna Ruckhaus 1]<br />
+'''GAR1''' = [https://www.music-ir.org/mirex/abstracts/2007/QBSH_SMS_gomez.pdf Carlos G├│mez, Soraya Abad-Mota, Edna Ruckhaus 1]<br />
-'''GAR2''' = [https://www.music-ir.org/mirex/abs/2007/QBSH_SMS_gomez.pdf Carlos G├│mez, Soraya Abad-Mota, Edna Ruckhaus 2]<br />
+'''GAR2''' = [https://www.music-ir.org/mirex/abstracts/2007/QBSH_SMS_gomez.pdf Carlos G├│mez, Soraya Abad-Mota, Edna Ruckhaus 2]<br />
-'''AP1''' = [https://www.music-ir.org/mirex/abs/2007/SMS_pinto.pdf Alberto Pinto 1]<br />
+'''AP1''' = [https://www.music-ir.org/mirex/abstracts/2007/SMS_pinto.pdf Alberto Pinto 1]<br />
-'''AP2''' = [https://www.music-ir.org/mirex/abs/2007/SMS_pinto.pdf Alberto Pinto 2]<br />
+'''AP2''' = [https://www.music-ir.org/mirex/abstracts/2007/SMS_pinto.pdf Alberto Pinto 2]<br />
-'''AU1''' = [https://www.music-ir.org/mirex/abs/2007/QBSH_SMS_uitdenbogerd.pdf Alexandra L. Uitdenbogerd 1]<br />
+'''AU1''' = [https://www.music-ir.org/mirex/abstracts/2007/QBSH_SMS_uitdenbogerd.pdf Alexandra L. Uitdenbogerd 1]<br />
-'''AU2''' = [https://www.music-ir.org/mirex/abs/2007/QBSH_SMS_uitdenbogerd.pdf Alexandra L. Uitdenbogerd 2]<br />
+'''AU2''' = [https://www.music-ir.org/mirex/abstracts/2007/QBSH_SMS_uitdenbogerd.pdf Alexandra L. Uitdenbogerd 2]<br />
-'''AU3''' = [https://www.music-ir.org/mirex/abs/2007/QBSH_SMS_uitdenbogerd.pdf Alexandra L. Uitdenbogerd 3]<br />
+'''AU3''' = [https://www.music-ir.org/mirex/abstracts/2007/QBSH_SMS_uitdenbogerd.pdf Alexandra L. Uitdenbogerd 3]<br />
 ====Broad Categories====

@@ Line 55: / Line 55: @@
 ==Summary Results==
 ===Run Times===
-<csv>sms_runtimes.csv</csv>
+<csv>2007/sms_runtimes.csv</csv>
 ===Overall Scores (Includes Perfect and Error Candidates)===
-<csv>SMS07_overall_norm.csv</csv>
+<csv>2007/SMS07_overall_norm.csv</csv>
 ===Overall Summaries (Presented by Error Types)===
-<csv>SMS07_errors_norm.csv</csv>
+<csv>2007/SMS07_errors_norm.csv</csv>
 ===Friedman Test with Multiple Comparisons Results (p=0.05)===
 The Friedman test was run in MATLAB against the Fine summary data over the 100 queries.<br />
 Command: [c,m,h,gnames] = multcompare(stats, 'ctype', 'tukey-kramer','estimate', 'friedman', 'alpha', 0.05);
-<csv>sms07_sum_friedman_fine.csv</csv>
+<csv>2007/sms07_sum_friedman_fine.csv</csv>
-<csv>sms07_detail_friedman_fine.csv</csv>
+<csv>2007/sms07_detail_friedman_fine.csv</csv>
 [[Image:2007 sms fine scores friedmans.png]]

@@ Line 1: / Line 1: @@
 ==Introduction==
-These are the results for the 2007 running of the Symbolic Melodic Similarity task set. For background information about this task set please refer to the [[Symbolic Melodic Similarity]] page.
+These are the results for the 2007 running of the Symbolic Melodic Similarity task set. For background information about this task set please refer to the [[2007:Symbolic Melodic Similarity]] page.
 Each system was given a query and returned the 10 most melodically similar songs from those taken from the Essen Collection (5274 pieces in the MIDI format; see [http://www.esac-data.org/  ESAC Data Homepage] for more information). For each query, we made four classes of error-mutations, thus the set comprises the following query classes:
@@ Line 72: / Line 72: @@
 ==Raw Scores==
-The raw data derived from the Evalutron 6000 human evaluations are located on the [[Symbolic Melodic Similarity Raw Data]] page.
+The raw data derived from the Evalutron 6000 human evaluations are located on the [[2007:Symbolic Melodic Similarity Raw Data]] page.
 [[Category: Results]]

@@ Line 23: / Line 23: @@
 ===General Legend===
 ====Team ID====
-'''FHAR''' = [https://www.music-ir.org/mirex2007/abs/SMS_ferraro.pdf Pascal Ferraro, Pierre Hanna, Julien Allali, Matthias Robine]<br />
+'''FHAR''' = [https://www.music-ir.org/mirex/2007/abs/SMS_ferraro.pdf Pascal Ferraro, Pierre Hanna, Julien Allali, Matthias Robine]<br />
-'''GAR1''' = [https://www.music-ir.org/mirex2007/abs/QBSH_SMS_gomez.pdf Carlos G├│mez, Soraya Abad-Mota, Edna Ruckhaus 1]<br />
+'''GAR1''' = [https://www.music-ir.org/mirex/2007/abs/QBSH_SMS_gomez.pdf Carlos G├│mez, Soraya Abad-Mota, Edna Ruckhaus 1]<br />
-'''GAR2''' = [https://www.music-ir.org/mirex2007/abs/QBSH_SMS_gomez.pdf Carlos G├│mez, Soraya Abad-Mota, Edna Ruckhaus 2]<br />
+'''GAR2''' = [https://www.music-ir.org/mirex/2007/abs/QBSH_SMS_gomez.pdf Carlos G├│mez, Soraya Abad-Mota, Edna Ruckhaus 2]<br />
-'''AP1''' = [https://www.music-ir.org/mirex2007/abs/SMS_pinto.pdf Alberto Pinto 1]<br />
+'''AP1''' = [https://www.music-ir.org/mirex/2007/abs/SMS_pinto.pdf Alberto Pinto 1]<br />
-'''AP2''' = [https://www.music-ir.org/mirex2007/abs/SMS_pinto.pdf Alberto Pinto 2]<br />
+'''AP2''' = [https://www.music-ir.org/mirex/2007/abs/SMS_pinto.pdf Alberto Pinto 2]<br />
-'''AU1''' = [https://www.music-ir.org/mirex2007/abs/QBSH_SMS_uitdenbogerd.pdf Alexandra L. Uitdenbogerd 1]<br />
+'''AU1''' = [https://www.music-ir.org/mirex/2007/abs/QBSH_SMS_uitdenbogerd.pdf Alexandra L. Uitdenbogerd 1]<br />
-'''AU2''' = [https://www.music-ir.org/mirex2007/abs/QBSH_SMS_uitdenbogerd.pdf Alexandra L. Uitdenbogerd 2]<br />
+'''AU2''' = [https://www.music-ir.org/mirex/2007/abs/QBSH_SMS_uitdenbogerd.pdf Alexandra L. Uitdenbogerd 2]<br />
-'''AU3''' = [https://www.music-ir.org/mirex2007/abs/QBSH_SMS_uitdenbogerd.pdf Alexandra L. Uitdenbogerd 3]<br />
+'''AU3''' = [https://www.music-ir.org/mirex/2007/abs/QBSH_SMS_uitdenbogerd.pdf Alexandra L. Uitdenbogerd 3]<br />
 ====Broad Categories====