Difference between revisions of "2005:Symbolic Melodic Similarity Results"
From MIREX Wiki
(Created page with '==Introduction== ''' Goal:''' To retrieve the most similar incipits from the RISM A/II collection, given one of the incipits as a query. '''Dataset:''' 558 MusicXML files of the…') |
|||
| Line 4: | Line 4: | ||
'''Dataset:''' 558 MusicXML files of the incipits from the RISM collection. 11 incipits of this collection are chosen as queries. These MusicXML files were converted to MIDI files. | '''Dataset:''' 558 MusicXML files of the incipits from the RISM collection. 11 incipits of this collection are chosen as queries. These MusicXML files were converted to MIDI files. | ||
| + | ==Result== | ||
The scores reported here are averaged over the 11 queries. | The scores reported here are averaged over the 11 queries. | ||
| Line 21: | Line 22: | ||
|---- | |---- | ||
|1 | |1 | ||
| − | |Grachten, Arcos & Mántaras | + | |[https://www.music-ir.org/mirex/abstracts/2005/grachten.pdf Grachten, Arcos & Mántaras] |
|65.98% | |65.98% | ||
|55.24% | |55.24% | ||
| Line 32: | Line 33: | ||
|---- | |---- | ||
|2 | |2 | ||
| − | |Orio, N. | + | |[https://www.music-ir.org/mirex/abstracts/2005/orio.pdf Orio, N.] |
|64.96% | |64.96% | ||
|53.35% | |53.35% | ||
| Line 43: | Line 44: | ||
|---- | |---- | ||
|3 | |3 | ||
| − | |Suyoto & Uitdenbogerd | + | |[https://www.music-ir.org/mirex/abstracts/2005/suyoto.pdf Suyoto & Uitdenbogerd] |
|64.18% | |64.18% | ||
|51.79% | |51.79% | ||
| Line 54: | Line 55: | ||
|---- | |---- | ||
|4 | |4 | ||
| − | |Typke, Wiering & Veltkamp | + | |[https://www.music-ir.org/mirex/abstracts/2005/typke.pdf Typke, Wiering & Veltkamp] |
|57.09% | |57.09% | ||
|48.17% | |48.17% | ||
| Line 65: | Line 66: | ||
|---- | |---- | ||
|5 | |5 | ||
| − | |Lemström, Mikkilä, Mäkinen & Ukkonen (P3) | + | |[https://www.music-ir.org/mirex/abstracts/2005/mikkila.pdf Lemström, Mikkilä, Mäkinen & Ukkonen (P3)] |
|55.82% | |55.82% | ||
|46.56% | |46.56% | ||
| Line 76: | Line 77: | ||
|---- | |---- | ||
|6 | |6 | ||
| − | |Lemström, Mikkilä, Mäkinen & Ukkonen (DP) | + | |[https://www.music-ir.org/mirex/abstracts/2005/mikkila.pdf Lemström, Mikkilä, Mäkinen & Ukkonen (DP)] |
|54.27% | |54.27% | ||
|47.26% | |47.26% | ||
| Line 87: | Line 88: | ||
|---- | |---- | ||
|7 | |7 | ||
| − | |Frieler & Müllensiefen | + | |[https://www.music-ir.org/mirex/abstracts/2005/frieler.pdf Frieler & Müllensiefen] |
|51.81% | |51.81% | ||
|45.10% | |45.10% | ||
Revision as of 14:45, 31 July 2010
Introduction
Goal: To retrieve the most similar incipits from the RISM A/II collection, given one of the incipits as a query.
Dataset: 558 MusicXML files of the incipits from the RISM collection. 11 incipits of this collection are chosen as queries. These MusicXML files were converted to MIDI files.
Result
The scores reported here are averaged over the 11 queries.
| Rank | Participant | Average Dynamic Recall | Normalized Recall at Group Boundaries | Average precision (non-interpolated) | Precision at N documents (N is number of relevant document) | Input Data Format | Runtime (s) | Machine | Detailed Evaluation Result |
|---|---|---|---|---|---|---|---|---|---|
| 1 | Grachten, Arcos & Mántaras | 65.98% | 55.24% | 51.72% | 44.33% | MIDI | 80.174 * | B0 | GAM_eval.txt |
| 2 | Orio, N. | 64.96% | 53.35% | 42.96% | 39.86% | XML | 24.610 | B4 | O_eval.txt |
| 3 | Suyoto & Uitdenbogerd | 64.18% | 51.79% | 40.42% | 41.72% | MIDI | 48.133 | B3 | SU_eval.txt |
| 4 | Typke, Wiering & Veltkamp | 57.09% | 48.17% | 35.64% | 33.46% | MIDI | 51240 | B4 | TWV_eval.txt |
| 5 | Lemström, Mikkilä, Mäkinen & Ukkonen (P3) | 55.82% | 46.56% | 41.40% | 39.18% | MIDI | 10.007 * | B0 | LMMU_P3_eval.txt |
| 6 | Lemström, Mikkilä, Mäkinen & Ukkonen (DP) | 54.27% | 47.26% | 39.91% | 36.20% | MIDI | 10.106 * | B0 | LMMU_DP_eval.txt |
| 7 | Frieler & Müllensiefen | 51.81% | 45.10% | 33.93% | 33.71% | MIDI | 54.593 | B4 | FM_eval.txt |
