Difference between revisions of "2005:Symbolic Melodic Similarity Results"
From MIREX Wiki
(→Result) |
|||
| Line 30: | Line 30: | ||
|80.174 * | |80.174 * | ||
|B0 | |B0 | ||
| − | |GAM_eval.txt | + | |[https://www.music-ir.org/mirex/results/2005/sym-melody/GAM_eval.txt GAM_eval.txt] |
|---- | |---- | ||
|2 | |2 | ||
| Line 41: | Line 41: | ||
|24.610 | |24.610 | ||
|B4 | |B4 | ||
| − | |O_eval.txt | + | |[https://www.music-ir.org/mirex/results/2005/sym-melody/O_eval.txt O_eval.txt] |
|---- | |---- | ||
|3 | |3 | ||
| Line 52: | Line 52: | ||
|48.133 | |48.133 | ||
|B3 | |B3 | ||
| − | |SU_eval.txt | + | |[https://www.music-ir.org/mirex/results/2005/sym-melody/SU_eval.txt SU_eval.txt] |
|---- | |---- | ||
|4 | |4 | ||
| Line 63: | Line 63: | ||
|51240 | |51240 | ||
|B4 | |B4 | ||
| − | |TWV_eval.txt | + | |[https://www.music-ir.org/mirex/results/2005/sym-melody/TWV_eval.txt TWV_eval.txt] |
|---- | |---- | ||
|5 | |5 | ||
| Line 74: | Line 74: | ||
|10.007 * | |10.007 * | ||
|B0 | |B0 | ||
| − | |LMMU_P3_eval.txt | + | |[https://www.music-ir.org/mirex/results/2005/sym-melody/LMMU_P3_eval.txt LMMU_P3_eval.txt] |
|---- | |---- | ||
|6 | |6 | ||
| Line 85: | Line 85: | ||
|10.106 * | |10.106 * | ||
|B0 | |B0 | ||
| − | |LMMU_DP_eval.txt | + | |[https://www.music-ir.org/mirex/results/2005/sym-melody/LMMU_DP_eval.txt LMMU_DP_eval.txt] |
|---- | |---- | ||
|7 | |7 | ||
| Line 96: | Line 96: | ||
|54.593 | |54.593 | ||
|B4 | |B4 | ||
| − | |FM_eval.txt | + | |[https://www.music-ir.org/mirex/results/2005/sym-melody/FM_eval.txt FM_eval.txt] |
|---- | |---- | ||
|} | |} | ||
Revision as of 14:48, 31 July 2010
Introduction
Goal: To retrieve the most similar incipits from the RISM A/II collection, given one of the incipits as a query.
Dataset: 558 MusicXML files of the incipits from the RISM collection. 11 incipits of this collection are chosen as queries. These MusicXML files were converted to MIDI files.
Result
The scores reported here are averaged over the 11 queries.
| Rank | Participant | Average Dynamic Recall | Normalized Recall at Group Boundaries | Average precision (non-interpolated) | Precision at N documents (N is number of relevant document) | Input Data Format | Runtime (s) | Machine | Detailed Evaluation Result |
|---|---|---|---|---|---|---|---|---|---|
| 1 | Grachten, Arcos & Mántaras | 65.98% | 55.24% | 51.72% | 44.33% | MIDI | 80.174 * | B0 | GAM_eval.txt |
| 2 | Orio, N. | 64.96% | 53.35% | 42.96% | 39.86% | XML | 24.610 | B4 | O_eval.txt |
| 3 | Suyoto & Uitdenbogerd | 64.18% | 51.79% | 40.42% | 41.72% | MIDI | 48.133 | B3 | SU_eval.txt |
| 4 | Typke, Wiering & Veltkamp | 57.09% | 48.17% | 35.64% | 33.46% | MIDI | 51240 | B4 | TWV_eval.txt |
| 5 | Lemström, Mikkilä, Mäkinen & Ukkonen (P3) | 55.82% | 46.56% | 41.40% | 39.18% | MIDI | 10.007 * | B0 | LMMU_P3_eval.txt |
| 6 | Lemström, Mikkilä, Mäkinen & Ukkonen (DP) | 54.27% | 47.26% | 39.91% | 36.20% | MIDI | 10.106 * | B0 | LMMU_DP_eval.txt |
| 7 | Frieler & Müllensiefen | 51.81% | 45.10% | 33.93% | 33.71% | MIDI | 54.593 | B4 | FM_eval.txt |
