2005:Audio Onset Detection Results

From MIREX Wiki
Revision as of 18:07, 29 July 2010 by Singh14 (talk | contribs) (Introduction)

Introduction

OVERALL
Rank Participant Overall Average F-measure Overall Average Precision Overall Average Recall Total Correct Total False Positives Total False Negatives Total Merged Total Doubled Average Correct Average False Positives Average False Negatives Average Merged Average Doubled Mean Absolute Distance Mean Distance Runtime (s) Machine
1 Lacoste & Eck 2 80.07% 79.27% 83.70% 7974 1776 1525 210 53 26.82 6.05 4.85 0.65 0.17 0.0115 0.00613 4713 G
2 Lacoste & Eck 1 78.35% 77.69% 83.27% 7884 2317 1615 202 60 26.55 7.91 5.12 0.62 0.19 0.0115 0.00572 1022 G
3 Ricard, J. 74.80% 81.36% 73.70% 7099 1581 2400 200 3 23.97 5.18 7.70 0.63 0.01 0.0138 0.00593 154 R
4 Brossier, P. 74.72% 74.07% 81.95% 7699 3101 1800 204 54 25.81 10.71 5.86 0.62 0.15 0.0111 0.00384 50 B0
5 Röbel, A. 2 74.64% 83.93% 71.00% 6555 1026 2944 163 169 22.62 3.46 9.05 0.51 0.52 0.0084 0.00380 159 L
6 Collins, N. 72.10% 87.96% 68.26% 6174 629 3325 168 35 21.27 2.13 10.40 0.52 0.12 0.0069 0.00120 12 I
7 Röbel, A. 1 69.57% 79.16% 68.60% 6215 1419 3284 154 253 21.40 5.05 10.27 0.48 0.88 0.0087 0.00525 158 L
8 Pertusa, Klapuri, & Iñesta 58.92% 60.01% 61.62% 5704 4548 3795 217 61 19.41 15.08 12.25 0.73 0.18 0.0276 0.02209 56 F
9 West, K. 48.77% 48.50% 56.29% 5424 7119 4075 146 0 18.46 24.05 13.21 0.46 0.0 0.0138 0.00499 179 F

Note: Overall Average F-Measure, Overall Average Precision and Overall Average Recall are weighted by number of files in each class; Total Correct, Total False Positive, Total False Negative, Total Merged, and Total Doubled are over ground-truths and classes; Average Correct, Average False Positive, Average False Negative, Average Merged, and Average Doubled are averaged over ground-truths, then weighted average across classes;


For the following tables: Average F-Measure, Average Precision and Average Recall are across all Ground-truths and Files in each class; Total Correct, Total False Positive, Total False Negative, Total Merged, and Total Doubled are across all Ground-truths and Files in each class; Average Correct, Average False Positive, Average False Negative, Average Merged, and Average Doubled are across all Ground-truths, total over Files in each class;

COMPLEX (15 files)
Rank Participant Average F-measure Average Precision Average Recall Total Correct Total False Positives Total False Negatives Total Merged Total Doubled Average Correct Average False Positives Average False Negatives Average Merged Average Doubled
1 Lacoste & Eck 2 78.85% 81.37% 77.82% 2836 584 723 109 23 567.20 116.80 144.60 21.80 4.60
2 Lacoste & Eck 1 77.02% 78.92% 77.46% 2786 749 773 107 32 557.20 149.80 154.60 21.40 6.40
3 Brossier, P. 76.16% 77.55% 77.89% 2793 927 766 115 42 558.60 185.40 153.20 23.00 8.40
4 Ricard, J. 71.90% 77.51% 68.20% 2465 650 1094 97 3 493.60 130.00 218.80 19.40 0.60
5 Röbel, A. 2 62.84% 82.39% 53.58% 1968 357 1591 85 92 393.60 71.40 318.20 17.00 18.40
6 Collins, N. 60.25% 86.14% 51.77% 1878 212 1681 87 13 375.60 42.40 336.20 17.40 2.60
7 Röbel, A. 1 59.76% 79.58% 52.66% 1897 328 1662 80 70 379.40 65.60 332.40 16.00 14.00
8 Pertusa, Klapuri, & Iñesta 50.16% 51.69% 51.22% 1884 1756 1675 80 40 376.80 351.20 355.30 16.00 8.00
9 West, K. 47.13% 47.45% 51.52% 1794 2466 1765 72 0 358.80 493.20 353.00 14.40 0.00
POLY-PITCHED (10 files)
Rank Participant Average F-measure Average Precision Average Recall Total Correct Total False Positives Total False Negatives Total Merged Total Doubled Average Correct Average False Positives Average False Negatives Average Merged Average Doubled
1 Lacoste & Eck 2 86.31% 86.71% 88.73% 764 100 95 26 2 254.67 33.33 31.67 8.67 0.67
2 Lacoste & Eck 1 85.93% 85.65% 88.94% 764 115 95 28 5 254.67 38.33 31.67 9.33 1.67
3 Ricard, J. 83.26% 90.12% 80.11% 677 82 182 27 0 225.67 27.33 60.67 9.00 0.00
4 Brossier, P. 80.88% 76.95% 89.41% 759 192 100 27 4 253.00 64.00 33.33 9.00 1.33
5 Röbel, A. 2 76.24% 88.93% 69.02% 593 58 266 19 4 197.67 19.33 88.67 6.33 1.33
6 Collins, N. 75.70% 89.95% 69.98% 570 54 289 19 0 190.00 18.00 96.33 6.33 0.00
7 Röbel, A. 1 69.29% 75.00% 72.87% 616 281 243 19 23 205.33 93.67 81.00 6.33 7.67
8 Pertusa, Klapuri, & Iñesta 59.37% 60.03% 58.30% 479 328 380 15 3 159.67 109.33 126.67 5.00 1.00
9 West, K. 39.98% 34.71% 54.01% 483 906 376 18 0 161.00 302.00 125.33 6.00 0.00
SOLO-BARS-AND-BELLS (4 files)
Rank Participant Average F-measure Average Precision Average Recall Total Correct Total False Positives Total False Negatives Total Merged Total Doubled Average Correct Average False Positives Average False Negatives Average Merged Average Doubled
1 Collins, N. 99.28% 98.91% 99.67% 321 3 3 0 0 107.00 1.00 1.00 0.00 0.00
2 Röbel, A. 1 97.92% 96.15% 100.00% 324 12 0 0 0 108.00 4.00 0.00 0.00 0.00
3 Röbel, A. 2. 90.34% 100.00% 84.07% 297 0 27 0 0 99.00 0.00 9.00 0.00 0.00
4 Ricard, J. 87.17% 81.79% 97.00% 297 18 27 6 0 99.00 6.00 9.00 2.00 0.00
5 Lacoste & Eck 2 86.55% 82.66% 98.33% 309 42 15 3 0 103.00 14.00 5.00 1.00 0.00
6 Lacoste & Eck 1 86.37% 81.67% 99.00% 315 45 9 0 0 105.00 15.00 3.00 0.00 0.00
7 Brossier, P. 73.97% 66.08% 99.33% 318 198 6 1 0 106.00 66.00 2.00 0.33 0.00
8 Pertusa, Klapuri, & Iñesta 60.22% 60.98% 68.39% 231 78 93 18 0 77.00 26.00 31.00 6.00 0.00
9 West, K. 34.58% 36.49% 51.89% 189 324 135 1 0 63.00 108.00 45.00 0.33 0.00