2005:Audio Onset Detection Results
Introduction
OVERALL | ||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Rank | Participant | Overall Average F-measure | Overall Average Precision | Overall Average Recall | Total Correct | Total False Positives | Total False Negatives | Total Merged | Total Doubled | Average Correct | Average False Positives | Average False Negatives | Average Merged | Average Doubled | Mean Absolute Distance | Mean Distance | Runtime (s) | Machine |
1 | Lacoste & Eck 2 | 80.07% | 79.27% | 83.70% | 7974 | 1776 | 1525 | 210 | 53 | 26.82 | 6.05 | 4.85 | 0.65 | 0.17 | 0.0115 | 0.00613 | 4713 | G |
2 | Lacoste & Eck 1 | 78.35% | 77.69% | 83.27% | 7884 | 2317 | 1615 | 202 | 60 | 26.55 | 7.91 | 5.12 | 0.62 | 0.19 | 0.0115 | 0.00572 | 1022 | G |
3 | Ricard, J. | 74.80% | 81.36% | 73.70% | 7099 | 1581 | 2400 | 200 | 3 | 23.97 | 5.18 | 7.70 | 0.63 | 0.01 | 0.0138 | 0.00593 | 154 | R |
4 | Brossier, P. | 74.72% | 74.07% | 81.95% | 7699 | 3101 | 1800 | 204 | 54 | 25.81 | 10.71 | 5.86 | 0.62 | 0.15 | 0.0111 | 0.00384 | 50 | B0 |
5 | Röbel, A. 2 | 74.64% | 83.93% | 71.00% | 6555 | 1026 | 2944 | 163 | 169 | 22.62 | 3.46 | 9.05 | 0.51 | 0.52 | 0.0084 | 0.00380 | 159 | L |
6 | Collins, N. | 72.10% | 87.96% | 68.26% | 6174 | 629 | 3325 | 168 | 35 | 21.27 | 2.13 | 10.40 | 0.52 | 0.12 | 0.0069 | 0.00120 | 12 | I |
7 | Röbel, A. 1 | 69.57% | 79.16% | 68.60% | 6215 | 1419 | 3284 | 154 | 253 | 21.40 | 5.05 | 10.27 | 0.48 | 0.88 | 0.0087 | 0.00525 | 158 | L |
8 | Pertusa, Klapuri, & Iñesta | 58.92% | 60.01% | 61.62% | 5704 | 4548 | 3795 | 217 | 61 | 19.41 | 15.08 | 12.25 | 0.73 | 0.18 | 0.0276 | 0.02209 | 56 | F |
9 | West, K. | 48.77% | 48.50% | 56.29% | 5424 | 7119 | 4075 | 146 | 0 | 18.46 | 24.05 | 13.21 | 0.46 | 0.0 | 0.0138 | 0.00499 | 179 | F |
Note: Overall Average F-Measure, Overall Average Precision and Overall Average Recall are weighted by number of files in each class; Total Correct, Total False Positive, Total False Negative, Total Merged, and Total Doubled are over ground-truths and classes; Average Correct, Average False Positive, Average False Negative, Average Merged, and Average Doubled are averaged over ground-truths, then weighted average across classes;
For the following tables: Average F-Measure, Average Precision and Average Recall are across all Ground-truths and Files in each class;
Total Correct, Total False Positive, Total False Negative, Total Merged, and Total Doubled are across all Ground-truths and Files in each class;
Average Correct, Average False Positive, Average False Negative, Average Merged, and Average Doubled are across all Ground-truths, total over Files in each class;
COMPLEX (15 files) | ||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Rank | Participant | Average F-measure | Average Precision | Average Recall | Total Correct | Total False Positives | Total False Negatives | Total Merged | Total Doubled | Average Correct | Average False Positives | Average False Negatives | Average Merged | Average Doubled |
1 | Lacoste & Eck 2 | 78.85% | 81.37% | 77.82% | 2836 | 584 | 723 | 109 | 23 | 567.20 | 116.80 | 144.60 | 21.80 | 4.60 |
2 | Lacoste & Eck 1 | 77.02% | 78.92% | 77.46% | 2786 | 749 | 773 | 107 | 32 | 557.20 | 149.80 | 154.60 | 21.40 | 6.40 |
3 | Brossier, P. | 76.16% | 77.55% | 77.89% | 2793 | 927 | 766 | 115 | 42 | 558.60 | 185.40 | 153.20 | 23.00 | 8.40 |
4 | Ricard, J. | 71.90% | 77.51% | 68.20% | 2465 | 650 | 1094 | 97 | 3 | 493.60 | 130.00 | 218.80 | 19.40 | 0.60 |
5 | Röbel, A. 2 | 62.84% | 82.39% | 53.58% | 1968 | 357 | 1591 | 85 | 92 | 393.60 | 71.40 | 318.20 | 17.00 | 18.40 |
6 | Collins, N. | 60.25% | 86.14% | 51.77% | 1878 | 212 | 1681 | 87 | 13 | 375.60 | 42.40 | 336.20 | 17.40 | 2.60 |
7 | Röbel, A. 1 | 59.76% | 79.58% | 52.66% | 1897 | 328 | 1662 | 80 | 70 | 379.40 | 65.60 | 332.40 | 16.00 | 14.00 |
8 | Pertusa, Klapuri, & Iñesta | 50.16% | 51.69% | 51.22% | 1884 | 1756 | 1675 | 80 | 40 | 376.80 | 351.20 | 355.30 | 16.00 | 8.00 |
9 | West, K. | 47.13% | 47.45% | 51.52% | 1794 | 2466 | 1765 | 72 | 0 | 358.80 | 493.20 | 353.00 | 14.40 | 0.00 |
POLY-PITCHED (10 files) | ||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Rank | Participant | Average F-measure | Average Precision | Average Recall | Total Correct | Total False Positives | Total False Negatives | Total Merged | Total Doubled | Average Correct | Average False Positives | Average False Negatives | Average Merged | Average Doubled |
1 | Lacoste & Eck 2 | 86.31% | 86.71% | 88.73% | 764 | 100 | 95 | 26 | 2 | 254.67 | 33.33 | 31.67 | 8.67 | 0.67 |
2 | Lacoste & Eck 1 | 85.93% | 85.65% | 88.94% | 764 | 115 | 95 | 28 | 5 | 254.67 | 38.33 | 31.67 | 9.33 | 1.67 |
3 | Ricard, J. | 83.26% | 90.12% | 80.11% | 677 | 82 | 182 | 27 | 0 | 225.67 | 27.33 | 60.67 | 9.00 | 0.00 |
4 | Brossier, P. | 80.88% | 76.95% | 89.41% | 759 | 192 | 100 | 27 | 4 | 253.00 | 64.00 | 33.33 | 9.00 | 1.33 |
5 | Röbel, A. 2 | 76.24% | 88.93% | 69.02% | 593 | 58 | 266 | 19 | 4 | 197.67 | 19.33 | 88.67 | 6.33 | 1.33 |
6 | Collins, N. | 75.70% | 89.95% | 69.98% | 570 | 54 | 289 | 19 | 0 | 190.00 | 18.00 | 96.33 | 6.33 | 0.00 |
7 | Röbel, A. 1 | 69.29% | 75.00% | 72.87% | 616 | 281 | 243 | 19 | 23 | 205.33 | 93.67 | 81.00 | 6.33 | 7.67 |
8 | Pertusa, Klapuri, & Iñesta | 59.37% | 60.03% | 58.30% | 479 | 328 | 380 | 15 | 3 | 159.67 | 109.33 | 126.67 | 5.00 | 1.00 |
9 | West, K. | 39.98% | 34.71% | 54.01% | 483 | 906 | 376 | 18 | 0 | 161.00 | 302.00 | 125.33 | 6.00 | 0.00 |
SOLO-BARS-AND-BELLS (4 files) | ||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Rank | Participant | Average F-measure | Average Precision | Average Recall | Total Correct | Total False Positives | Total False Negatives | Total Merged | Total Doubled | Average Correct | Average False Positives | Average False Negatives | Average Merged | Average Doubled |
1 | Collins, N. | 99.28% | 98.91% | 99.67% | 321 | 3 | 3 | 0 | 0 | 107.00 | 1.00 | 1.00 | 0.00 | 0.00 |
2 | Röbel, A. 1 | 97.92% | 96.15% | 100.00% | 324 | 12 | 0 | 0 | 0 | 108.00 | 4.00 | 0.00 | 0.00 | 0.00 |
3 | Röbel, A. 2. | 90.34% | 100.00% | 84.07% | 297 | 0 | 27 | 0 | 0 | 99.00 | 0.00 | 9.00 | 0.00 | 0.00 |
4 | Ricard, J. | 87.17% | 81.79% | 97.00% | 297 | 18 | 27 | 6 | 0 | 99.00 | 6.00 | 9.00 | 2.00 | 0.00 |
5 | Lacoste & Eck 2 | 86.55% | 82.66% | 98.33% | 309 | 42 | 15 | 3 | 0 | 103.00 | 14.00 | 5.00 | 1.00 | 0.00 |
6 | Lacoste & Eck 1 | 86.37% | 81.67% | 99.00% | 315 | 45 | 9 | 0 | 0 | 105.00 | 15.00 | 3.00 | 0.00 | 0.00 |
7 | Brossier, P. | 73.97% | 66.08% | 99.33% | 318 | 198 | 6 | 1 | 0 | 106.00 | 66.00 | 2.00 | 0.33 | 0.00 |
8 | Pertusa, Klapuri, & Iñesta | 60.22% | 60.98% | 68.39% | 231 | 78 | 93 | 18 | 0 | 77.00 | 26.00 | 31.00 | 6.00 | 0.00 |
9 | West, K. | 34.58% | 36.49% | 51.89% | 189 | 324 | 135 | 1 | 0 | 63.00 | 108.00 | 45.00 | 0.33 | 0.00 |