Revision as of 17:59, 29 July 2010
Introduction
OVERALL
|
Rank
|
Participant
|
Overall Average F-measure
|
Overall Average Precision
|
Overall Average Recall
|
Total Correct
|
Total False Positives
|
Total False Negatives
|
Total Merged
|
Total Doubled
|
Average Correct
|
Average False Positives
|
Average False Negatives
|
Average Merged
|
Average Doubled
|
Mean Absolute Distance
|
Mean Distance
|
Runtime (s)
|
Machine
|
1
|
Lacoste & Eck 2
|
80.07%
|
79.27%
|
83.70%
|
7974
|
1776
|
1525
|
210
|
53
|
26.82
|
6.05
|
4.85
|
0.65
|
0.17
|
0.0115
|
0.00613
|
4713
|
G
|
2
|
Lacoste & Eck 1
|
78.35%
|
77.69%
|
83.27%
|
7884
|
2317
|
1615
|
202
|
60
|
26.55
|
7.91
|
5.12
|
0.62
|
0.19
|
0.0115
|
0.00572
|
1022
|
G
|
3
|
Ricard, J.
|
74.80%
|
81.36%
|
73.70%
|
7099
|
1581
|
2400
|
200
|
3
|
23.97
|
5.18
|
7.70
|
0.63
|
0.01
|
0.0138
|
0.00593
|
154
|
R
|
4
|
Brossier, P.
|
74.72%
|
74.07%
|
81.95%
|
7699
|
3101
|
1800
|
204
|
54
|
25.81
|
10.71
|
5.86
|
0.62
|
0.15
|
0.0111
|
50
|
B0
|
5
|
Röbel, A. 2
|
74.64%
|
83.93%
|
71.00%
|
6555
|
1026
|
2944
|
163
|
169
|
22.62
|
3.46
|
9.05
|
0.51
|
0.52
|
0.0084
|
0.00380
|
159
|
L
|
6
|
Collins, N.
|
72.10%
|
87.96%
|
68.26%
|
6174
|
629
|
3325
|
168
|
35
|
21.27
|
2.13
|
10.40
|
0.52
|
0.12
|
0.0069
|
12
|
I
|
7
|
Röbel, A. 1
|
69.57%
|
79.16%
|
68.60%
|
6215
|
1419
|
3284
|
154
|
253
|
21.40
|
5.05
|
10.27
|
0.48
|
0.88
|
0.0087
|
0.00525
|
158
|
L
|
8
|
Pertusa, Klapuri, & Iñesta
|
58.92%
|
60.01%
|
61.62%
|
5704
|
4548
|
3795
|
217
|
61
|
19.41
|
15.08
|
12.25
|
0.73
|
0.18
|
0.0276
|
56
|
F
|
9
|
West, K.
|
48.77%
|
48.50%
|
56.29%
|
5424
|
7119
|
4075
|
146
|
0
|
18.46
|
24.05
|
13.21
|
0.46
|
0.0
|
0.0138
|
179
|
F
|
Note: Overall Average F-Measure, Overall Average Precision and Overall Average Recall are weighted by number of files in each class;
Total Correct, Total False Positive, Total False Negative, Total Merged, and Total Doubled are over ground-truths and classes;
Average Correct, Average False Positive, Average False Negative, Average Merged, and Average Doubled are averaged over ground-truths, then weighted average across classes;
For the following tables: Average F-Measure, Average Precision and Average Recall are across all Ground-truths and Files in each class;
Total Correct, Total False Positive, Total False Negative, Total Merged, and Total Doubled are across all Ground-truths and Files in each class;
Average Correct, Average False Positive, Average False Negative, Average Merged, and Average Doubled are across all Ground-truths, total over Files in each class;
COMPLEX (15 files)
|
Rank
|
Participant
|
Average F-measure
|
Average Precision
|
Average Recall
|
Total Correct
|
Total False Positives
|
Total False Negatives
|
Total Merged
|
Total Doubled
|
Average Correct
|
Average False Positives
|
Average False Negatives
|
Average Merged
|
Average Doubled
|
1
|
Lacoste & Eck 2
|
78.85%
|
81.37%
|
77.82%
|
2836
|
584
|
723
|
109
|
23
|
567.20
|
116.80
|
144.60
|
21.80
|
4.60
|
2
|
Lacoste & Eck 1
|
77.02%
|
78.92%
|
77.46%
|
2786
|
749
|
773
|
107
|
32
|
557.20
|
149.80
|
154.60
|
21.40
|
6.40
|
3
|
Brossier, P.
|
76.16%
|
77.55%
|
77.89%
|
2793
|
927
|
766
|
115
|
42
|
558.60
|
185.40
|
153.20
|
23.00
|
8.40
|
4
|
Ricard, J.
|
71.90%
|
77.51%
|
68.20%
|
2465
|
650
|
1094
|
97
|
3
|
493.60
|
130.00
|
218.80
|
19.40
|
0.60
|
5
|
Röbel, A. 2
|
62.84%
|
82.39%
|
53.58%
|
1968
|
357
|
1591
|
85
|
92
|
393.60
|
71.40
|
318.20
|
17.00
|
18.40
|
6
|
Collins, N.
|
60.25%
|
86.14%
|
51.77%
|
1878
|
212
|
1681
|
87
|
13
|
375.60
|
42.40
|
336.20
|
17.40
|
2.60
|
7
|
Röbel, A. 1
|
59.76%
|
79.58%
|
52.66%
|
1897
|
328
|
1662
|
80
|
70
|
379.40
|
65.60
|
332.40
|
16.00
|
14.00
|
8
|
Pertusa, Klapuri, & Iñesta
|
50.16%
|
51.69%
|
51.22%
|
1884
|
1756
|
1675
|
80
|
40
|
376.80
|
351.20
|
355.30
|
16.00
|
8.00
|
9
|
West, K.
|
47.13%
|
47.45%
|
51.52%
|
1794
|
2466
|
1765
|
72
|
0
|
358.80
|
493.20
|
353.00
|
14.40
|
0.00
|
POLY-PITCHED (10 files)
|
Rank
|
Participant
|
Average F-measure
|
Average Precision
|
Average Recall
|
Total Correct
|
Total False Positives
|
Total False Negatives
|
Total Merged
|
Total Doubled
|
Average Correct
|
Average False Positives
|
Average False Negatives
|
Average Merged
|
Average Doubled
|
1
|
Lacoste & Eck 2
|
86.31%
|
86.71%
|
88.73%
|
764
|
100
|
95
|
26
|
2
|
254.67
|
33.33
|
31.67
|
8.67
|
0.67
|
2
|
Lacoste & Eck 1
|
85.93%
|
85.65%
|
88.94%
|
764
|
115
|
95
|
28
|
5
|
254.67
|
38.33
|
31.67
|
9.33
|
1.67
|
3
|
Ricard, J.
|
83.26%
|
90.12%
|
80.11%
|
677
|
82
|
182
|
27
|
0
|
225.67
|
27.33
|
60.67
|
9.00
|
0.00
|
4
|
Brossier, P.
|
80.88%
|
76.95%
|
89.41%
|
759
|
192
|
100
|
27
|
4
|
253.00
|
64.00
|
33.33
|
9.00
|
1.33
|
5
|
Röbel, A. 2
|
76.24%
|
88.93%
|
69.02%
|
593
|
58
|
266
|
19
|
4
|
197.67
|
19.33
|
88.67
|
6.33
|
1.33
|
6
|
Collins, N.
|
75.70%
|
89.95%
|
69.98%
|
570
|
54
|
289
|
19
|
0
|
190.00
|
18.00
|
96.33
|
6.33
|
0.00
|
7
|
Röbel, A. 1
|
69.29%
|
75.00%
|
72.87%
|
616
|
281
|
243
|
19
|
23
|
205.33
|
93.67
|
81.00
|
6.33
|
7.67
|
8
|
Pertusa, Klapuri, & Iñesta
|
59.37%
|
60.03%
|
58.30%
|
479
|
328
|
380
|
15
|
3
|
159.67
|
109.33
|
126.67
|
5.00
|
1.00
|
9
|
West, K.
|
39.98%
|
34.71%
|
54.01%
|
483
|
906
|
376
|
18
|
0
|
161.00
|
302.00
|
125.33
|
6.00
|
0.00
|
SOLO-BARS-AND-BELLS (4 files)
|
Rank
|
Participant
|
Average F-measure
|
Average Precision
|
Average Recall
|
Total Correct
|
Total False Positives
|
Total False Negatives
|
Total Merged
|
Total Doubled
|
Average Correct
|
Average False Positives
|
Average False Negatives
|
Average Merged
|
Average Doubled
|
1
|
Collins, N.
|
99.28%
|
98.91%
|
99.67%
|
321
|
3
|
3
|
0
|
0
|
107.00
|
1.00
|
1.00
|
0.00
|
0.00
|
2
|
Röbel, A. 1
|
97.92%
|
96.15%
|
100.00%
|
324
|
12
|
0
|
0
|
0
|
108.00
|
4.00
|
0.00
|
0.00
|
0.00
|
3
|
Röbel, A. 2.
|
90.34%
|
100.00%
|
84.07%
|
297
|
0
|
27
|
0
|
0
|
99.00
|
0.00
|
9.00
|
0.00
|
0.00
|
4
|
Ricard, J.
|
87.17%
|
81.79%
|
97.00%
|
297
|
18
|
27
|
6
|
0
|
99.00
|
6.00
|
9.00
|
2.00
|
0.00
|
5
|
Lacoste & Eck 2
|
86.55%
|
82.66%
|
98.33%
|
309
|
42
|
15
|
3
|
0
|
103.00
|
14.00
|
5.00
|
1.00
|
0.00
|
6
|
Lacoste & Eck 1
|
86.37%
|
81.67%
|
99.00%
|
315
|
45
|
9
|
0
|
0
|
105.00
|
15.00
|
3.00
|
0.00
|
0.00
|
7
|
Brossier, P.
|
73.97%
|
66.08%
|
99.33%
|
318
|
198
|
6
|
1
|
0
|
106.00
|
66.00
|
2.00
|
0.33
|
0.00
|
8
|
Pertusa, Klapuri, & Iñesta
|
60.22%
|
60.98%
|
68.39%
|
231
|
78
|
93
|
18
|
0
|
77.00
|
26.00
|
31.00
|
6.00
|
0.00
|
9
|
West, K.
|
34.58%
|
36.49%
|
51.89%
|
189
|
324
|
135
|
1
|
0
|
63.00
|
108.00
|
45.00
|
0.33
|
0.00
|