2005:Audio Tempo Extraction Results
From MIREX Wiki
Introduction
Goal: The comparison and evaluation of current methods for the extraction of tempo from musical audio
Dataset: 140 wav files, 354 Megabytes
Results
| Rank | Participant | Score (std. deviation) | At Least One Tempo Correct | Both Tempos Correct | At Least One Phase Correct | Both Phases Correct | Mean Absolute Difference of Scored Saliences | Runtime (s) | Machine |
|---|---|---|---|---|---|---|---|---|---|
| 1 | Alonso, David, & Richard | 0.689 (0.231) | 95.00% | 55.71% | 25.00% | 5.00% | 0.239 | 2875 | G |
| 2 | Uhle, C. (1) | 0.675 (0.273) | 90.71% | 59.29% | 32.14% | 7.14% | 0.222 | 1160 | F |
| 3 | Uhle, C. (2) | 0.675 (0.272) | 90.71% | 59.29% | 32.86% | 6.43% | 0.222 | 2621 | F |
| 4 | Gouyon & Dixon (1) | 0.670 (0.252) | 92.14% | 56.43% | 40.71% | 7.86% | 0.311 | 3303 | G |
| 5 | Peeters, G. | 0.656 (0.223) | 95.71% | 47.86% | 27.86% | 4.29% | 0.258 | 2159 | R |
| 6 | Gouyon & Dixon (2) | 0.649 (0.253) | 92.14% | 51.43% | 37.14% | 5.71% | 0.305 | 2050 | G |
| 7 | Gouyon & Dixon (4) | 0.645 (0.294) | 87.14% | 55.71% | 48.57% | 10.71% | 0.313 | 1357 | G |
| 8 | Eck, D. | 0.644 (0.300) | 86.43% | 53.57% | 37.14% | 5.71% | 0.230 | 1665 | Y |
| 9 | Davies & Brossier | 0.628 (0.284) | 86.43% | 48.57% | 26.43% | 4.29% | 0.224 | 1005 | R |
| 10 | Gouyon & Dixon (3) | 0.607 (0.287) | 87.14% | 47.14% | 36.43% | 6.43% | 0.294 | 1388 | R |
| 11 | Sethares, W. | 0.597 (0.252) | 90.71% | 37.86% | 30.71% | 0.71% | 0.239 | 70975 | Y |
| 12 | Brossier, P. | 0.583 (0.333) | 80.71% | 51.43% | 28.57% | 2.14% | 0.223 | 180 | B 0 |
| 13 | Tzanetakis, G. | 0.538 (0.359) | 71.43% | 50.71% | 28.57% | 3.57% | 0.295 | 7173 | B 0 |
McNemar's Test Results
Statistical probability that algorithms have same error function: Note: Results of less than 5% indicate significant differences, results of 1% or less indicate highly significant differences.
| Tzanetakis, G. | Gouyon & Dixon (3) | Gouyon & Dixon (1) | Gouyon & Dixon (0) | Brossier, P. | Uhle, C. (1) | Uhle, C. (0) | Sethares, B | Peeters, G | Eck, D. | Davies, M. | Alonso, David, & Richard | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Tzanetakis, G. | n/a | |||||||||||
| Gouyon & Dixon (3) | 17.44% | n/a | ||||||||||
| Gouyon & Dixon (1) | 50.00% | 19.58% | n/a | |||||||||
| Gouyon & Dixon (0) | 12.15% | 50.00% | 4.61% | n/a | ||||||||
| Brossier, P. | 50.00% | 23.54% | 55.31% | 20.05% | n/a | |||||||
| Uhle, C. (1) | 2.88% | 26.64% | 6.76% | 31.36% | 5.41% | n/a | ||||||
| Uhle, C. (0) | 2.88% | 26.64% | 6.31% | 30.89% | 5.86% | 75.00% | n/a | |||||
| Sethares, B. | 0.99% | 0.02% | 0.27% | 0.02% | 1.24% | 0.01% | 0.01% | n/a | ||||
| Peeters, G. | 34.70% | 7.19% | 29.83% | 6.32% | 30.73% | 2.40% | 2.40% | 2.97% | n/a | |||
| Eck, D. | 32.58% | 38.04% | 38.54% | 32.20% | 38.54% | 12.15% | 12.15% | 0.41% | 18.32% | n/a | ||
| Davies, M. | 38.77% | 7.17% | 33.59% | 6.31% | 33.89% | 2.67% | 2.67% | 1.38% | 50.00% | 21.35% | n/a | |
| Alsonso, David, & Richard | 18.02% | 56.12% | 23.99% | 50.00% | 23.99% | 26.64% | 26.64% | 0.04% | 7.62% | 39.39% | 6.07% | n/a |
