Difference between revisions of "2007:Audio Onset Detection Results"
Line 1: | Line 1: | ||
− | |||
==Introduction== | ==Introduction== | ||
These are the results for the 2007 running of the Audio Onset Detection task set. For background information about this task set please refer to the [[Audio Onset Detection]] page. | These are the results for the 2007 running of the Audio Onset Detection task set. For background information about this task set please refer to the [[Audio Onset Detection]] page. | ||
Line 10: | Line 9: | ||
====Team ID==== | ====Team ID==== | ||
− | '''lacoste''' = [https://www.music-ir.org/ | + | '''lacoste''' = [https://www.music-ir.org/mirex2007/abs/OD_lacoste.pdf Alexandre Lacoste]<br /> |
− | '''lee''' = [https://www.music-ir.org/ | + | '''lee''' = [https://www.music-ir.org/mirex2007/abs/OD_lee.pdf Wan-Chi Lee, Yu Shiu, & C.-C. Jay Kuo]<br /> |
− | '''roebel''' = [https://www.music-ir.org/ | + | '''roebel''' = [https://www.music-ir.org/mirex2007/abs/OD_roebel.pdf A. R├╢bel]<br /> |
− | '''stowell''' = [https://www.music-ir.org/ | + | '''stowell''' = [https://www.music-ir.org/mirex2007/abs/OD_stowell.pdf Dan Stowell & Mark Plumbley]<br /> |
− | '''zhou''' = [https://www.music-ir.org/ | + | '''zhou''' = [https://www.music-ir.org/mirex2007/abs/OD_zhou.pdf Ruohua Zhou & Joshua D. Reiss]<br /> |
==Overall Summary Results== | ==Overall Summary Results== | ||
Line 57: | Line 56: | ||
*[[Audio_Onset_Detection_Results:_Stowell_-_som]] | *[[Audio_Onset_Detection_Results:_Stowell_-_som]] | ||
*[[Audio_Onset_Detection_Results:_Stowell_-_wpd]] | *[[Audio_Onset_Detection_Results:_Stowell_-_wpd]] | ||
− | *[[Audio_Onset_Detection_Results:_Zhou]] | + | *[[Audio_Onset_Detection_Results:_Zhou]]] |
+ | |||
+ | [[Category: Results]] |
Revision as of 17:58, 15 September 2007
Introduction
These are the results for the 2007 running of the Audio Onset Detection task set. For background information about this task set please refer to the Audio Onset Detection page.
The aim of the Audio Onset Detection task is to find the time locations at which all musical events in a recording begin. The dataset consists of 85 recordings across 9 different "classes" (e.g. solo drums, polyphonic pitched, etc.). For each sound file, ground truth annotations produced by 3-5 listeners were used for the evaluation. Each algorithm was tested across 10-20 different parameterizations (e.g. thresholds) in order to produce Precision vs. Recall Operating Characteristic (P-ROC) curves. The primary evauluation metric used was the F1-Measure (the equal weighted harmonic mean of precision and recall).
- Note: There were a few faulty ground truth annotations in the 2005 and 2006 runs of this task. These have been removed for this year's evaluation. Thanks to Dan Stowell for finding these.
General Legend
Team ID
lacoste = Alexandre Lacoste
lee = Wan-Chi Lee, Yu Shiu, & C.-C. Jay Kuo
roebel = A. R├╢bel
stowell = Dan Stowell & Mark Plumbley
zhou = Ruohua Zhou & Joshua D. Reiss
Overall Summary Results
MIREX 2007 Audio Onset Detection Summary Results - Peak F-measure performance across all parameterizations
file /nema-raid/www/mirex/results/onset.Total_peak.csv not found
MIREX 2007 Audio Onset Detection Summary Plot
MIREX 2007 Audio Onset Detection Runtime Data
file /nema-raid/www/mirex/results/onset.runtime.csv not found
Results by Class
- Audio_Onset_Detection_Results:_Complex
- Audio_Onset_Detection_Results:_Poly_Pitched
- Audio_Onset_Detection_Results:_Solo_Bars_and_Bells
- Audio_Onset_Detection_Results:_Solo_Brass
- Audio_Onset_Detection_Results:_Solo_Drum
- Audio_Onset_Detection_Results:_Solo_Plucked_Strings
- Audio_Onset_Detection_Results:_Solo_Singing_Voice
- Audio_Onset_Detection_Results:_Solo_Sustained_Strings
- Audio_Onset_Detection_Results:_Solo_Winds
Individual Results
- Audio_Onset_Detection_Results:_Lacoste
- Audio_Onset_Detection_Results:_Lee_-_Joint_-_0.2
- Audio_Onset_Detection_Results:_Lee_-_Joint_-_0.3
- Audio_Onset_Detection_Results:_Lee_-_Joint_-_0.4
- Audio_Onset_Detection_Results:_Lee_-_LP
- Audio_Onset_Detection_Results:_Roebel_1
- Audio_Onset_Detection_Results:_Roebel_2
- Audio_Onset_Detection_Results:_Roebel_3
- Audio_Onset_Detection_Results:_Roebel_4
- Audio_Onset_Detection_Results:_Stowell_-_cd
- Audio_Onset_Detection_Results:_Stowell_-_mkl
- Audio_Onset_Detection_Results:_Stowell_-_pd
- Audio_Onset_Detection_Results:_Stowell_-_pow
- Audio_Onset_Detection_Results:_Stowell_-_rcd
- Audio_Onset_Detection_Results:_Stowell_-_som
- Audio_Onset_Detection_Results:_Stowell_-_wpd
- Audio_Onset_Detection_Results:_Zhou]