Difference between revisions of "2007:Audio Onset Detection Results"
(→Introduction) |
(→Overall Summary Results) |
||
Line 17: | Line 17: | ||
==Overall Summary Results== | ==Overall Summary Results== | ||
− | ===MIREX | + | ===MIREX 2007 Audio Onset Detection Summary Results - Peak F-measure performance across all parameterizations=== |
− | <csv> | + | <csv>onset.Total_peak.csv</csv> |
− | ===MIREX | + | ===MIREX 2007 Audio Onset Detection Summary Plot=== |
− | [[image: | + | [[image:Total.png]] |
− | ===MIREX | + | ===MIREX 2007 Audio Onset Detection Runtime Data=== |
<csv>onset06_runtime.csv</csv> | <csv>onset06_runtime.csv</csv> |
Revision as of 13:44, 15 September 2007
Introduction
These are the results for the 2007 running of the Audio Onset Detection task set. For background information about this task set please refer to the Audio Onset Detection page.
The aim of the Audio Onset Detection task is to find the time locations at which all musical events in a recording begin. The dataset consists of 85 recordings across 9 different "classes" (e.g. solo drums, polyphonic pitched, etc.). For each sound file, ground truth annotations produced by 3-5 listeners were used for the evaluation. Each algorithm was tested across 10-20 different parameterizations (e.g. thresholds) in order to produce Precision vs. Recall Operating Characteristic (P-ROC) curves. The primary evauluation metric used was the F1-Measure (the equal weighted harmonic mean of precision and recall).
- Note: There were a few faulty ground truth annotations in the 2005 and 2006 runs of this task. These have been removed for this year's evaluation. Thanks to Dan Stowell for finding these.
General Legend
Team ID
lacoste = Simon Dixon
lee = Yunfeng Du, Ming Li, Jian Liu
roebel = A. R├╢bel
stowell = Paul Brossier
zhou = Paul Brossier
Overall Summary Results
MIREX 2007 Audio Onset Detection Summary Results - Peak F-measure performance across all parameterizations
file /nema-raid/www/mirex/results/onset.Total_peak.csv not found
MIREX 2007 Audio Onset Detection Summary Plot
MIREX 2007 Audio Onset Detection Runtime Data
file /nema-raid/www/mirex/results/onset06_runtime.csv not found
Results by Class
- Audio_Onset_Detection_Results:_Complex
- Audio_Onset_Detection_Results:_Poly_Pitched
- Audio_Onset_Detection_Results:_Solo_Bars_and_Bells
- Audio_Onset_Detection_Results:_Solo_Brass
- Audio_Onset_Detection_Results:_Solo_Drum
- Audio_Onset_Detection_Results:_Solo_Plucked_Strings
- Audio_Onset_Detection_Results:_Solo_Singing_Voice
- Audio_Onset_Detection_Results:_Solo_Sustained_Strings
- Audio_Onset_Detection_Results:_Solo_Winds
Individual Results
- Audio_Onset_Detection_Results:_Brossier_-_complex
- Audio_Onset_Detection_Results:_Brossier_-_dual
- Audio_Onset_Detection_Results:_Brossier_-_hfc
- Audio_Onset_Detection_Results:_Brossier_-_specdiff
- Audio_Onset_Detection_Results:_Dixon_-_cd
- Audio_Onset_Detection_Results:_Dixon_-_nwpd
- Audio_Onset_Detection_Results:_Dixon_-_rcd
- Audio_Onset_Detection_Results:_Dixon_-_sf
- Audio_Onset_Detection_Results:_Dixon_-_wpd
- Audio_Onset_Detection_Results:_Du
- Audio_Onset_Detection_Results:_Roebel_1
- Audio_Onset_Detection_Results:_Roebel_2
- Audio_Onset_Detection_Results:_Roebel_3