2007:Audio Onset Detection Results

From MIREX Wiki
Revision as of 18:58, 15 September 2007 by Jhlee (talk | contribs)

Introduction

These are the results for the 2007 running of the Audio Onset Detection task set. For background information about this task set please refer to the Audio Onset Detection page.

The aim of the Audio Onset Detection task is to find the time locations at which all musical events in a recording begin. The dataset consists of 85 recordings across 9 different "classes" (e.g. solo drums, polyphonic pitched, etc.). For each sound file, ground truth annotations produced by 3-5 listeners were used for the evaluation. Each algorithm was tested across 10-20 different parameterizations (e.g. thresholds) in order to produce Precision vs. Recall Operating Characteristic (P-ROC) curves. The primary evauluation metric used was the F1-Measure (the equal weighted harmonic mean of precision and recall).

  • Note: There were a few faulty ground truth annotations in the 2005 and 2006 runs of this task. These have been removed for this year's evaluation. Thanks to Dan Stowell for finding these.

General Legend

Team ID

lacoste = Alexandre Lacoste
lee = Wan-Chi Lee, Yu Shiu, & C.-C. Jay Kuo
roebel = A. R├╢bel
stowell = Dan Stowell & Mark Plumbley
zhou = Ruohua Zhou & Joshua D. Reiss

Overall Summary Results

MIREX 2007 Audio Onset Detection Summary Results - Peak F-measure performance across all parameterizations

file /nema-raid/www/mirex/results/onset.Total_peak.csv not found

MIREX 2007 Audio Onset Detection Summary Plot

File:Total.png

MIREX 2007 Audio Onset Detection Runtime Data

file /nema-raid/www/mirex/results/onset.runtime.csv not found

Results by Class

Individual Results

Retrieved from "https://music-ir.org/mirex/w/index.php?title=2007:Audio_Onset_Detection_Results&oldid=3356"