Difference between revisions of "2006:Audio Onset Detection Results"

From MIREX Wiki
(Team ID)
m (Robot: Automated text replacement (-\[\[([A-Z][^:]+)\]\] +2006:\1))
Line 1: Line 1:
 
[[Category: Results]]
 
[[Category: Results]]
 
==Introduction==
 
==Introduction==
These are the results for the 2006 running of the Audio Onset Detection task set. For background information about this task set please refer to the [[Audio Onset Detection]] page.
+
These are the results for the 2006 running of the Audio Onset Detection task set. For background information about this task set please refer to the [[2006:Audio Onset Detection]] page.
  
 
The aim of the Audio Onset Detection task is to find the time locations at which all musical events in a recording begin. The dataset consists of 85 recordings across 9 different "classes" (e.g. solo drums, polyphonic pitched, etc.). For each sound file, ground truth annotations produced by 3-5 listeners were used for the evaluation. Each algorithm was tested across 10-20 different parameterizations (e.g. thresholds) in order to produce Precision vs. Recall Operating Characteristic (P-ROC) curves. The primary evauluation metric used was the F1-Measure (the equal weighted harmonic mean of precision and recall).  
 
The aim of the Audio Onset Detection task is to find the time locations at which all musical events in a recording begin. The dataset consists of 85 recordings across 9 different "classes" (e.g. solo drums, polyphonic pitched, etc.). For each sound file, ground truth annotations produced by 3-5 listeners were used for the evaluation. Each algorithm was tested across 10-20 different parameterizations (e.g. thresholds) in order to produce Precision vs. Recall Operating Characteristic (P-ROC) curves. The primary evauluation metric used was the F1-Measure (the equal weighted harmonic mean of precision and recall).  

Revision as of 12:04, 13 May 2010

Introduction

These are the results for the 2006 running of the Audio Onset Detection task set. For background information about this task set please refer to the 2006:Audio Onset Detection page.

The aim of the Audio Onset Detection task is to find the time locations at which all musical events in a recording begin. The dataset consists of 85 recordings across 9 different "classes" (e.g. solo drums, polyphonic pitched, etc.). For each sound file, ground truth annotations produced by 3-5 listeners were used for the evaluation. Each algorithm was tested across 10-20 different parameterizations (e.g. thresholds) in order to produce Precision vs. Recall Operating Characteristic (P-ROC) curves. The primary evauluation metric used was the F1-Measure (the equal weighted harmonic mean of precision and recall).

General Legend

Team ID

dixon = Simon Dixon
roebel = A. R├╢bel
brossier = Paul Brossier
du = Yunfeng Du, Ming Li, Jian Liu

  • Dixon's NWPD submission was modified by Andreas Ehmann, and requires the author's verification

Overall Summary Results

MIREX 2006 Audio Onset Detection Summary Results - Peak F-measure performance across all parameterizations

file /nema-raid/www/mirex/results/onset06_sum.csv not found

MIREX 2006 Audio Onset Detection Summary Plot

File:Onset06 summary.png

MIREX 2006 Audio Onset Detection Runtime Data

file /nema-raid/www/mirex/results/onset06_runtime.csv not found

Results by Class

Individual Results