2006:Audio Melody Extraction Results

From MIREX Wiki
Revision as of 14:28, 4 October 2006 by Admin (talk | contribs) (Introduction)

Introduction

These are the results for the 2006 running of the Audio Melody Extraction task set. For background information about this task set please refer to the Audio Melody Extraction page.

The aim of the MIREX audio melody extraction evaluation is to identify the predominant melody pitch contour from polyphonic musical audio. The task consists of two parts: Voicing detection (deciding whether a particular time frame contains a "melody pitch" or not), and pitch detection (deciding the most likely melody pitch for each time frame). We structure the submission to allow these parts to be done independently, i.e. it is possible (via a negative pitch value) to guess a pitch even for frames that were being judged unvoiced. The algorithms were tested on two datasets, the MIREX2005 dataset, consisting of 25 sound files, and the ADC2004 dataset, consisting of 20 sound files, both across different music styles. Moreover, each of these datasets were split into two groups: those files in which the predominant melody is sung, and those in which the predominant melody is nonvocal.

General Legend

Team ID

dressler = Karin Dressler
ryynanen = Matti Ryynänen and Anssi Klapuri
poliner = Graham Poliner and Daniel P. W. Ellis
sutton = Christopher Sutton, Emmanuel Vincent, Mark D. Plumbley and Juan P. Bello
brossier = Paul Brossier

  • Brossier does not do voiced/unvoiced detection.
  • Sutton's algorithm is designed for sung/vocal melody extraction.

Table Headings

Vx Recall = Voicing Detection
Vx False Alm = Voicing False Alarm
Vx d' = Voicing d-prime
Raw pitch = Raw Pitch Accuracy
Raw Chroma = Raw Chroma Accuracy
Overall Acc = Overall Acuuracy

Overall Summary Results

MIREX 2006 Audio Melody Extraction Runtime Data

file /nema-raid/www/mirex/results/am06_runtime.csv not found

MIREX 2006 Audio Melody Extraction Summary results - ADC 2004 Dataset - All

file /nema-raid/www/mirex/results/am06_adc04_all.csv not found

File:Am06 adc04 all.PNG

Download the Excel workbook for ADC 2004 Dataset - All.


MIREX 2006 Audio Melody Extraction Summary results- ADC 2004 Dataset - Vocal

file /nema-raid/www/mirex/results/am06_adc04_vocal.csv not found

File:Am06 adc04 vocal.png

Download the Excel workbook for ADC 2004 Dataset - Vocal.


MIREX 2006 Audio Melody Extraction Summary results - ADC 2004 Dataset - Nonvocal

file /nema-raid/www/mirex/results/am06_adc04_nonvocal.csv not found

File:Am06 adc04 nonvocal.PNG

Download the Excel workbook for ADC 2004 Dataset - Nonvocal.


MIREX 2006 Audio Melody Extraction Summary results - MIREX 2005 Dataset - All

file /nema-raid/www/mirex/results/am06_m05_all.csv not found

File:Am06 mirex05 all.png

Download the Excel workbook for MIREX 2005 Dataset - All.


MIREX 2006 Audio Melody Extraction Summary results - MIREX 2005 Dataset - Vocal

file /nema-raid/www/mirex/results/am06_m05_vocal.csv not found

File:Am06 mirex05 vocal.png

Download the Excel workbook for MIREX 2005 Dataset - Vocal.


MIREX 2006 Audio Melody Extraction Summary results - MIREX 2005 Dataset - Nonvocal

file /nema-raid/www/mirex/results/am06_m05_nonvocal.csv not found

File:Am06 mirex05 nonvocal.png

Download the Excel workbook for MIREX 2005 Dataset - Nonvocal.