Difference between revisions of "2007:Audio Genre Classification Results"

From MIREX Wiki
m (Robot: Automated text replacement (-\[\[([A-Z][^:]+)\]\] +2007:\1))
m (Robot: Automated text replacement (-<csv([^>]*)> +<csv\1>2007/))
Line 26: Line 26:
 
===MIREX 2007 Audio Genre Classification Summary Results - Raw and Hierarchical Classification Accuracy Averaged Over Three Train/Test Folds===
 
===MIREX 2007 Audio Genre Classification Summary Results - Raw and Hierarchical Classification Accuracy Averaged Over Three Train/Test Folds===
  
<csv>genre.results.csv</csv>
+
<csv>2007/genre.results.csv</csv>
  
 
===MIREX 2007 Audio Genre Classification Evaluation Logs and Confusion Matrices===
 
===MIREX 2007 Audio Genre Classification Evaluation Logs and Confusion Matrices===
Line 39: Line 39:
 
===MIREX 2007 Audio Genre Classification Run Times===
 
===MIREX 2007 Audio Genre Classification Run Times===
  
<csv>genre.runtime.csv</csv>
+
<csv>2007/genre.runtime.csv</csv>
  
 
[[Category: Results]]
 
[[Category: Results]]

Revision as of 18:40, 13 May 2010

Introduction

These are the results for the 2007 running of the Audio Genre Classification task. For background information about this task set please refer to the 2007:Audio Genre Classification page. The data set consisted of 7000 30 second clips covering the following genres (700 tracks per genre):

A  : BAROQUE
B  : BLUES
C  : CLASSICAL
D  : COUNTRY
E  : EDANCE
F  : JAZZ
G  : METAL
H  : RAPHIPHOP
I  : ROCKROLL
J  : ROMANTIC

Partial scores were earned for some confusions (i.e., ROCKROLL-METAL; JAZZ-BLUES, etc.)

General Legend

Team ID

ME = Michael I. Mandel, Daniel P. W. Ellis
TL = Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel Iñesta
GT = George Tzanetakis
GH = Enric Guaus, Perfecto Herrera
IM = IMIRSEL M2K

Overall Summary Results

MIREX 2007 Audio Genre Classification Summary Results - Raw and Hierarchical Classification Accuracy Averaged Over Three Train/Test Folds

Participant Avg. Hierarchical Classification Accuracy Avg. Raw Classification Accuracy
GH 71.87% 62.89%
IM_knn 64.83% 54.87%
IM_svm 76.56% 68.29%
TL 75.57% 66.71%
ME 75.03% 66.60%
ME_spec 73.57% 65.50%
GT 74.15% 65.34%

download these results as csv

MIREX 2007 Audio Genre Classification Evaluation Logs and Confusion Matrices

GH
IM_knn
IM_svm
TL
ME
ME_spec
GT

MIREX 2007 Audio Genre Classification Run Times

Participant Runtime (sec) / Fold
GH Feat Ex: 22740 Train/Classify: 194
IM-knn Feat Ex: 6879 Train/Classify: 1245
IM-svm Feat Ex: 6879 Train/Classify: 51
TL Feat Ex: 54192 Train/Classify: 147
ME Feat Ex: 8166 Train/Classify: 207
ME_spec Feat Ex: 8018 Train/Classify: 210
GT Feat Ex/Train/Classify: 1442

download these results as csv