Difference between revisions of "2007:Audio Genre Classification Results"

From MIREX Wiki
(New page: ==Introduction== These are the results for the 2007 running of the Audio Genre Classification task. For background information about this task set please refer to the [[Audio Genre Classif...)
 
(→‎Team ID)
 
(19 intermediate revisions by 6 users not shown)
Line 1: Line 1:
 
==Introduction==
 
==Introduction==
−
These are the results for the 2007 running of the Audio Genre Classification task. For background information about this task set please refer to the [[Audio Genre Classification]] page.
+
These are the results for the 2007 running of the Audio Genre Classification task. For background information about this task set please refer to the [[2007:Audio Genre Classification]] page. The data set consisted of 7000 30 second clips covering the following genres (700 tracks per genre):
 +
 
 +
A  : BAROQUE<br />
 +
B  : BLUES<br />
 +
C  : CLASSICAL<br />
 +
D  : COUNTRY<br />
 +
E  : EDANCE<br />
 +
F  : JAZZ<br />
 +
G  : METAL<br />
 +
H  : RAPHIPHOP<br />
 +
I  : ROCKROLL<br />
 +
J  : ROMANTIC<br />
 +
 
 +
Partial scores were earned for some confusions (i.e., ROCKROLL-METAL; JAZZ-BLUES, etc.)
  
 
===General Legend===
 
===General Legend===
 
====Team ID====
 
====Team ID====
−
'''ME''' = [https://www.music-ir.org/evaluation/MIREX/2007_abstracts/CC_mandel.pdf Michael I. Mandel and Daniel P. W. Ellis]<br />
+
'''ME''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_mandel.pdf Michael I. Mandel, Daniel P. W. Ellis]<br />
−
'''TL''' = [https://www.music-ir.org/evaluation/MIREX/2007_abstracts/CC_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa and José Manuel Iñesta]<br />
+
'''TL''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel Iñesta]<br />
−
'''GT''' = [https://www.music-ir.org/evaluation/MIREX/2007_abstracts/CC_tzanetakis.pdf George Tzanetakis]<br />
+
'''GT''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_tzanetakis.pdf George Tzanetakis]<br />
−
'''GH''' = [https://www.music-ir.org/evaluation/MIREX/2007_abstracts/CC_lee.pdf Enric Guaus and Perfecto Herrera]<br />
+
'''GH''' = [https://www.music-ir.org/mirex/abstracts/2007/GC_guaus.pdf Enric Guaus, Perfecto Herrera]<br />
−
'''IM''' = [https://www.music-ir.org/evaluation/MIREX/2007_abstracts/CC_imirsel.pdf IMIRSEL]<br />
+
'''IM''' = IMIRSEL M2K<br />
 +
 
 +
==Overall Summary Results==
 +
===MIREX 2007 Audio Genre Classification Summary Results - Raw and Hierarchical Classification Accuracy Averaged Over Three Train/Test Folds===
 +
 
 +
<csv>2007/genre.results.csv</csv>
 +
 
 +
===MIREX 2007 Audio Genre Classification Evaluation Logs and Confusion Matrices===
 +
[https://www.music-ir.org/mirex/results/2007/ag_guaus.eval.txt GH]<br />
 +
[https://www.music-ir.org/mirex/results/2007/ag_imirsel_knn.eval.txt IM_knn]<br />
 +
[https://www.music-ir.org/mirex/results/2007/ag_imirsel_svm.eval.txt IM_svm]<br />
 +
[https://www.music-ir.org/mirex/results/2007/ag_lidy.eval.txt TL]<br />
 +
[https://www.music-ir.org/mirex/results/2007/ag_mandel_1.eval.txt ME]<br />
 +
[https://www.music-ir.org/mirex/results/2007/ag_mandel_2_spec.eval.txt ME_spec]<br />
 +
[https://www.music-ir.org/mirex/results/2007/ag_tzan.eval.txt GT]<br />
 +
 
 +
===MIREX 2007 Audio Genre Classification Run Times===
 +
 
 +
<csv>2007/genre.runtime.csv</csv>
  
 
[[Category: Results]]
 
[[Category: Results]]

Latest revision as of 10:47, 26 July 2010

Introduction

These are the results for the 2007 running of the Audio Genre Classification task. For background information about this task set please refer to the 2007:Audio Genre Classification page. The data set consisted of 7000 30 second clips covering the following genres (700 tracks per genre):

A  : BAROQUE
B  : BLUES
C  : CLASSICAL
D  : COUNTRY
E  : EDANCE
F  : JAZZ
G  : METAL
H  : RAPHIPHOP
I  : ROCKROLL
J  : ROMANTIC

Partial scores were earned for some confusions (i.e., ROCKROLL-METAL; JAZZ-BLUES, etc.)

General Legend

Team ID

ME = Michael I. Mandel, Daniel P. W. Ellis
TL = Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel Iñesta
GT = George Tzanetakis
GH = Enric Guaus, Perfecto Herrera
IM = IMIRSEL M2K

Overall Summary Results

MIREX 2007 Audio Genre Classification Summary Results - Raw and Hierarchical Classification Accuracy Averaged Over Three Train/Test Folds

Participant Avg. Hierarchical Classification Accuracy Avg. Raw Classification Accuracy
GH 71.87% 62.89%
IM_knn 64.83% 54.87%
IM_svm 76.56% 68.29%
TL 75.57% 66.71%
ME 75.03% 66.60%
ME_spec 73.57% 65.50%
GT 74.15% 65.34%

download these results as csv

MIREX 2007 Audio Genre Classification Evaluation Logs and Confusion Matrices

GH
IM_knn
IM_svm
TL
ME
ME_spec
GT

MIREX 2007 Audio Genre Classification Run Times

Participant Runtime (sec) / Fold
GH Feat Ex: 22740 Train/Classify: 194
IM-knn Feat Ex: 6879 Train/Classify: 1245
IM-svm Feat Ex: 6879 Train/Classify: 51
TL Feat Ex: 54192 Train/Classify: 147
ME Feat Ex: 8166 Train/Classify: 207
ME_spec Feat Ex: 8018 Train/Classify: 210
GT Feat Ex/Train/Classify: 1442

download these results as csv

Retrieved from "https://music-ir.org/mirex/w/index.php?title=2007:Audio_Genre_Classification_Results&oldid=7413"