Difference between revisions of "2007:Audio Music Mood Classification Results"

From MIREX Wiki
(Team ID)
 
(15 intermediate revisions by 6 users not shown)
Line 1: Line 1:
 
==Introduction==
 
==Introduction==
These are the results for the 2007 running of the Audio Music Mood Classification task. For background information about this task set please refer to the [[Audio Music Mood Classification]] page.
+
These are the results for the 2007 running of the Audio Music Mood Classification task. For background information about this task set please refer to the [[2007:Audio Music Mood Classification]] page. The data set consisted of 600 30 second audio clips evenly divided into 5 general moods. The assignment of moods to files was done by human evaluators with a file accepted as a representative of a given mood when at least 2 graders concurred in the assignment.
  
 
===General Legend===
 
===General Legend===
 
====Team ID====
 
====Team ID====
'''ME1''' = [https://www.music-ir.org/mirex2007/abs/AI_CC_GC_MC_mandel.pdf Michael I. Mandel, Daniel P. W. Ellis 1]<br />
+
'''ME''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_mandel.pdf Michael I. Mandel, Daniel P. W. Ellis]<br />
'''ME2''' = [https://www.music-ir.org/mirex2007/abs/AI_CC_GC_MC_mandel.pdf Michael I. Mandel, Daniel P. W. Ellis 2]<br />
+
'''TL''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel Iñesta]<br />
'''TL''' = [https://www.music-ir.org/mirex2007/abs/AI_CC_GC_MC_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel Iñesta]<br />
+
'''GT''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_tzanetakis.pdf George Tzanetakis]<br />
'''GT''' = [https://www.music-ir.org/mirex2007/abs/AI_CC_GC_MC_AS_tzanetakis.pdf George Tzanetakis]<br />
+
'''CL''' = [https://www.music-ir.org/mirex/abstracts/2007/MC_laurier.pdf Cyril Laurier, Perfecto Herrera]<br />
'''CL''' = [https://www.music-ir.org/mirex2007/abs/MC_laurier.pdf Cyril Laurier]<br />
 
 
'''IM''' = IMIRSEL M2K<br />
 
'''IM''' = IMIRSEL M2K<br />
'''KL1''' = Kyogu Lee 1<br />
+
'''KL''' = Kyogu Lee<br />
'''KL2''' = Kyogu Lee 2<br />
+
 
 +
==Overall Summary Results==
 +
===MIREX 2007 Audio Mood Classification Summary Results - Raw Classification Accuracy Averaged Over Three Train/Test Folds===
 +
 
 +
<csv>2007/mood.results.csv</csv>
 +
 
 +
===MIREX 2007 Audio Artist Classification Evaluation Logs and Confusion Matrices===
 +
[https://www.music-ir.org/mirex/results/2007/am_imirsel_knn.eval.txt IM_knn]<br />
 +
[https://www.music-ir.org/mirex/results/2007/am_imirsel_svm.eval.txt IM_svm]<br />
 +
[https://www.music-ir.org/mirex/results/2007/am_laurier.eval.txt CL]<br />
 +
[https://www.music-ir.org/mirex/results/2007/am_lee_1.eval.txt KL_1]<br />
 +
[https://www.music-ir.org/mirex/results/2007/am_lee_2.eval.txt KL_2]<br />
 +
[https://www.music-ir.org/mirex/results/2007/am_lidy.eval.txt TL]<br />
 +
[https://www.music-ir.org/mirex/results/2007/am_mandel_1.eval.txt ME]<br />
 +
[https://www.music-ir.org/mirex/results/2007/am_mandel_2_spec.eval.txt ME_spec]<br />
 +
[https://www.music-ir.org/mirex/results/2007/am_tzan.eval.txt GT]<br />
 +
 
 +
===MIREX 2007 Audio Mood Classification Run Times===
 +
 
 +
<csv>2007/mood.runtime.csv</csv>
  
 
[[Category: Results]]
 
[[Category: Results]]

Latest revision as of 10:44, 26 July 2010

Introduction

These are the results for the 2007 running of the Audio Music Mood Classification task. For background information about this task set please refer to the 2007:Audio Music Mood Classification page. The data set consisted of 600 30 second audio clips evenly divided into 5 general moods. The assignment of moods to files was done by human evaluators with a file accepted as a representative of a given mood when at least 2 graders concurred in the assignment.

General Legend

Team ID

ME = Michael I. Mandel, Daniel P. W. Ellis
TL = Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel Iñesta
GT = George Tzanetakis
CL = Cyril Laurier, Perfecto Herrera
IM = IMIRSEL M2K
KL = Kyogu Lee

Overall Summary Results

MIREX 2007 Audio Mood Classification Summary Results - Raw Classification Accuracy Averaged Over Three Train/Test Folds

Participant Avg. Raw Classification Accuracy
IM_knn 47.17%
IM_svm 55.83%
CL 60.50%
KL_1 49.83%
KL_2 25.67%
TL 59.67%
ME 57.83%
ME_spec 55.83%
GT 61.50%

download these results as csv

MIREX 2007 Audio Artist Classification Evaluation Logs and Confusion Matrices

IM_knn
IM_svm
CL
KL_1
KL_2
TL
ME
ME_spec
GT

MIREX 2007 Audio Mood Classification Run Times

Participant Runtime (sec) / Fold
IM-knn Feat Ex: 535 Train/Classify: 74
IM-svm Feat Ex: 535 Train/Classify: 7
CL Feat Ex: 3605 Train/Classify: 7440
KL_1 Feat Ex: 353 Train/Classify: 204
KL_2 Feat Ex: 348 Train/Classify: 173
TL Feat Ex: 1597 Train/Classify: 12
ME Feat Ex: 613 Train/Classify: 2
ME_spec Feat Ex: 612 Train/Classify: 2
GT Feat Ex/Train/Classify: 122

download these results as csv