Difference between revisions of "2007:Audio Music Mood Classification Results"
From MIREX Wiki
(→MIREX 2007 Audio Mood Classification Run Times) |
(→Team ID) |
||
| (10 intermediate revisions by 5 users not shown) | |||
| Line 1: | Line 1: | ||
==Introduction== | ==Introduction== | ||
| − | These are the results for the 2007 running of the Audio Music Mood Classification task. For background information about this task set please refer to the [[Audio Music Mood Classification]] page. | + | These are the results for the 2007 running of the Audio Music Mood Classification task. For background information about this task set please refer to the [[2007:Audio Music Mood Classification]] page. The data set consisted of 600 30 second audio clips evenly divided into 5 general moods. The assignment of moods to files was done by human evaluators with a file accepted as a representative of a given mood when at least 2 graders concurred in the assignment. |
===General Legend=== | ===General Legend=== | ||
====Team ID==== | ====Team ID==== | ||
| − | '''ME''' = [https://www.music-ir.org/ | + | '''ME''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_mandel.pdf Michael I. Mandel, Daniel P. W. Ellis]<br /> |
| − | '''TL''' = [https://www.music-ir.org/ | + | '''TL''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel Iñesta]<br /> |
| − | '''GT''' = [https://www.music-ir.org/ | + | '''GT''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_tzanetakis.pdf George Tzanetakis]<br /> |
| − | '''CL''' = [https://www.music-ir.org/ | + | '''CL''' = [https://www.music-ir.org/mirex/abstracts/2007/MC_laurier.pdf Cyril Laurier, Perfecto Herrera]<br /> |
'''IM''' = IMIRSEL M2K<br /> | '''IM''' = IMIRSEL M2K<br /> | ||
'''KL''' = Kyogu Lee<br /> | '''KL''' = Kyogu Lee<br /> | ||
| Line 14: | Line 14: | ||
===MIREX 2007 Audio Mood Classification Summary Results - Raw Classification Accuracy Averaged Over Three Train/Test Folds=== | ===MIREX 2007 Audio Mood Classification Summary Results - Raw Classification Accuracy Averaged Over Three Train/Test Folds=== | ||
| − | <csv>mood.results.csv</csv> | + | <csv>2007/mood.results.csv</csv> |
===MIREX 2007 Audio Artist Classification Evaluation Logs and Confusion Matrices=== | ===MIREX 2007 Audio Artist Classification Evaluation Logs and Confusion Matrices=== | ||
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/am_imirsel_knn.eval.txt IM_knn]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/am_imirsel_svm.eval.txt IM_svm]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/am_laurier.eval.txt CL]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/am_lee_1.eval.txt KL_1]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/am_lee_2.eval.txt KL_2]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/am_lidy.eval.txt TL]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/am_mandel_1.eval.txt ME]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/am_mandel_2_spec.eval.txt ME_spec]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/am_tzan.eval.txt GT]<br /> |
===MIREX 2007 Audio Mood Classification Run Times=== | ===MIREX 2007 Audio Mood Classification Run Times=== | ||
| − | <csv>mood.runtime.csv</csv> | + | <csv>2007/mood.runtime.csv</csv> |
[[Category: Results]] | [[Category: Results]] | ||
Latest revision as of 10:44, 26 July 2010
Contents
Introduction
These are the results for the 2007 running of the Audio Music Mood Classification task. For background information about this task set please refer to the 2007:Audio Music Mood Classification page. The data set consisted of 600 30 second audio clips evenly divided into 5 general moods. The assignment of moods to files was done by human evaluators with a file accepted as a representative of a given mood when at least 2 graders concurred in the assignment.
General Legend
Team ID
ME = Michael I. Mandel, Daniel P. W. Ellis
TL = Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel Iñesta
GT = George Tzanetakis
CL = Cyril Laurier, Perfecto Herrera
IM = IMIRSEL M2K
KL = Kyogu Lee
Overall Summary Results
MIREX 2007 Audio Mood Classification Summary Results - Raw Classification Accuracy Averaged Over Three Train/Test Folds
| Participant | Avg. Raw Classification Accuracy |
|---|---|
| IM_knn | 47.17% |
| IM_svm | 55.83% |
| CL | 60.50% |
| KL_1 | 49.83% |
| KL_2 | 25.67% |
| TL | 59.67% |
| ME | 57.83% |
| ME_spec | 55.83% |
| GT | 61.50% |
MIREX 2007 Audio Artist Classification Evaluation Logs and Confusion Matrices
IM_knn
IM_svm
CL
KL_1
KL_2
TL
ME
ME_spec
GT
MIREX 2007 Audio Mood Classification Run Times
| Participant | Runtime (sec) / Fold |
|---|---|
| IM-knn | Feat Ex: 535 Train/Classify: 74 |
| IM-svm | Feat Ex: 535 Train/Classify: 7 |
| CL | Feat Ex: 3605 Train/Classify: 7440 |
| KL_1 | Feat Ex: 353 Train/Classify: 204 |
| KL_2 | Feat Ex: 348 Train/Classify: 173 |
| TL | Feat Ex: 1597 Train/Classify: 12 |
| ME | Feat Ex: 613 Train/Classify: 2 |
| ME_spec | Feat Ex: 612 Train/Classify: 2 |
| GT | Feat Ex/Train/Classify: 122 |
