Difference between revisions of "2007:Audio Music Mood Classification Results"
From MIREX Wiki
(→Team ID) |
(→Team ID) |
||
| (6 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
==Introduction== | ==Introduction== | ||
| − | These are the results for the 2007 running of the Audio Music Mood Classification task. For background information about this task set please refer to the [[Audio Music Mood Classification]] page. The data set consisted of 600 30 second audio clips evenly divided into 5 general moods. The assignment of moods to files was done by human evaluators with a file accepted as a representative of a given mood when at least 2 graders concurred in the assignment. | + | These are the results for the 2007 running of the Audio Music Mood Classification task. For background information about this task set please refer to the [[2007:Audio Music Mood Classification]] page. The data set consisted of 600 30 second audio clips evenly divided into 5 general moods. The assignment of moods to files was done by human evaluators with a file accepted as a representative of a given mood when at least 2 graders concurred in the assignment. |
===General Legend=== | ===General Legend=== | ||
====Team ID==== | ====Team ID==== | ||
| − | '''ME''' = [https://www.music-ir.org/ | + | '''ME''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_mandel.pdf Michael I. Mandel, Daniel P. W. Ellis]<br /> |
| − | '''TL''' = [https://www.music-ir.org/ | + | '''TL''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel Iñesta]<br /> |
| − | '''GT''' = [https://www.music-ir.org/ | + | '''GT''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_tzanetakis.pdf George Tzanetakis]<br /> |
| − | '''CL''' = [https://www.music-ir.org/ | + | '''CL''' = [https://www.music-ir.org/mirex/abstracts/2007/MC_laurier.pdf Cyril Laurier, Perfecto Herrera]<br /> |
'''IM''' = IMIRSEL M2K<br /> | '''IM''' = IMIRSEL M2K<br /> | ||
'''KL''' = Kyogu Lee<br /> | '''KL''' = Kyogu Lee<br /> | ||
| Line 14: | Line 14: | ||
===MIREX 2007 Audio Mood Classification Summary Results - Raw Classification Accuracy Averaged Over Three Train/Test Folds=== | ===MIREX 2007 Audio Mood Classification Summary Results - Raw Classification Accuracy Averaged Over Three Train/Test Folds=== | ||
| − | <csv>mood.results.csv</csv> | + | <csv>2007/mood.results.csv</csv> |
===MIREX 2007 Audio Artist Classification Evaluation Logs and Confusion Matrices=== | ===MIREX 2007 Audio Artist Classification Evaluation Logs and Confusion Matrices=== | ||
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/am_imirsel_knn.eval.txt IM_knn]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/am_imirsel_svm.eval.txt IM_svm]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/am_laurier.eval.txt CL]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/am_lee_1.eval.txt KL_1]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/am_lee_2.eval.txt KL_2]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/am_lidy.eval.txt TL]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/am_mandel_1.eval.txt ME]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/am_mandel_2_spec.eval.txt ME_spec]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/am_tzan.eval.txt GT]<br /> |
===MIREX 2007 Audio Mood Classification Run Times=== | ===MIREX 2007 Audio Mood Classification Run Times=== | ||
| − | <csv>mood.runtime.csv</csv> | + | <csv>2007/mood.runtime.csv</csv> |
[[Category: Results]] | [[Category: Results]] | ||
Latest revision as of 11:44, 26 July 2010
Contents
[hide]Introduction
These are the results for the 2007 running of the Audio Music Mood Classification task. For background information about this task set please refer to the 2007:Audio Music Mood Classification page. The data set consisted of 600 30 second audio clips evenly divided into 5 general moods. The assignment of moods to files was done by human evaluators with a file accepted as a representative of a given mood when at least 2 graders concurred in the assignment.
General Legend
Team ID
ME = Michael I. Mandel, Daniel P. W. Ellis
TL = Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel Iñesta
GT = George Tzanetakis
CL = Cyril Laurier, Perfecto Herrera
IM = IMIRSEL M2K
KL = Kyogu Lee
Overall Summary Results
MIREX 2007 Audio Mood Classification Summary Results - Raw Classification Accuracy Averaged Over Three Train/Test Folds
| Participant | Avg. Raw Classification Accuracy |
|---|---|
| IM_knn | 47.17% |
| IM_svm | 55.83% |
| CL | 60.50% |
| KL_1 | 49.83% |
| KL_2 | 25.67% |
| TL | 59.67% |
| ME | 57.83% |
| ME_spec | 55.83% |
| GT | 61.50% |
MIREX 2007 Audio Artist Classification Evaluation Logs and Confusion Matrices
IM_knn
IM_svm
CL
KL_1
KL_2
TL
ME
ME_spec
GT
MIREX 2007 Audio Mood Classification Run Times
| Participant | Runtime (sec) / Fold |
|---|---|
| IM-knn | Feat Ex: 535 Train/Classify: 74 |
| IM-svm | Feat Ex: 535 Train/Classify: 7 |
| CL | Feat Ex: 3605 Train/Classify: 7440 |
| KL_1 | Feat Ex: 353 Train/Classify: 204 |
| KL_2 | Feat Ex: 348 Train/Classify: 173 |
| TL | Feat Ex: 1597 Train/Classify: 12 |
| ME | Feat Ex: 613 Train/Classify: 2 |
| ME_spec | Feat Ex: 612 Train/Classify: 2 |
| GT | Feat Ex/Train/Classify: 122 |
