Difference between revisions of "2009:Audio Classical Composer Identification Results"

From MIREX Wiki
(→‎Results By Algorithm)
(→‎Run Times)
Line 163: Line 163:
 
'''XLZZG''' = [Jieping Xu, Yi Liu, Tao Zheng, Chao Zhen, Yue Gao (RUC_1)]<br />
 
'''XLZZG''' = [Jieping Xu, Yi Liu, Tao Zheng, Chao Zhen, Yue Gao (RUC_1)]<br />
 
'''XZZ''' = [JiePing Xu, Chao Zhen, Tao Zheng (RUC_2)]<br />
 
'''XZZ''' = [JiePing Xu, Chao Zhen, Tao Zheng (RUC_2)]<br />
 +
 
==Overall Summary Results==
 
==Overall Summary Results==

Revision as of 22:36, 15 October 2009

Introduction

These are the results for the 2009 running of the Audio Classical Composer Identification task. For background information about this task set please refer to the 2007:Audio Classical Composer Identification page.

The data set consisted of 2772 30 second audio clips. The composers represented were:

  1. Bach
  2. Beethoven
  3. Brahms
  4. Chopin
  5. Dvorak
  6. Handel
  7. Haydn
  8. Mendelssohnn
  9. Mozart
  10. Schubert
  11. Vivaldi

The goal was to correctly identify the composer who wrote each of the pieces represented.

General Legend

Team ID

ANO= Just Testing Anonymous
BP1= [Juan José Burred, Geoffroy Peeters (file)]
BP2 = [Juan José Burred, Geoffroy Peeters (tw)]
CL1 = [Chuan Cao, Ming Li]
CL2 = [Chuan Cao, Ming Li]
FCY1 = [Tao Feng, XiaoOu Chen, DeShun Yang]
FCY2 = [Tao Feng, XiaoOu Chen, DeShun Yang]
GP = [Geoffroy Peeters]
GT1 = [George Tzanetakis (mono)]
GT2 = [George Tzanetakis (stereo)]
GLR1 = [A. Grecu, T. Lidy, A. Rauber (full)]
GLR2 = [A. Grecu, T. Lidy, A. Rauber (template)]
HNOS1 = [Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcca)]
HNOS2 = [Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcck)]
HNOS3 = [Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tccl)]
HNOS4 = [Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcpk)]
HW1 = [Huaxin Wang]
HW2 = [Huaxin Wang]
VA1 = [T. Lidy, A. Grecu, A. Rauber, A. Pertusa, P. J. Ponce de Léon, J. M. Iñesta (WMV)]
VA2 = [T. Lidy, A. Grecu, A. Rauber, A. Pertusa, P. J. Ponce de Léon, J. M. Iñesta (BWWV)]
LZG = [Yi Liu, Tao Zheng, Yue Gao (RUC_1)]
RK1 = [Preeti Rao, Sujeet Kini]
RK2 = [Preeti Rao, Sujeet Kini]
SS = [Klaus Seyerlehner, Markus Schedl]
TAOS= [Emiru Tsunoo, Taichi Akase, Nobutaka Ono, Shigeki Sagayama]
MTG1 = [N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, rca)]
MTG2 = [N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, rca)]
MTG3 = [N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, simca)]
MTG4 = [N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, simca)]
MTG5 = [N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, svm)]
MTG6 = [N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, svm)]
XLZZG = [Jieping Xu, Yi Liu, Tao Zheng, Chao Zhen, Yue Gao (RUC_1)]
XZZ = [JiePing Xu, Chao Zhen, Tao Zheng (RUC_2)]

Overall Summary Results

Raw Classification Accuracy Averaged Over Three Train/Test Folds

file /nema-raid/www/mirex/results/audiocomposer/summary_audiocomposer.csv not found

Accuracy Across Folds

file /nema-raid/www/mirex/results/audiocomposer/audiocomposer_Accuracy.csv not found

Accuracy Across Categories

file /nema-raid/www/mirex/results/audiocomposer/audiocomposer_Accuracy_Per_Class.csv not found

Friedman's Tests for Significant Differences

Classes vs. System Tukey-Kramer HSD Multi-Comparisons

The Friedman test was run in MATLAB against the average accuracy for each class. The Tukey-Kramer HSD multi-comparison data below was generated using the following MATLAB instruction. Command:
[c, m, h, gnames] = multicompare(stats, 'ctype', 'tukey-kramer', 'estimate', 'friedman', 'alpha', 0.05);

file /nema-raid/www/mirex/results/audiocomposer/audiocomposer_Accuracy_Per_Class.friedman.tukeyKramerHSD.csv not found

https://music-ir.org/mirex/2009/results/audiocomposer/small.audiocomposer_Accuracy_Per_Class.friedman.tukeyKramerHSD.png

Folds vs. Systems Tukey-Kramer HSD Multi-Comparison

The Friedman test was run in MATLAB against the accuracy for each fold. The Tukey-Kramer HSD multi-comparison data below was generated using the following MATLAB instruction. Command:
[c, m, h, gnames] = multicompare(stats, 'ctype', 'tukey-kramer', 'estimate', 'friedman', 'alpha', 0.05);

file /nema-raid/www/mirex/results/audiocomposer/audiocomposer_Accuracy.friedman.tukeyKramerHSD.csv not found

https://music-ir.org/mirex/2009/results/audiocomposer/small.audiocomposer_Accuracy.friedman.tukeyKramerHSD.png

Results By Algorithm

(.tgz)

ANO= Anonymous
BP1= Juan José Burred, Geoffroy Peeters (file)
BP2 = Juan José Burred, Geoffroy Peeters (tw)
CL1 = Chuan Cao, Ming Li
CL2 = Chuan Cao, Ming Li
GP = Geoffroy Peeters
GT1 = George Tzanetakis (mono)
GT2 = George Tzanetakis (stereo)
GLR1 = A. Grecu, T. Lidy, A. Rauber (full)
GLR2 = A. Grecu, T. Lidy, A. Rauber (template)
HNOS1 = Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcca)
HNOS2 = Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcck)
HNOS3 = Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tccl)
HNOS4 = Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcpk)
HW1 = Huaxin Wang
HW2 = Huaxin Wang
VA1 = T. Lidy, A. Grecu, A. Rauber, A. Pertusa, P. J. Ponce de Léon, J. M. Iñesta (WMV)
VA2 = T. Lidy, A. Grecu, A. Rauber, A. Pertusa, P. J. Ponce de Léon, J. M. Iñesta (BWWV)
LZG = Yi Liu, Tao Zheng, Yue Gao (RUC_1)
RK1 = Preeti Rao, Sujeet Kini
SS = Klaus Seyerlehner, Markus Schedl

TTOS= Emiru Tsunoo, Taichi Akase, Nobutaka Ono, Shigeki Sagayama

MTG1 = N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, rca)
MTG2 = N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, rca)
MTG3 = N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, simca)
MTG4 = N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, simca)
MTG5 = N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, svm)
MTG6 = N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, svm)
XLZZG = Jieping Xu, Yi Liu, Tao Zheng, Chao Zhen, Yue Gao (RUC_1)
XZZ = JiePing Xu, Chao Zhen, Tao Zheng (RUC_2)

Run Times

file /nema-raid/www/mirex/results/mood.runtime.csv not found TBA

XXXXXXXXXXXXXXX ANO= Anonymous
BP1= [Juan José Burred, Geoffroy Peeters (file)]
BP2 = [Juan José Burred, Geoffroy Peeters (tw)]
CL1 = [Chuan Cao, Ming Li]
CL2 = [Chuan Cao, Ming Li]
FCY1 = [Tao Feng, XiaoOu Chen, DeShun Yang]
FCY2 = [Tao Feng, XiaoOu Chen, DeShun Yang]
GP = [Geoffroy Peeters]
GT1 = [George Tzanetakis (mono)]
GT2 = [George Tzanetakis (stereo)]
GLR1 = [A. Grecu, T. Lidy, A. Rauber (full)]
GLR2 = [A. Grecu, T. Lidy, A. Rauber (template)]
HNOS1 = [Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcca)]
HNOS2 = [Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcck)]
HNOS3 = [Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tccl)]
HNOS4 = [Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcpk)]
HW1 = [Huaxin Wang]
HW2 = [Huaxin Wang]
VA1 = [T. Lidy, A. Grecu, A. Rauber, A. Pertusa, P. J. Ponce de Léon, J. M. Iñesta (WMV)]
VA2 = [T. Lidy, A. Grecu, A. Rauber, A. Pertusa, P. J. Ponce de Léon, J. M. Iñesta (BWWV)]
LZG = [Yi Liu, Tao Zheng, Yue Gao (RUC_1)]
RK1 = [Preeti Rao, Sujeet Kini]
RK2 = [Preeti Rao, Sujeet Kini]
RCJ1 = [Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang]
RCJ2 = [Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang]
RCJ3 = [Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang]
RCJ4 = [Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang]
SS = [Klaus Seyerlehner, Markus Schedl]
TAOS= [Emiru Tsunoo, Taichi Akase, Nobutaka Ono, Shigeki Sagayama]
TTOS = [Emiru Tsunoo, George Tzanetakis, Nobutaka Ono, Shigeki Sagayama]
MTG1 = [N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, rca)]
MTG2 = [N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, rca)]
MTG3 = [N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, simca)]
MTG4 = [N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, simca)]
MTG5 = [N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, svm)]
MTG6 = [N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, svm)]
XLZZG = [Jieping Xu, Yi Liu, Tao Zheng, Chao Zhen, Yue Gao (RUC_1)]
XZZ = [JiePing Xu, Chao Zhen, Tao Zheng (RUC_2)]

Overall Summary Results

Retrieved from "https://music-ir.org/mirex/w/index.php?title=2009:Audio_Classical_Composer_Identification_Results&oldid=5677"