Difference between revisions of "2009:Audio Genre Classification (Mixed Set) Results"

From MIREX Wiki
Line 16: Line 16:
  
 
=== General Legend ===
 
=== General Legend ===
 +
==== Team ID ====
 +
'''ANO'''= [https://music-ir.org/mirex/2009/results/abs  Anonymous]<br />
 +
'''BP1'''= [https://music-ir.org/mirex/2009/results/abs Juan José Burred, Geoffroy Peeters (file)]<br />
 +
'''BP2''' = [https://music-ir.org/mirex/2009/results/abs Juan José Burred, Geoffroy Peeters (tw)]<br />
 +
'''CL1''' = [https://music-ir.org/mirex/2009/results/abs Chuan Cao, Ming Li]<br />
 +
'''CL2''' = [https://music-ir.org/mirex/2009/results/abs Chuan Cao, Ming Li]<br />
 +
'''GP'''  = [https://music-ir.org/mirex/2009/results/abs Geoffroy Peeters]<br />
 +
'''GT1''' = [https://music-ir.org/mirex/2009/results/abs George Tzanetakis (mono)]<br />
 +
'''GT2''' = [https://music-ir.org/mirex/2009/results/abs George Tzanetakis (stereo)]<br />
 +
'''GLR1''' = [https://music-ir.org/mirex/2009/results/abs A. Grecu, T. Lidy, A. Rauber (full)]<br />
 +
'''GLR2''' = [https://music-ir.org/mirex/2009/results/abs  A. Grecu, T. Lidy, A. Rauber (template)]<br />
 +
'''HNOS1''' = [https://music-ir.org/mirex/2009/results/abs Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcca)]<br />
 +
'''HNOS2''' = [https://music-ir.org/mirex/2009/results/abs Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcck)]<br />
 +
'''HNOS3''' = [https://music-ir.org/mirex/2009/results/abs Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tccl)]<br />
 +
'''HNOS4''' = [https://music-ir.org/mirex/2009/results/abs Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcpk)]<br />
 +
'''HW1'''  = [https://music-ir.org/mirex/2009/results/abs Huaxin Wang]<br />
 +
'''HW2'''  = [https://music-ir.org/mirex/2009/results/abs Huaxin Wang]<br />
 +
'''VA1''' = [https://music-ir.org/mirex/2009/results/abs T. Lidy, A. Grecu, A. Rauber, A. Pertusa, P. J. Ponce de Léon, J. M. Iñesta (WMV)]<br />
 +
'''VA2''' = [https://music-ir.org/mirex/2009/results/abs T. Lidy, A. Grecu, A. Rauber, A. Pertusa, P. J. Ponce de Léon, J. M. Iñesta (BWWV)]<br />
 +
'''LZG''' = [https://music-ir.org/mirex/2009/results/abs Yi Liu, Tao Zheng, Yue Gao (RUC_1)]<br />
 +
'''RCJ1''' = [https://music-ir.org/mirex/2009/results/abs Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang]<br />
 +
'''RCJ2''' = [https://music-ir.org/mirex/2009/results/abs Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang]<br />
 +
'''RCJ3''' = [https://music-ir.org/mirex/2009/results/abs Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang]<br />
 +
'''RCJ4''' = [https://music-ir.org/mirex/2009/results/abs Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang]<br />
 +
'''RK1''' = [https://music-ir.org/mirex/2009/results/abs Preeti Rao, Sujeet Kini]<br />
 +
'''SS''' = [https://music-ir.org/mirex/2009/results/abs Klaus Seyerlehner, Markus Schedl]<br />
 +
'''TTOS''' = [https://music-ir.org/mirex/2009/results/abs Emiru Tsunoo, George Tzanetakis, Nobutaka Ono, Shigeki Sagayama]<br />
 +
'''MTG1''' = [https://music-ir.org/mirex/2009/results/abs N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, rca)]<br />
 +
'''MTG2''' = [https://music-ir.org/mirex/2009/results/abs N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, rca)]<br />
 +
'''MTG3''' = [https://music-ir.org/mirex/2009/results/abs N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, simca)]<br />
 +
'''MTG4''' = [https://music-ir.org/mirex/2009/results/abs N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, simca)]<br />
 +
'''MTG5''' = [https://music-ir.org/mirex/2009/results/abs N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, svm)]<br />
 +
'''MTG6''' = [https://music-ir.org/mirex/2009/results/abs N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, svm)]<br />
 +
'''XLZZG''' = [https://music-ir.org/mirex/2009/results/abs Jieping Xu, Yi Liu, Tao Zheng, Chao Zhen, Yue Gao (RUC_1)]<br />
 +
'''XZZ''' = [https://music-ir.org/mirex/2009/results/abs JiePing Xu, Chao Zhen, Tao Zheng (RUC_2)]<br />
 +
 +
==Overall Summary Results==
 +
===Raw Classification Accuracy Averaged Over Three Train/Test Folds===
 +
 +
<csv p=3>audiogenre/summary_audiogenre.csv</csv>
 +
 +
===Accuracy Across Folds===
 +
 +
<csv p=3>audiogenre/audiogenre_Accuracy.csv</csv>
 +
 +
===Accuracy Across Categories===
 +
 +
<csv p=3>audiogenre/audiogenre_Accuracy_Per_Class.csv</csv>
 +
 +
==Friedman's Tests for Significant Differences==
 +
===Classes vs. System Tukey-Kramer HSD Multi-Comparisons ===
 +
The Friedman test was run in MATLAB against the average accuracy for each class. The Tukey-Kramer HSD multi-comparison data below was generated using the following MATLAB instruction. Command: <br />
 +
[c, m, h, gnames] = multicompare(stats, 'ctype', 'tukey-kramer', 'estimate', 'friedman', 'alpha', 0.05);
 +
 +
<csv p=3>audiogenre/audiogenre_Accuracy_Per_Class.friedman.tukeyKramerHSD.csv</csv>
  
 +
https://music-ir.org/mirex/2009/results/audiogenre/small.audiogenre_Accuracy_Per_Class.friedman.tukeyKramerHSD.png
  
−
==== Team ID ====
+
===Folds vs. Systems Tukey-Kramer HSD Multi-Comparison===
 +
The Friedman test was run in MATLAB against the accuracy for each fold. The Tukey-Kramer HSD multi-comparison data below was generated using the following MATLAB instruction. Command: <br /> [c, m, h, gnames] = multicompare(stats, 'ctype', 'tukey-kramer', 'estimate', 'friedman', 'alpha', 0.05);
 +
 
 +
<csv p=3>audiogenre/audiogenre_Accuracy.friedman.tukeyKramerHSD.csv
 +
</csv>
 +
 
 +
https://music-ir.org/mirex/2009/results/audiogenre/small.audiogenre_Accuracy.friedman.tukeyKramerHSD.png
 +
 
 +
==Hierarchical-Discounted Scoring Results==
 +
Because of space considerations, the [[Mixed Set Hierarchical-Discounted Scoring Results]] are present on a separate page.
 +
 
 +
==Results By Algorithm==
 +
(.tgz) <br />
 +
 
 +
'''ANO'''= [https://music-ir.org/mirex/2009/results/audiogenre/ANO.tgz  Anonymous]<br />
 +
'''BP1'''= [https://music-ir.org/mirex/2009/results/audiogenre/BP1.tgz Juan José Burred, Geoffroy Peeters (file)]<br />
 +
'''BP2''' = [https://music-ir.org/mirex/2009/results/audiogenre/BP2.tgz Juan José Burred, Geoffroy Peeters (tw)]<br />
 +
'''CL1''' = [https://music-ir.org/mirex/2009/results/audiogenre/CL1.tgz Chuan Cao, Ming Li]<br />
 +
'''CL2''' = [https://music-ir.org/mirex/2009/results/audiogenre/CL1.tgz Chuan Cao, Ming Li]<br />
 +
'''GP'''  = [https://music-ir.org/mirex/2009/results/audiogenre/GP.tgz Geoffroy Peeters]<br />
 +
'''GT1''' = [https://music-ir.org/mirex/2009/results/audiogenre/GT1.tgz George Tzanetakis (mono)]<br />
 +
'''GT2''' = [https://music-ir.org/mirex/2009/results/audiogenre/GT2.tgz George Tzanetakis (stereo)]<br />
 +
'''GLR1''' = [https://music-ir.org/mirex/2009/results/audiogenre/GLR1.tgz A. Grecu, T. Lidy, A. Rauber (full)]<br />
 +
'''GLR2''' = [https://music-ir.org/mirex/2009/results/audiogenre/GLR2.tgz  A. Grecu, T. Lidy, A. Rauber (template)]<br />
 +
'''HNOS1''' = [https://music-ir.org/mirex/2009/results/audiogenre/HNOS1.tgz Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcca)]<br />
 +
'''HNOS2''' = [https://music-ir.org/mirex/2009/results/audiogenre/HNOS2.tgz Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcck)]<br />
 +
'''HNOS3''' = [https://music-ir.org/mirex/2009/results/audiogenre/HNOS3.tgz Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tccl)]<br />
 +
'''HNOS4''' = [https://music-ir.org/mirex/2009/results/audiogenre/HNOS4.tgz Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcpk)]<br />
 +
'''HW1'''  = [https://music-ir.org/mirex/2009/results/audiogenre/HW1.tgz Huaxin Wang]<br />
 +
'''HW2'''  = [https://music-ir.org/mirex/2009/results/audiogenre/HW2.tgz Huaxin Wang]<br />
 +
'''VA1''' = [https://music-ir.org/mirex/2009/results/audiogenre/VA1.tgz T. Lidy, A. Grecu, A. Rauber, A. Pertusa, P. J. Ponce de Léon, J. M. Iñesta (WMV)]<br />
 +
'''VA2''' = [https://music-ir.org/mirex/2009/results/audiogenre/VA2.tgz T. Lidy, A. Grecu, A. Rauber, A. Pertusa, P. J. Ponce de Léon, J. M. Iñesta (BWWV)]<br />
 +
'''LZG''' = [https://music-ir.org/mirex/2009/results/audiogenre/LZG.tgz Yi Liu, Tao Zheng, Yue Gao (RUC_1)]<br />
 +
'''RCJ1''' = [https://music-ir.org/mirex/2009/results/audiogenre/RCJ1.tgz Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang]<br />
 +
'''RCJ2''' = [https://music-ir.org/mirex/2009/results/audiogenre/RCJ2.tgz Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang]<br />
 +
'''RCJ3''' = [https://music-ir.org/mirex/2009/results/audiogenre/RCJ3.tgz Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang]<br />
 +
'''RCJ4''' = [https://music-ir.org/mirex/2009/results/audiogenre/RCJ4.tgz Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang]<br />
 +
'''RK1''' = [https://music-ir.org/mirex/2009/results/audiogenre/RK1.tgz Preeti Rao, Sujeet Kini]<br />
 +
'''SS''' = [https://music-ir.org/mirex/2009/results/audiogenre/SS.tgz Klaus Seyerlehner, Markus Schedl]<br />
 +
'''TTOS''' = [https://music-ir.org/mirex/2009/results/audiogenre/TTOS.tgz Emiru Tsunoo, George Tzanetakis, Nobutaka Ono, Shigeki Sagayama]<br />
 +
'''MTG1''' = [https://music-ir.org/mirex/2009/results/audiogenre/MTG1.tgz N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, rca)]<br />
 +
'''MTG2''' = [https://music-ir.org/mirex/2009/results/audiogenre/MTG2.tgz N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, rca)]<br />
 +
'''MTG3''' = [https://music-ir.org/mirex/2009/results/audiogenre/MTG3.tgz N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, simca)]<br />
 +
'''MTG4''' = [https://music-ir.org/mirex/2009/results/audiogenre/MTG4.tgz N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, simca)]<br />
 +
'''MTG5''' = [https://music-ir.org/mirex/2009/results/audiogenre/MTG5.tgz N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, svm)]<br />
 +
'''MTG6''' = [https://music-ir.org/mirex/2009/results/audiogenre/MTG6.tgz N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, svm)]<br />
 +
'''XLZZG''' = [https://music-ir.org/mirex/2009/results/audiogenre/XLZZG.tgz Jieping Xu, Yi Liu, Tao Zheng, Chao Zhen, Yue Gao (RUC_1)]<br />
 +
'''XZZ''' = [https://music-ir.org/mirex/2009/results/audiogenre/XZZ.tgz JiePing Xu, Chao Zhen, Tao Zheng (RUC_2)]<br />
 +
 
 +
==Run Times==
  
−
'''ANO'''= [https://music-ir.org Anonymous]<br />
+
<csv>mood.runtime.csv</csv> TBA
−
'''BP1'''= [Juan José Burred, Geoffroy Peeters (file)]<br />
 
−
'''BP2''' = [Juan José Burred, Geoffroy Peeters (tw)]<br />
 
−
'''CL1''' = [Chuan Cao, Ming Li]<br />
 
−
'''CL2''' = [Chuan Cao, Ming Li]<br />
 
−
'''FCY1''' = [Tao Feng, XiaoOu Chen, DeShun Yang]<br />
 
−
'''FCY2''' = [Tao Feng, XiaoOu Chen, DeShun Yang]<br />
 
−
'''GP'''  = [Geoffroy Peeters]<br />
 
−
'''GT1''' = [George Tzanetakis (mono)]<br />
 
−
'''GT2''' = [George Tzanetakis (stereo)]<br />
 
−
'''GLR1''' = [A. Grecu, T. Lidy, A. Rauber (full)]<br />
 
−
'''GLR2''' = [A. Grecu, T. Lidy, A. Rauber (template)]<br />
 
−
'''HNOS1''' = [Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcca)]<br />
 
−
'''HNOS2''' = [Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcck)]<br />
 
−
'''HNOS3''' = [Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tccl)]<br />
 
−
'''HNOS4''' = [Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcpk)]<br />
 
−
'''HW1'''  = [Huaxin Wang]<br />
 
−
'''HW2'''  = [Huaxin Wang]<br />
 
−
'''VA1''' = [T. Lidy, A. Grecu, A. Rauber, A. Pertusa, P. J. Ponce de Léon, J. M. Iñesta (WMV)]<br />
 
−
'''VA2''' = [T. Lidy, A. Grecu, A. Rauber, A. Pertusa, P. J. Ponce de Léon, J. M. Iñesta (BWWV)]<br />
 
−
'''LZG''' = [Yi Liu, Tao Zheng, Yue Gao (RUC_1)]<br />
 
−
'''RK1''' = [Preeti Rao, Sujeet Kini]<br />
 
−
'''RK2''' = [Preeti Rao, Sujeet Kini]<br />
 
−
'''RCJ1''' = [Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang]<br />
 
−
'''RCJ2''' = [Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang]<br />
 
−
'''RCJ3''' = [Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang]<br />
 
−
'''RCJ4''' = [Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang]<br />
 
−
'''SS''' = [Klaus Seyerlehner, Markus Schedl]<br />
 
−
'''TAOS'''= [Emiru Tsunoo, Taichi Akase, Nobutaka Ono, Shigeki Sagayama]<br />
 
−
'''TTOS''' = [Emiru Tsunoo, George Tzanetakis, Nobutaka Ono, Shigeki Sagayama]<br />
 
−
'''MTG1''' = [N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, rca)]<br />
 
−
'''MTG2''' = [N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, rca)]<br />
 
−
'''MTG3''' = [N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, simca)]<br />
 
−
'''MTG4''' = [N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, simca)]<br />
 
−
'''MTG5''' = [N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, svm)]<br />
 
−
'''MTG6''' = [N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, svm)]<br />
 
−
'''XLZZG''' = [Jieping Xu, Yi Liu, Tao Zheng, Chao Zhen, Yue Gao (RUC_1)]<br />
 
−
'''XZZ''' = [JiePing Xu, Chao Zhen, Tao Zheng (RUC_2)]<br />
 
−
==Overall Summary Results==
 

Revision as of 10:02, 16 October 2009

Introduction

These are the results for the 2008 running of the Audio Genre Classification (Mixed Set) task. For background information about this task set please refer to the Audio Genre Classification page.

Mixed Set collection statistics: 7000 30-second audio clips in 22.05kHz mono WAV format drawn from 10 genres (700 clips from each genre). Genres:

  • Blues
  • Jazz
  • Country/Western
  • Baroque
  • Classical
  • Romantic
  • Electronica
  • Hip-Hop
  • Rock
  • HardRock/Metal

General Legend

Team ID

ANO= Anonymous
BP1= Juan José Burred, Geoffroy Peeters (file)
BP2 = Juan José Burred, Geoffroy Peeters (tw)
CL1 = Chuan Cao, Ming Li
CL2 = Chuan Cao, Ming Li
GP = Geoffroy Peeters
GT1 = George Tzanetakis (mono)
GT2 = George Tzanetakis (stereo)
GLR1 = A. Grecu, T. Lidy, A. Rauber (full)
GLR2 = A. Grecu, T. Lidy, A. Rauber (template)
HNOS1 = Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcca)
HNOS2 = Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcck)
HNOS3 = Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tccl)
HNOS4 = Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcpk)
HW1 = Huaxin Wang
HW2 = Huaxin Wang
VA1 = T. Lidy, A. Grecu, A. Rauber, A. Pertusa, P. J. Ponce de Léon, J. M. Iñesta (WMV)
VA2 = T. Lidy, A. Grecu, A. Rauber, A. Pertusa, P. J. Ponce de Léon, J. M. Iñesta (BWWV)
LZG = Yi Liu, Tao Zheng, Yue Gao (RUC_1)
RCJ1 = Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang
RCJ2 = Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang
RCJ3 = Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang
RCJ4 = Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang
RK1 = Preeti Rao, Sujeet Kini
SS = Klaus Seyerlehner, Markus Schedl
TTOS = Emiru Tsunoo, George Tzanetakis, Nobutaka Ono, Shigeki Sagayama
MTG1 = N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, rca)
MTG2 = N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, rca)
MTG3 = N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, simca)
MTG4 = N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, simca)
MTG5 = N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, svm)
MTG6 = N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, svm)
XLZZG = Jieping Xu, Yi Liu, Tao Zheng, Chao Zhen, Yue Gao (RUC_1)
XZZ = JiePing Xu, Chao Zhen, Tao Zheng (RUC_2)

Overall Summary Results

Raw Classification Accuracy Averaged Over Three Train/Test Folds

file /nema-raid/www/mirex/results/audiogenre/summary_audiogenre.csv not found

Accuracy Across Folds

file /nema-raid/www/mirex/results/audiogenre/audiogenre_Accuracy.csv not found

Accuracy Across Categories

file /nema-raid/www/mirex/results/audiogenre/audiogenre_Accuracy_Per_Class.csv not found

Friedman's Tests for Significant Differences

Classes vs. System Tukey-Kramer HSD Multi-Comparisons

The Friedman test was run in MATLAB against the average accuracy for each class. The Tukey-Kramer HSD multi-comparison data below was generated using the following MATLAB instruction. Command:
[c, m, h, gnames] = multicompare(stats, 'ctype', 'tukey-kramer', 'estimate', 'friedman', 'alpha', 0.05);

file /nema-raid/www/mirex/results/audiogenre/audiogenre_Accuracy_Per_Class.friedman.tukeyKramerHSD.csv not found

https://music-ir.org/mirex/2009/results/audiogenre/small.audiogenre_Accuracy_Per_Class.friedman.tukeyKramerHSD.png

Folds vs. Systems Tukey-Kramer HSD Multi-Comparison

The Friedman test was run in MATLAB against the accuracy for each fold. The Tukey-Kramer HSD multi-comparison data below was generated using the following MATLAB instruction. Command:
[c, m, h, gnames] = multicompare(stats, 'ctype', 'tukey-kramer', 'estimate', 'friedman', 'alpha', 0.05);

file /nema-raid/www/mirex/results/audiogenre/audiogenre_Accuracy.friedman.tukeyKramerHSD.csv not found

https://music-ir.org/mirex/2009/results/audiogenre/small.audiogenre_Accuracy.friedman.tukeyKramerHSD.png

Hierarchical-Discounted Scoring Results

Because of space considerations, the Mixed Set Hierarchical-Discounted Scoring Results are present on a separate page.

Results By Algorithm

(.tgz)

ANO= Anonymous
BP1= Juan José Burred, Geoffroy Peeters (file)
BP2 = Juan José Burred, Geoffroy Peeters (tw)
CL1 = Chuan Cao, Ming Li
CL2 = Chuan Cao, Ming Li
GP = Geoffroy Peeters
GT1 = George Tzanetakis (mono)
GT2 = George Tzanetakis (stereo)
GLR1 = A. Grecu, T. Lidy, A. Rauber (full)
GLR2 = A. Grecu, T. Lidy, A. Rauber (template)
HNOS1 = Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcca)
HNOS2 = Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcck)
HNOS3 = Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tccl)
HNOS4 = Takashi Hasegawa, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama (tcpk)
HW1 = Huaxin Wang
HW2 = Huaxin Wang
VA1 = T. Lidy, A. Grecu, A. Rauber, A. Pertusa, P. J. Ponce de Léon, J. M. Iñesta (WMV)
VA2 = T. Lidy, A. Grecu, A. Rauber, A. Pertusa, P. J. Ponce de Léon, J. M. Iñesta (BWWV)
LZG = Yi Liu, Tao Zheng, Yue Gao (RUC_1)
RCJ1 = Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang
RCJ2 = Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang
RCJ3 = Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang
RCJ4 = Jia-Min Ren, Zhi-Sheng Chen, Jyh-Shing Roger Jang
RK1 = Preeti Rao, Sujeet Kini
SS = Klaus Seyerlehner, Markus Schedl
TTOS = Emiru Tsunoo, George Tzanetakis, Nobutaka Ono, Shigeki Sagayama
MTG1 = N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, rca)
MTG2 = N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, rca)
MTG3 = N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, simca)
MTG4 = N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, simca)
MTG5 = N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (false, svm)
MTG6 = N. Wack, E. Guaus, C. Laurier, O. Meyers, R. Marxer, D. Bogdanov, J. Serrà, P. Herrera (true, svm)
XLZZG = Jieping Xu, Yi Liu, Tao Zheng, Chao Zhen, Yue Gao (RUC_1)
XZZ = JiePing Xu, Chao Zhen, Tao Zheng (RUC_2)

Run Times

file /nema-raid/www/mirex/results/mood.runtime.csv not found TBA

Retrieved from "https://music-ir.org/mirex/w/index.php?title=2009:Audio_Genre_Classification_(Mixed_Set)_Results&oldid=5474"