Difference between revisions of "2009:Audio Tag Classification (MajorMinor) Set Results"
(→Team ID) |
|||
Line 1: | Line 1: | ||
− | ==General Legend== | + | ==Introduction== |
− | + | ===General Legend=== | |
− | ===Team ID=== | + | ====Team ID==== |
'''BP1''' = [[Juan José Burred, Geoffroy Peeters]]<br /> | '''BP1''' = [[Juan José Burred, Geoffroy Peeters]]<br /> | ||
'''BP2''' = [[Juan José Burred, Geoffroy Peeters]]<br /> | '''BP2''' = [[Juan José Burred, Geoffroy Peeters]]<br /> | ||
− | ''' | + | '''CC1''' = [[Chuan Cao, Ming Li]]<br /> |
− | ''' | + | '''CC2''' = [[Chuan Cao, Ming Li]]<br /> |
− | ''' | + | '''CC3''' = [[Chuan Cao, Ming Li]]<br /> |
− | ''' | + | '''CC4''' = [[Chuan Cao, Ming Li]]<br /> |
'''GP''' = [[Geoffroy Peeters]]<br /> | '''GP''' = [[Geoffroy Peeters]]<br /> | ||
'''GT1''' = [[George Tzanetakis]]<br /> | '''GT1''' = [[George Tzanetakis]]<br /> | ||
'''GT2''' = [[George Tzanetakis]]<br /> | '''GT2''' = [[George Tzanetakis]]<br /> | ||
− | '''LWW1''' = [[Hung-Yi Lo,Ju-Chiang Wang,Hsin-Min Wang]]<br /> | + | '''LWW1''' = [[Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang]]<br /> |
− | '''LWW2''' = [[Hung-Yi Lo,Ju-Chiang Wang,Hsin-Min Wang]]<br /> | + | '''LWW2''' = [[Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang]]<br /> |
− | ''' | + | '''HCB''' = [[Matthew D.Hoffman, David M. Blei, Perry R.Cook]]<br /> |
+ | |||
+ | ==Overall Summary Results (Binary)== | ||
+ | |||
+ | <csv p=3>tag/MajorMiner/summary_binary.csv</csv> | ||
+ | |||
+ | |||
+ | |||
+ | ===Summary Binary Relevance F-Measure (Average Across All Folds)=== | ||
+ | |||
+ | <csv p=3>tag/MajorMiner/binary_avg_Fmeasure.csv</csv> | ||
+ | |||
+ | ===Summary Binary Accuracy (Average Across All Folds)=== | ||
+ | |||
+ | <csv p=3>tag/MajorMiner/binary_avg_Accuracy.csv</csv> | ||
+ | |||
+ | ===Summary Positive Example Accuracy (Average Across All Folds)=== | ||
+ | |||
+ | <csv p=3>tag/MajorMiner/binary_avg_positive_example_Accuracy.csv</csv> | ||
+ | |||
+ | ===Summary Negative Example Accuracy (Average Across All Folds)=== | ||
+ | |||
+ | <csv p=3>tag/MajorMiner/binary_avg_negative_example_Accuracy.csv</csv> | ||
+ | |||
+ | ==Overall Summary Results (Affinity)== | ||
+ | |||
+ | <csv p=3>tag/MajorMiner/summary_affinity.csv</csv> | ||
+ | |||
+ | ===Summary AUC-ROC Tag (Average Across All Folds)=== | ||
+ | |||
+ | <csv p=3>tag/MajorMiner/affinity_tag_AUC_ROC.csv</csv> | ||
+ | |||
+ | ==Select Friedman's Test Results== | ||
+ | ===Tag F-measure (Binary) Friedman Test=== | ||
+ | The following table and plot show the results of Friedman's ANOVA with Tukey-Kramer multiple comparisons computed over the F-measure for each '''tag''' in the test, averaged over all folds. | ||
+ | |||
+ | <csv p=3>tag/MajorMiner/binary_FMeasure.friedman.tukeyKramerHSD.csv</csv> | ||
+ | |||
+ | |||
+ | https://music-ir.org/mirex/2009/results/tag/MajorMiner/small.binary_FMeasure.friedman.tukeyKramerHSD.png | ||
+ | |||
+ | ===Per Track F-measure (Binary) Friedman Test=== | ||
+ | The following table and plot show the results of Friedman's ANOVA with Tukey-Kramer multiple comparisons computed over the F-measure for each '''track''' in the test, averaged over all folds. | ||
+ | <csv p=3>tag/MajorMiner/binary_FMeasure_per_track.friedman.tukeyKramerHSD.csv</csv> | ||
+ | |||
+ | |||
+ | https://music-ir.org/mirex/2009/results/tag/MajorMiner/small.binary_FMeasure_per_track.friedman.tukeyKramerHSD.png | ||
+ | |||
+ | ===Per Track AUC-ROC (Affinity) Friedman Test=== | ||
+ | The following table and plot show the results of Friedman's ANOVA with Tukey-Kramer multiple comparisons computed over the Area Under the ROC curve (AUC-ROC) for each '''track/clip''' in the test, averaged over all folds. | ||
+ | |||
+ | <csv p=3>tag/MajorMiner/affinity.AUC_ROC_TRACK.friedman.tukeyKramerHSD.csv</csv> | ||
+ | |||
+ | https://music-ir.org/mirex/2009/results/tag/MajorMiner/small.affinity.AUC_ROC_TRACK.friedman.tukeyKramerHSD.png | ||
+ | |||
+ | ==Assorted Results Files for Download== | ||
+ | ===General Results=== | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity_tag_fold_AUC_ROC.csv affinity_tag_fold_AUC_ROC.csv]<br /> | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity_clip_AUC_ROC.csv affinity_clip_AUC_ROC.csv]<br /> | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/binary_per_fold_Accuracy.csv binary_per_fold_Accuracy.csv]<br /> | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/binary_per_fold_Fmeasure.csv binary_per_fold_Fmeasure.csv]<br /> | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/binary_per_fold_negative_example_Accuracy.csv binary_per_fold_negative_example_Accuracy.csv]<br /> | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/binary_per_fold_per_track_Accuracy.csv binary_per_fold_per_track_Accuracy.csv]<br /> | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/binary_per_fold_per_track_Fmeasure.csv binary_per_fold_per_track_Fmeasure.csv]<br /> | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/binary_per_fold_per_track_negative_example_Accuracy.csv binary_per_fold_per_track_negative_example_Accuracy.csv]<br /> | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/binary_per_fold_per_track_positive_example_Accuracy.csv binary_per_fold_per_track_positive_example_Accuracy.csv]<br /> | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/binary_per_fold_positive_example_Accuracy.csv binary_per_fold_positive_example_Accuracy.csv]<br /> | ||
+ | |||
+ | ===Friedman's Tests Results=== | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity.PrecisionAt3.friedman.tukeyKramerHSD.csv affinity.PrecisionAt3.friedman.tukeyKramerHSD.csv ]<br /> | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity.PrecisionAt3.friedman.tukeyKramerHSD.png affinity.PrecisionAt3.friedman.tukeyKramerHSD.png]<br /> | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity.PrecisionAt6.friedman.tukeyKramerHSD.csv affinity.PrecisionAt6.friedman.tukeyKramerHSD.csv]<br /> | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity.PrecisionAt6.friedman.tukeyKramerHSD.png affinity.PrecisionAt6.friedman.tukeyKramerHSD.png]<br /> | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity.PrecisionAt9.friedman.tukeyKramerHSD.csv affinity.PrecisionAt9.friedman.tukeyKramerHSD.csv]<br /> | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity.PrecisionAt9.friedman.tukeyKramerHSD.png affinity.PrecisionAt9.friedman.tukeyKramerHSD.png ]<br /> | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity.PrecisionAt12.friedman.tukeyKramerHSD.csv affinity.PrecisionAt12.friedman.tukeyKramerHSD.csv]<br /> | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity.PrecisionAt12.friedman.tukeyKramerHSD.png affinity.PrecisionAt12.friedman.tukeyKramerHSD.png]<br /> | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity.PrecisionAt15.friedman.tukeyKramerHSD.csv affinity.PrecisionAt15.friedman.tukeyKramerHSD.csv]<br /> | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity.PrecisionAt15.friedman.tukeyKramerHSD.png affinity.PrecisionAt15.friedman.tukeyKramerHSD.png]<br /> | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/binary_Accuracy.friedman.tukeyKramerHSD.csv binary_Accuracy.friedman.tukeyKramerHSD.csv]<br /> | ||
+ | [https://music-ir.org/mirex/2009/results/tag/MajorMiner/binary_Accuracy.friedman.tukeyKramerHSD.png binary_Accuracy.friedman.tukeyKramerHSD.png]<br /> | ||
+ | |||
+ | ===Results By Algorithm=== | ||
+ | (.tgz format) <br /> | ||
+ | |||
+ | '''BP1''' = [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/BP1.tgz Juan José Burred, Geoffroy Peeters]<br /> | ||
+ | '''BP2''' = [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/BP2.tgz Juan José Burred, Geoffroy Peeters]<br /> | ||
+ | '''CC1''' = [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/CC1.tgz Chuan Cao, Ming Li]<br /> | ||
+ | '''CC2''' = [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/CC2.tgz Chuan Cao, Ming Li]<br /> | ||
+ | '''CC3''' = [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/CC3.tgz Chuan Cao, Ming Li]<br /> | ||
+ | '''CC4''' = [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/CC4.tgz Chuan Cao, Ming Li]<br /> | ||
+ | '''GP''' = [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/GP.tgz Geoffroy Peeters]<br /> | ||
+ | '''GT1''' = [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/GT1.tgz George Tzanetakis]<br /> | ||
+ | '''GT2''' = [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/GT2.tgz George Tzanetakis]<br /> | ||
+ | '''LWW1''' = [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/LWW1.tgz Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang]<br /> | ||
+ | '''LWW2''' = [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/LWW2.tgz Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang]<br /> | ||
+ | '''HCB''' = [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/HCB.tgz Matthew D.Hoffman, David M. Blei, Perry R.Cook]<br /> |
Revision as of 22:50, 13 October 2009
Contents
Introduction
General Legend
Team ID
BP1 = Juan José Burred, Geoffroy Peeters
BP2 = Juan José Burred, Geoffroy Peeters
CC1 = Chuan Cao, Ming Li
CC2 = Chuan Cao, Ming Li
CC3 = Chuan Cao, Ming Li
CC4 = Chuan Cao, Ming Li
GP = Geoffroy Peeters
GT1 = George Tzanetakis
GT2 = George Tzanetakis
LWW1 = Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang
LWW2 = Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang
HCB = Matthew D.Hoffman, David M. Blei, Perry R.Cook
Overall Summary Results (Binary)
file /nema-raid/www/mirex/results/tag/MajorMiner/summary_binary.csv not found
Summary Binary Relevance F-Measure (Average Across All Folds)
file /nema-raid/www/mirex/results/tag/MajorMiner/binary_avg_Fmeasure.csv not found
Summary Binary Accuracy (Average Across All Folds)
file /nema-raid/www/mirex/results/tag/MajorMiner/binary_avg_Accuracy.csv not found
Summary Positive Example Accuracy (Average Across All Folds)
file /nema-raid/www/mirex/results/tag/MajorMiner/binary_avg_positive_example_Accuracy.csv not found
Summary Negative Example Accuracy (Average Across All Folds)
file /nema-raid/www/mirex/results/tag/MajorMiner/binary_avg_negative_example_Accuracy.csv not found
Overall Summary Results (Affinity)
file /nema-raid/www/mirex/results/tag/MajorMiner/summary_affinity.csv not found
Summary AUC-ROC Tag (Average Across All Folds)
file /nema-raid/www/mirex/results/tag/MajorMiner/affinity_tag_AUC_ROC.csv not found
Select Friedman's Test Results
Tag F-measure (Binary) Friedman Test
The following table and plot show the results of Friedman's ANOVA with Tukey-Kramer multiple comparisons computed over the F-measure for each tag in the test, averaged over all folds.
file /nema-raid/www/mirex/results/tag/MajorMiner/binary_FMeasure.friedman.tukeyKramerHSD.csv not found
Per Track F-measure (Binary) Friedman Test
The following table and plot show the results of Friedman's ANOVA with Tukey-Kramer multiple comparisons computed over the F-measure for each track in the test, averaged over all folds. file /nema-raid/www/mirex/results/tag/MajorMiner/binary_FMeasure_per_track.friedman.tukeyKramerHSD.csv not found
Per Track AUC-ROC (Affinity) Friedman Test
The following table and plot show the results of Friedman's ANOVA with Tukey-Kramer multiple comparisons computed over the Area Under the ROC curve (AUC-ROC) for each track/clip in the test, averaged over all folds.
file /nema-raid/www/mirex/results/tag/MajorMiner/affinity.AUC_ROC_TRACK.friedman.tukeyKramerHSD.csv not found
Assorted Results Files for Download
General Results
affinity_tag_fold_AUC_ROC.csv
affinity_clip_AUC_ROC.csv
binary_per_fold_Accuracy.csv
binary_per_fold_Fmeasure.csv
binary_per_fold_negative_example_Accuracy.csv
binary_per_fold_per_track_Accuracy.csv
binary_per_fold_per_track_Fmeasure.csv
binary_per_fold_per_track_negative_example_Accuracy.csv
binary_per_fold_per_track_positive_example_Accuracy.csv
binary_per_fold_positive_example_Accuracy.csv
Friedman's Tests Results
affinity.PrecisionAt3.friedman.tukeyKramerHSD.csv
affinity.PrecisionAt3.friedman.tukeyKramerHSD.png
affinity.PrecisionAt6.friedman.tukeyKramerHSD.csv
affinity.PrecisionAt6.friedman.tukeyKramerHSD.png
affinity.PrecisionAt9.friedman.tukeyKramerHSD.csv
affinity.PrecisionAt9.friedman.tukeyKramerHSD.png
affinity.PrecisionAt12.friedman.tukeyKramerHSD.csv
affinity.PrecisionAt12.friedman.tukeyKramerHSD.png
affinity.PrecisionAt15.friedman.tukeyKramerHSD.csv
affinity.PrecisionAt15.friedman.tukeyKramerHSD.png
binary_Accuracy.friedman.tukeyKramerHSD.csv
binary_Accuracy.friedman.tukeyKramerHSD.png
Results By Algorithm
(.tgz format)
BP1 = Juan José Burred, Geoffroy Peeters
BP2 = Juan José Burred, Geoffroy Peeters
CC1 = Chuan Cao, Ming Li
CC2 = Chuan Cao, Ming Li
CC3 = Chuan Cao, Ming Li
CC4 = Chuan Cao, Ming Li
GP = Geoffroy Peeters
GT1 = George Tzanetakis
GT2 = George Tzanetakis
LWW1 = Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang
LWW2 = Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang
HCB = Matthew D.Hoffman, David M. Blei, Perry R.Cook