Difference between revisions of "2008:Audio Chord Detection Results"
(→Task 2 Results) |
|||
| Line 54: | Line 54: | ||
===Task 2 Results=== | ===Task 2 Results=== | ||
| − | =====Task | + | =====Task 2 Overall Results===== |
<csv>chord/task2_results/summary.csv</csv> | <csv>chord/task2_results/summary.csv</csv> | ||
| − | ====Task | + | ====Task 2 Summary Data for Download==== |
| − | [https://www.music-ir.org/mirex/2008/results/chord/ | + | [https://www.music-ir.org/mirex/2008/results/chord/task2_results/all_filenames.csv File Name Set (Train-test runs)] <br /> |
| − | [https://www.music-ir.org/mirex/2008/results/chord/ | + | [https://www.music-ir.org/mirex/2008/results/chord/task2_results/all3folds_overlap_scores.csv Summary Overlap Data (Train-test runs)] <br /> |
| − | [https://www.music-ir.org/mirex/2008/results/chord/ | + | [https://www.music-ir.org/mirex/2008/results/chord/task2_results/all3folds_overlap_scores_majorMinor.csv Summary Overlap Data (Train-Test runs (Merged maj/min))] <br /> |
| − | ====Task | + | ====Task Friedman's Test for Significant Differences==== |
| − | The Friedman test was run in MATLAB against the Task | + | The Friedman test was run in MATLAB against the Task 2 Overlap Score data over the 176 ground truth songs. |
| − | <csv>chord/ | + | <csv>chord/task2_results/all3folds_friedman.txt</csv> |
The Tukey-Kramer HSD multi-comparison data below was generate using the following MATLAB instruction. | The Tukey-Kramer HSD multi-comparison data below was generate using the following MATLAB instruction. | ||
Command: [c,m,h,gnames] = multcompare(stats, 'ctype', 'tukey-kramer', 'estimate', 'friedman', 'alpha', 0.05); | Command: [c,m,h,gnames] = multcompare(stats, 'ctype', 'tukey-kramer', 'estimate', 'friedman', 'alpha', 0.05); | ||
| − | <csv>chord/ | + | <csv>chord/task2_results/task2_allFolds_friedman_detailed.csv</csv> |
| − | [[Image: | + | [[Image:Task2.allFolds_friedman.png]] |
[[Category: Results]] | [[Category: Results]] | ||
Revision as of 20:35, 9 September 2008
Contents
Introduction
These are the results for the 2008 running of the Audio Chord Detection task set. For background information about this task set please refer to the Audio Chord Detection page.
Task Descriptions
Task 1 (Pretrained Systems) Goto Task 1 Results: MERT NEED DESCRIPTION
Task 2 (Train-Test Systems) Goto Task 2 Results: MERT NEED DESCRIPTION
General Legend
Team ID for ChordPreTrained (Task 1)
BP = J. P. Bello, J. Pickens
KO = M. Khadkevich, M. Omologo
KL1 = K. Lee 1
KL2 = K. Lee 2
PP = H.Papadopoulos, G. Peeters
PVM = J. Pauwels, M. Varewyck, J-P. Martens
RK = M. Ryynänen, A. Klapuri
Team ID for ChordTrainTest (Task 2)
DE = D. Ellis
JL = X. Jhang, C. Lash
KO = M. Khadkevich, M. Omologo
KL = K. Lee (withtrain)
UMS = Y. Uchiyama, K. Miyamoto, S. Sagayama
WD1 = J. Weil
WD2 = J. Weil, J-L. Durrieu
Overall Summary Results
Task 1 Results
Task 1 Overall Results
file /nema-raid/www/mirex/results/chord/task1_results/pretrained_summary.csv not found
Task 1 Summary Data for Download
File Name Set (Pretrained runs)
Summary Overlap Data (Pretrained runs)
Summary Overlap Data (Pretrained runs (Merged maj/min))
Task 1 Friedman's Test for Significant Differences
The Friedman test was run in MATLAB against the Task 1 Overlap Score data over the 176 ground truth songs.
file /nema-raid/www/mirex/results/chord/task1_results/task1_friedman.csv not found
The Tukey-Kramer HSD multi-comparison data below was generate using the following MATLAB instruction.
Command: [c,m,h,gnames] = multcompare(stats, 'ctype', 'tukey-kramer', 'estimate', 'friedman', 'alpha', 0.05); file /nema-raid/www/mirex/results/chord/task1_results/friedman_detailed.csv not found
Task 2 Results
Task 2 Overall Results
file /nema-raid/www/mirex/results/chord/task2_results/summary.csv not found
Task 2 Summary Data for Download
File Name Set (Train-test runs)
Summary Overlap Data (Train-test runs)
Summary Overlap Data (Train-Test runs (Merged maj/min))
Task Friedman's Test for Significant Differences
The Friedman test was run in MATLAB against the Task 2 Overlap Score data over the 176 ground truth songs.
file /nema-raid/www/mirex/results/chord/task2_results/all3folds_friedman.txt not found
The Tukey-Kramer HSD multi-comparison data below was generate using the following MATLAB instruction.
Command: [c,m,h,gnames] = multcompare(stats, 'ctype', 'tukey-kramer', 'estimate', 'friedman', 'alpha', 0.05); file /nema-raid/www/mirex/results/chord/task2_results/task2_allFolds_friedman_detailed.csv not found
