Difference between revisions of "2006:QBSH: Query-by-Singing/Humming Results"
(→Task I: Friedman Test with Multiple Comparisons Results (p=0.05)) |
(→Task II: Queries as Variations) |
||
| Line 39: | Line 39: | ||
<csv>qbsh2_friedman.csv</csv> | <csv>qbsh2_friedman.csv</csv> | ||
<csv>qbsh2_sum.csv</csv> | <csv>qbsh2_sum.csv</csv> | ||
| − | ==Task II: Queries as Variations== | + | ==Task II: Queries as Variations Summary Results== |
Mean precision data summarized over the 48 ground truth song groups. | Mean precision data summarized over the 48 ground truth song groups. | ||
<csv>qbsh06_task2_sum.csv</csv> | <csv>qbsh06_task2_sum.csv</csv> | ||
Revision as of 23:15, 25 September 2006
Contents
- 1 Introduction
- 2 Overall Summary Results
- 3 Task I: Known-Item Searching Friedman Test with Multiple Comparisons Results (p=0.05)
- 4 Task I: Known-Item Searching Summary Results
- 5 Task II: Friedman Test with Multiple Comparisons Results (p=0.05)
- 6 Task II: Queries as Variations Summary Results
- 7 Raw Scores
Introduction
These are the results for the 2006 running of the QBSH: Query-by-Singing Humming task set. For background information about this task set please refer to the QBSH: Query-by-Singing/Humming page.
General Legend
Team ID
AU = Alexandra Uitdenbogerd
CS1 = Christian Sailer-ear
CS2 = Christian Sailer-midi
CS3 = Christian Sailer-warp
FH = Pascal Ferraro and Pierre Hanna
NM = Kjell Lemström, Niko Mikkilä, Veli Mäkinen and Esko Ukkonen
RJ = Jyh-Shing Roger Jang and Nien-Jung Lee
RL = Ernesto Lopez and Martín Rocamora
RT = Rainer Typke, Frans Wiering and Remco C. Veltkamp
XW = Xiao Wu and Ming Li
Calculating Summary Measures
MRR = Mean Reciprocal Rank. Reciprocal rank is the reciprocal of the rank of the first correctly identified cover for each query (1/rank). These values are averaged for each ground truth group as well as overall.
Overall Summary Results
file /nema-raid/www/mirex/results/qbsh_overall_sum.csv not found
Task I: Known-Item Searching Friedman Test with Multiple Comparisons Results (p=0.05)
The Friedman test was run in MATLAB against the QBSH Task 1 MRR data over the 48 ground truth song groups.
Command: [c,m,h,gnames] = multcompare(stats, 'ctype', 'tukey-kramer','estimate', 'friedman', 'alpha', 0.05);
file /nema-raid/www/mirex/results/qush_friedman.csv not found
file /nema-raid/www/mirex/results/QBSH_sum.csv not found
Task I: Known-Item Searching Summary Results
MMR data summarized by the 48 ground truth song groups. file /nema-raid/www/mirex/results/qbsh_task1_sum.csv not found
Task II: Friedman Test with Multiple Comparisons Results (p=0.05)
The Friedman test was run in MATLAB against the QBSH Task 1 MMR data over the 48 ground truth song groups.
Command: [c,m,h,gnames] = multcompare(stats, 'ctype', 'tukey-kramer','estimate', 'friedman', 'alpha', 0.05);
file /nema-raid/www/mirex/results/qbsh2_friedman.csv not found
file /nema-raid/www/mirex/results/qbsh2_sum.csv not found
Task II: Queries as Variations Summary Results
Mean precision data summarized over the 48 ground truth song groups. file /nema-raid/www/mirex/results/qbsh06_task2_sum.csv not found
Raw Scores
The raw data are located on the Query-by-Singing/Humming Raw Data page.
