Difference between revisions of "2006:QBSH: Query-by-Singing/Humming Results"
(→Task I: Known-Item Searching Friedman Test with Multiple Comparisons Results (p=0.05)) |
(→Task I: Known-Item Searching Summary Results) |
||
| Line 29: | Line 29: | ||
<csv>QBSH_sum.csv</csv> | <csv>QBSH_sum.csv</csv> | ||
| − | ==Task I: Known-Item Searching Summary Results== | + | ==Task I: "Known-Item Searching" Summary Results== |
MMR data summarized by the 48 ground truth song groups. | MMR data summarized by the 48 ground truth song groups. | ||
<csv>qbsh_task1_sum.csv</csv> | <csv>qbsh_task1_sum.csv</csv> | ||
Revision as of 09:38, 27 September 2006
Contents
- 1 Introduction
- 2 Overall Summary Results
- 3 Task I: "Known-Item Searching" Friedman Test with Multiple Comparisons Results (p=0.05)
- 4 Task I: "Known-Item Searching" Summary Results
- 5 Task II: Queries as Variations Friedman Test with Multiple Comparisons Results (p=0.05)
- 6 Task II: Queries as Variations Summary Results
- 7 Raw Scores
Introduction
These are the results for the 2006 running of the QBSH: Query-by-Singing Humming task set. For background information about this task set please refer to the QBSH: Query-by-Singing/Humming page.
General Legend
Team ID
AU = Alexandra Uitdenbogerd
CS1 = Christian Sailer-ear
CS2 = Christian Sailer-midi
CS3 = Christian Sailer-warp
FH = Pascal Ferraro and Pierre Hanna
NM = Kjell Lemström, Niko Mikkilä, Veli Mäkinen and Esko Ukkonen
RJ = Jyh-Shing Roger Jang and Nien-Jung Lee
RL = Ernesto Lopez and Martín Rocamora
RT = Rainer Typke, Frans Wiering and Remco C. Veltkamp
XW = Xiao Wu and Ming Li
Calculating Summary Measures
MRR = Mean Reciprocal Rank. Reciprocal rank is the reciprocal of the rank of the first correctly identified cover for each query (1/rank). These values are averaged for each ground truth group as well as overall.
Overall Summary Results
file /nema-raid/www/mirex/results/qbsh_overall_sum.csv not found
Task I: "Known-Item Searching" Friedman Test with Multiple Comparisons Results (p=0.05)
The Friedman test was run in MATLAB against the QBSH Task 1 MRR data over the 48 ground truth song groups.
Command: [c,m,h,gnames] = multcompare(stats, 'ctype', 'tukey-kramer','estimate', 'friedman', 'alpha', 0.05);
file /nema-raid/www/mirex/results/qush_friedman.csv not found
file /nema-raid/www/mirex/results/QBSH_sum.csv not found
Task I: "Known-Item Searching" Summary Results
MMR data summarized by the 48 ground truth song groups. file /nema-raid/www/mirex/results/qbsh_task1_sum.csv not found
Task II: Queries as Variations Friedman Test with Multiple Comparisons Results (p=0.05)
The Friedman test was run in MATLAB against the QBSH Task 2 mean precision data over the 48 ground truth song groups.
Command: [c,m,h,gnames] = multcompare(stats, 'ctype', 'tukey-kramer','estimate', 'friedman', 'alpha', 0.05);
file /nema-raid/www/mirex/results/qbsh2_friedman.csv not found
file /nema-raid/www/mirex/results/qbsh2_sum.csv not found
Task II: Queries as Variations Summary Results
Mean precision data summarized over the 48 ground truth song groups. file /nema-raid/www/mirex/results/qbsh06_task2_sum.csv not found
Raw Scores
The raw data are located on the Query-by-Singing/Humming Raw Data page.
