Difference between revisions of "2006:QBSH: Query-by-Singing/Humming Results"
(→Raw Scores) |
|||
| Line 6: | Line 6: | ||
====Team ID==== | ====Team ID==== | ||
'''AU''' = [https://www.music-ir.org/evaluation/MIREX/2006_abstracts/QBSH_uitdenbogerd.pdf Alexandra Uitdenbogerd]<br /> | '''AU''' = [https://www.music-ir.org/evaluation/MIREX/2006_abstracts/QBSH_uitdenbogerd.pdf Alexandra Uitdenbogerd]<br /> | ||
| − | ''' | + | '''CS1''' = [https://www.music-ir.org/evaluation/MIREX/2006_abstracts/QBSH_sailer.pdf Christian Sailer-ear]<br /> |
| + | '''CS2''' = [https://www.music-ir.org/evaluation/MIREX/2006_abstracts/QBSH_sailer.pdf Christian Sailer-midi]<br /> | ||
| + | '''CS3''' = [https://www.music-ir.org/evaluation/MIREX/2006_abstracts/QBSH_sailer.pdf Christian Sailer-warp]<br /> | ||
'''FH''' = Pascal Ferraro and Pierre Hanna<br /> | '''FH''' = Pascal Ferraro and Pierre Hanna<br /> | ||
'''NM''' = [https://www.music-ir.org/evaluation/MIREX/2006_abstracts/QBSH_mikkila.pdf Kjell Lemström, Niko Mikkilä, Veli Mäkinen and Esko Ukkonen]<br /> | '''NM''' = [https://www.music-ir.org/evaluation/MIREX/2006_abstracts/QBSH_mikkila.pdf Kjell Lemström, Niko Mikkilä, Veli Mäkinen and Esko Ukkonen]<br /> | ||
Revision as of 23:55, 25 September 2006
Contents
Introduction
These are the results for the 2006 running of the QBSH: Query-by-Singing Humming task set. For background information about this task set please refer to the QBSH: Query-by-Singing/Humming page.
General Legend
Team ID
AU = Alexandra Uitdenbogerd
CS1 = Christian Sailer-ear
CS2 = Christian Sailer-midi
CS3 = Christian Sailer-warp
FH = Pascal Ferraro and Pierre Hanna
NM = Kjell Lemström, Niko Mikkilä, Veli Mäkinen and Esko Ukkonen
RJ = Jyh-Shing Roger Jang and Nien-Jung Lee
RL = Ernesto Lopez and Martín Rocamora
RT = Rainer Typke, Frans Wiering and Remco C. Veltkamp
XW = Xiao Wu and Ming Li
Calculating Summary Measures
MRR = Mean Reciprocal Rank. Reciprocal rank is the reciprocal of the rank of the first correctly identified cover for each query (1/rank). These values are averaged for each ground truth group as well as overall.
Overall Summary Results
file /nema-raid/www/mirex/results/qbsh_overall_sum.csv not found
Task I: Friedman Test with Multiple Comparisons Results (p=0.05)
The Friedman test was run in MATLAB against the QBSH Task 1 MMR data over the 48 ground truth song groups.
Command: [c,m,h,gnames] = multcompare(stats, 'ctype', 'tukey-kramer','estimate', 'friedman', 'alpha', 0.05);
file /nema-raid/www/mirex/results/qush_friedman.csv not found
file /nema-raid/www/mirex/results/QBSH_sum.csv not found
Task I: Known-Item Searching Summary Results
MMR data summarized by the 48 ground truth song groups. file /nema-raid/www/mirex/results/qbsh_task1_sum.csv not found
Task II: Queries as Variations
Mean precision data summarized over the 48 ground truth song groups. file /nema-raid/www/mirex/results/qbsh06_task2_sum.csv not found
Raw Scores
The raw data are located on the Query-by-Singing/Humming Raw Data page.
