Difference between revisions of "2009:Music Structure Segmentation Results"
(→Evaluation Measures) |
|||
| Line 18: | Line 18: | ||
'''pwRecall''' - frame pair clustering recall rate from [http://dx.doi.org/10.1109/TASL.2007.910781 Levy & Sandler TASLP2008]<br> | '''pwRecall''' - frame pair clustering recall rate from [http://dx.doi.org/10.1109/TASL.2007.910781 Levy & Sandler TASLP2008]<br> | ||
'''R''' - Rand clustering index from [http://www.springerlink.com/content/x64124718341j1j0/fulltext.pdf Hubert & Arabie, "Comparing partitions", Journal of Classification, 1985]<br> | '''R''' - Rand clustering index from [http://www.springerlink.com/content/x64124718341j1j0/fulltext.pdf Hubert & Arabie, "Comparing partitions", Journal of Classification, 1985]<br> | ||
| − | '''Fmeasure@[0.5, 3]s''' - <br> | + | '''Fmeasure@[0.5, 3]s''' - segment boundary recovery evaluation measure. claimed boundary is accepted if it is within the specified window length from a true boundary, overall F-measure for boundary recovery<br> |
| − | '''precRate@[0.5, 3]s''' - <br> | + | '''precRate@[0.5, 3]s''' - segment boundary recovery precision rate<br> |
| − | '''recRate@[0.5, 3]s''' - <br> | + | '''recRate@[0.5, 3]s''' - segment boundary recovery recall rate<br> |
| − | '''medianTrue2claim | + | '''medianTrue2claim''' - median distance from an annotated segment boundary to the closest found boundary, seconds<br> |
| − | ''' | + | '''medianClaim2true''' - median distance from a found segment boundary to the closest annotated one, seconds<br> |
The calculation of the measures is described in [[Structural_Segmentation#Evaluation_Measures]]. | The calculation of the measures is described in [[Structural_Segmentation#Evaluation_Measures]]. | ||
Revision as of 02:41, 15 October 2009
Contents
Introduction
This task concerns itself with analyzing the structure of music audio files, and labeling the corresponding segments, e.g. {verse, chorus, bridge, etc}, {A, B, C, etc.}. A more detailed description can be found at the task page Structural_Segmentation. The dataset consists of 297 popular music songs.
General Legend
Team ID
ANO1 = Anonymous
ANO2 = Anonymous
MND = Matthias Mauch, Katy Noland, Simon Dixon
PK = Jouni Paulus, Anssi Klapuri
GP = Geoffroy Peeters
Evaluation Measures
overSegScore - normalised conditional entropy based over-segmentation score, S_o from Lukashevich ISMIR2008
underSegScore - normalised conditional entropy based under-segmentation score, S_u from Lukashevich ISMIR2008
pwF - frame pair clustering F-measure from Levy & Sandler TASLP2008
pwPrecision - frame pair clustering precision rate from Levy & Sandler TASLP2008
pwRecall - frame pair clustering recall rate from Levy & Sandler TASLP2008
R - Rand clustering index from Hubert & Arabie, "Comparing partitions", Journal of Classification, 1985
Fmeasure@[0.5, 3]s - segment boundary recovery evaluation measure. claimed boundary is accepted if it is within the specified window length from a true boundary, overall F-measure for boundary recovery
precRate@[0.5, 3]s - segment boundary recovery precision rate
recRate@[0.5, 3]s - segment boundary recovery recall rate
medianTrue2claim - median distance from an annotated segment boundary to the closest found boundary, seconds
medianClaim2true - median distance from a found segment boundary to the closest annotated one, seconds
The calculation of the measures is described in Structural_Segmentation#Evaluation_Measures.
MIREX 2009 Music Structure Summary Results - Mean of all Measures
file /nema-raid/www/mirex/results/structure/structure.summary.csv not found
MIREX 2009 Music Structure Summary Runtime Data
TBA
