2014:MIREX2014 Results/ade

From MIREX Wiki
Revision as of 05:46, 9 October 2014 by Florian (talk | contribs)

Submitted Algorithms

Submission code Submission name Abstract Contributors
DBDR2 DB1_no_ballroom PDF Simon Durand, Juan Bello, Bertrand David, Gael Richard
DBDR3 DB2_no_beatles PDF Simon Durand, Juan Bello, Bertrand David, Gael Richard
FK3 Ballroom_tracker PDF Florian Krebs
FK4 Ballroom_Pop_tracker PDF Florian Krebs
KSH1 Turkish_Indian_Cretan_tracker PDF Florian Krebs, Andre Holzapfel, Ajay Srinivasamurthy

Table 1. Algorithms submitted to the Automatic Downbeat Estimation task.

Results

Results ballroom dataset
Algorithm F-Measure Precision Recall
FK3* 79.2 77.6 81.6
FK4* 70.8 68.0 75.8
KSH1 19.4 22.7 19.9
DBDR2 70.5 75.4 70.3
DBDR3* 75.2 80.0 75.2


Results beatles dataset
Algorithm F-Measure Precision Recall
FK3 58.8 57.5 63.4
FK4 63.0 59.5 70.2
KSH1 19.4 21.1 20.8
DBDR2* 83.1 82.6 87.1
DBDR3 81.6 81.4 85.6


Results carnatic dataset
Algorithm F-Measure Precision Recall
FK3 16.9 16.1 20.2
FK4 19.4 15.3 30.4
KSH1 40.0 39.9 41.4
DBDR2 18.4 15.6 25.9
DBDR3 20.0 16.9 28.2


Results turkish dataset
Algorithm F-Measure Precision Recall
FK3 19.7 15.8 28.9
FK4 24.0 18.2 38.7
KSH1* 77.5 75.9 81.9
DBDR2 44.8 40.0 55.3
DBDR3 44.8 39.5 56.5


Results cretan dataset
Algorithm F-Measure Precision Recall
FK3 53.5 86.6 39.3
FK4 51.2 74.5 39.4
KSH1* 85.4 88.2 84.1
DBDR2 43.5 65.5 32.5
DBDR3 41.5 62.5 31.0
Results hjdb dataset
Algorithm F-Measure Precision Recall
FK3 21.5 26.2 19.1
FK4 64.0 64.2 63.9
KSH1 9.4 16.7 8.5
DBDR2 64.2 65.1 64.2
DBDR3 66.7 67.6 66.8
  • ) Submissions marked by an asterisk partially include the test set into their training set.