2015:Audio Downbeat Estimation Results

From MIREX Wiki
Revision as of 00:28, 22 September 2015 by Florian (talk | contribs) (Created page with "= Submitted Algorithms = {|class="wikitable" style="text-align: left;" |+ Algorithms submitted to the Automatic Downbeat Estimation task ! width="80" | Submission code ...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Submitted Algorithms

Algorithms submitted to the Automatic Downbeat Estimation task
Submission code Submission name Abstract Contributors
DBDR2 DB1_no_ballroom PDF Simon Durand, Juan Bello, Bertrand David, Gael Richard
DBDR3 DB2_no_beatles PDF Simon Durand, Juan Bello, Bertrand David, Gael Richard
FK2 mixed_no_ballroom PDF Florian Krebs, Sebastian Böck
FK3 mixed_no_beatles PDF Florian Krebs, Sebastian Böck
FK4 carnatic_tracker PDF Florian Krebs, Sebastian Böck
FK6 2014_tracker_new_ss PDF Florian Krebs, Sebastian Böck

Results

Results ballroom dataset
Algorithm F-Measure Precision Recall
DBDR2 0.756 0.797 0.765
DBDR3 0.793 0.833 0.801
FK2 0.556 0.567 0.564
FK3 0.622 0.631 0.632
FK4 0.175 0.197 0.171
FK6 0.683 0.669 0.712


Results beatles dataset
Algorithm F-Measure Precision Recall
FK3 58.8 57.5 63.4
FK4 63.0 59.5 70.2
KSH1 19.4 21.1 20.8
DBDR2* 85.5 86.6 87.4c
DBDR3 81.6 81.4 85.6


Results carnatic dataset
Algorithm F-Measure Precision Recall
FK3 16.9 16.1 20.2
FK4 19.4 15.3 30.4
KSH1 40.0 39.9 41.4
DBDR2 18.4 15.6 25.9
DBDR3 20.0 16.9 28.2


Results turkish dataset
Algorithm F-Measure Precision Recall
FK3 19.7 15.8 28.9
FK4 24.0 18.2 38.7
KSH1* 77.5 75.9 81.9
DBDR2 44.8 40.0 55.3
DBDR3 44.8 39.5 56.5


Results cretan dataset
Algorithm F-Measure Precision Recall
FK3 53.5 86.6 39.3
FK4 51.2 74.5 39.4
KSH1* 85.4 88.2 84.1
DBDR2 43.5 65.5 32.5
DBDR3 41.5 62.5 31.0


Results hjdb dataset
Algorithm F-Measure Precision Recall
FK3 21.5 26.2 19.1
FK4 64.0 64.2 63.9
KSH1 9.4 16.7 8.5
DBDR2 64.2 65.1 64.2
DBDR3 66.7 67.6 66.8

*) Rows marked by an asterisk should be taken with care as in those cases overlapping test and training sets were used.

Runtime

All submissions except KSH1 finished the computations in less than 24 hours.