Latest revision as of 04:29, 10 October 2014

Submitted Algorithms

Algorithms submitted to the Automatic Downbeat Estimation task
Submission code	Submission name	Abstract	Contributors

DBDR2	DB1_no_ballroom	PDF	Simon Durand, Juan Bello, Bertrand David, Gael Richard
DBDR3	DB2_no_beatles	PDF	Simon Durand, Juan Bello, Bertrand David, Gael Richard
FK3	Ballroom_tracker	PDF	Florian Krebs
FK4	Ballroom_Pop_tracker	PDF	Florian Krebs
KSH1	Turkish_Indian_Cretan_tracker	PDF	Florian Krebs, Andre Holzapfel, Ajay Srinivasamurthy

Results ballroom dataset
Algorithm	F-Measure	Precision	Recall
FK3*	79.2	77.6	81.6
FK4*	70.8	68.0	75.8
KSH1	19.4	22.7	19.9
DBDR2	70.5	75.4	70.3
DBDR3*	75.2	80.0	75.2

Results beatles dataset
Algorithm	F-Measure	Precision	Recall
FK3	58.8	57.5	63.4
FK4	63.0	59.5	70.2
KSH1	19.4	21.1	20.8
DBDR2*	83.1	82.6	87.1
DBDR3	81.6	81.4	85.6

Results carnatic dataset
Algorithm	F-Measure	Precision	Recall
FK3	16.9	16.1	20.2
FK4	19.4	15.3	30.4
KSH1	40.0	39.9	41.4
DBDR2	18.4	15.6	25.9
DBDR3	20.0	16.9	28.2

Results turkish dataset
Algorithm	F-Measure	Precision	Recall
FK3	19.7	15.8	28.9
FK4	24.0	18.2	38.7
KSH1*	77.5	75.9	81.9
DBDR2	44.8	40.0	55.3
DBDR3	44.8	39.5	56.5

Results cretan dataset
Algorithm	F-Measure	Precision	Recall
FK3	53.5	86.6	39.3
FK4	51.2	74.5	39.4
KSH1*	85.4	88.2	84.1
DBDR2	43.5	65.5	32.5
DBDR3	41.5	62.5	31.0

Results hjdb dataset
Algorithm	F-Measure	Precision	Recall
FK3	21.5	26.2	19.1
FK4	64.0	64.2	63.9
KSH1	9.4	16.7	8.5
DBDR2	64.2	65.1	64.2
DBDR3	66.7	67.6	66.8

*) Rows marked by an asterisk should be taken with care as in those cases overlapping test and training sets were used.

All submissions except KSH1 finished the computations in less than 24 hours.

@@ Line 1: / Line 1: @@
-== Submitted Algorithms ==
+= Submitted Algorithms =
 {|class="wikitable" style="text-align: left;"
@@ Line 28: / Line 28: @@
 |}
-== Results ==
+= Results =
 {| class="wikitable sortable" border="1"
@@ Line 207: / Line 207: @@
 {| class="wikitable sortable" border="1"
-|+ Results hjdb dataset (preliminary)
+|+ Results hjdb dataset
 |-
 ! Algorithm
@@ Line 240: / Line 240: @@
 |}
-<nowiki>*</nowiki>) Rows marked by an asterisk have to be taken with care as overlapping test and training set were used.
+<nowiki>*</nowiki>) Rows marked by an asterisk should be taken with care as in those cases overlapping test and training sets were used.
+= Runtime =
+All submissions except KSH1 finished the computations in less than 24 hours.