2017:Drum Transcription Results - Revision history

Richard Vogl: /* MDB subset */

2017-10-24T02:47:16Z

‎MDB subset

2017-10-22T03:04:14Z

2017-10-19T08:54:41Z

2017-10-18T17:07:21Z

2017-10-18T16:51:57Z

2017-10-18T16:51:17Z

2017-10-18T16:34:19Z

2017-10-18T16:32:48Z

2017-10-14T11:24:52Z

2017-10-14T11:20:09Z

@@ Line 59: / Line 59: @@
 === MDB subset ===
 <csv>2017/dt/eval-set_results_MEDLEY.csv</csv>
 === GEN subset ===
 <csv>2017/dt/eval-set_results_GEN.csv</csv>

@@ Line 18: / Line 18: @@
 |-
 | CS1-CS3
-| style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2017/CS.pdf PDF]
+| style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2017/CS4.pdf PDF]
 | Carl Southall
 |-
@@ Line 29: / Line 29: @@
 | Richard Vogl
 |}
 == Results ==
@@ Line 55: / Line 57: @@
 <csv>2017/dt/eval-set_results_RBMA.csv</csv>
-=== MEDLEY subset ===
+=== MDB subset ===
 <csv>2017/dt/eval-set_results_MEDLEY.csv</csv>
 === GEN subset ===
 <csv>2017/dt/eval-set_results_GEN.csv</csv>

@@ Line 26: / Line 26: @@
 |-
 | RV1-RV4
-| style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/RV.pdf PDF]
+| style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2017/RV1.pdf PDF]
 | Richard Vogl
 |}

@@ Line 45: / Line 45: @@
 <csv>2017/dt/eval-set_results_IDMT.csv</csv>
-baseline: ""0.753"" (CD)
+baseline: '''0.753''' (CD)
 === KT subset ===
 <csv>2017/dt/eval-set_results_KT.csv</csv>
-baseline: ""0.617"" (YGO)
+baseline: '''0.617''' (YGO)
 === RBMA subset ===

@@ Line 37: / Line 37: @@
 <csv>2017/dt/eval-set_results_global.csv</csv>
-baseline: *0.670* (YGO)
+baseline: '''0.670''' (YGO)
 The best overall result from 2005 is only provided to put the current results into perspective.
@@ Line 45: / Line 45: @@
 <csv>2017/dt/eval-set_results_IDMT.csv</csv>
-baseline: *0.753* (CD)
+baseline: ""0.753"" (CD)
 === KT subset ===
 <csv>2017/dt/eval-set_results_KT.csv</csv>
-baseline: *0.617* (YGO)
+baseline: ""0.617"" (YGO)
 === RBMA subset ===

@@ Line 42: / Line 42: @@
 Since the overall result form 2005 was calculated on different datasets it is problematic to compare them directly.
-=== IDMTsubset ===
+=== IDMT subset ===
 <csv>2017/dt/eval-set_results_IDMT.csv</csv>

@@ Line 1: / Line 1: @@
 == Introduction ==
-== What's new ==
+As in 2005 only the three main drum instruments (kick drum, snare drum, and hi-hat) are considered.
+Additionally to the two datasets from 2005, three new datasets were used in the evaluation.
-Two new datasets.
+For training the algorithms, the public training set from 2005 plus additional training data taken from the new datasets was provided to the participants.
 == Submissions ==
 {| class="wikitable"
@@ Line 31: / Line 31: @@
 == Results ==
 === Overall ===
 <csv>2017/dt/eval-set_results_global.csv</csv>
-baseline: 0.670 (YGO) *1
+baseline: 0.670 (YGO)
-=== IDMT ===
+=== IDMTsubset ===
 <csv>2017/dt/eval-set_results_IDMT.csv</csv>
 baseline: 0.753 (CD)
-=== KT ===
+=== KT subset ===
 <csv>2017/dt/eval-set_results_KT.csv</csv>
 baseline: 0.617 (YGO)
-=== RBMA ===
+=== RBMA subset ===
 <csv>2017/dt/eval-set_results_RBMA.csv</csv>
-=== MEDLEY ===
+=== MEDLEY subset ===
 <csv>2017/dt/eval-set_results_MEDLEY.csv</csv>
-=== GEN ===
+=== GEN subset ===
 <csv>2017/dt/eval-set_results_GEN.csv</csv>

← Older revision		Revision as of 11:20, 14 October 2017
Line 1:		Line 1:
−	~~Coming soon~~	+	== Introduction ==
		+
		+
		+	== What's new ==
		+
		+	Two new datasets.
		+
		+
		+	== Submissions ==
		+
		+	https://drive.google.com/open?id=0B5QVjGCSDYW1Nk16dkZmYUpEM2c
		+
		+
		+	{\| class="wikitable"
		+	!
		+	! Abstract
		+	! Contributors
		+	\|-
		+	\| CS1-CS3 (<em>Chordino</em>)
		+	\| style="text-align: center;" \| [https://www.music-ir.org/mirex/abstracts/2017/CS.pdf PDF]
		+	\| Carl Southall
		+	\|-
		+	\| CW1-CW3
		+	\| style="text-align: center;" \| [https://www.music-ir.org/mirex/abstracts/2017/CW.pdf PDF]
		+	\| Chih-Wei Wu
		+	\|-
		+	\| RV1-RV4
		+	\| style="text-align: center;" \| [https://www.music-ir.org/mirex/abstracts/2016/RV.pdf PDF]
		+	\| Richard Vogl
		+	\|}
		+
		+	== Results ==
		+
		+	=== Overall ===
		+	<csv>2017/dt/eval-set_results_global.csv</csv>
		+
		+	2005 baseline: 0.670 (YGO) *1
		+
		+	=== IDMT ===
		+	<csv>2017/dt/eval-set_results_IDMT.csv</csv>
		+
		+	2005 baseline: 0.753 (CD)
		+
		+	=== KT ===
		+	<csv>2017/dt/eval-set_results_KT.csv</csv>
		+
		+	2005 baseline: 0.617 (YGO)
		+
		+	=== RBMA ===
		+	<csv>2017/dt/eval-set_results_RBMA.csv</csv>
		+
		+	=== MEDLEY ===
		+	<csv>2017/dt/eval-set_results_MEDLEY.csv</csv>
		+
		+	=== GEN ===
		+	<csv>2017/dt/eval-set_results_GEN.csv</csv>