2017:Drum Transcription Results

What's new

Two new datasets.

Submissions

https://drive.google.com/open?id=0B5QVjGCSDYW1Nk16dkZmYUpEM2c

	Abstract	Contributors
CS1-CS3 (Chordino)	PDF	Carl Southall
CW1-CW3	PDF	Chih-Wei Wu
RV1-RV4	PDF	Richard Vogl

Results

Overall

Algorithm	mean fm	mean pr	mean rc	BD mean fm	SD mean fm	HH mean fm
CW1	0.51	0.46	0.68	0.68	0.48	0.38
CW3	0.53	0.50	0.65	0.67	0.46	0.42
CW2	0.55	0.52	0.66	0.70	0.55	0.40
RV3	0.68	0.74	0.70	0.81	0.64	0.51
RV2	0.67	0.69	0.73	0.78	0.67	0.51
RV1	0.71	0.75	0.74	0.82	0.70	0.53
RV4	0.70	0.74	0.73	0.81	0.70	0.52
CS1	0.61	0.56	0.73	0.79	0.55	0.46
CS3	0.63	0.59	0.75	0.78	0.58	0.49
CS2	0.63	0.61	0.71	0.78	0.57	0.49

download these results as csv

2005 baseline: 0.670 (YGO) *1

IDMT

Algorithm	mean fm	mean pr	mean rc	BD mean fm	SD mean fm	HH mean fm
CW1	0.37	0.30	0.66	0.55	0.45	0.26
CW3	0.42	0.37	0.62	0.53	0.44	0.32
CW2	0.41	0.35	0.67	0.56	0.54	0.28
RV3	0.62	0.73	0.68	0.73	0.70	0.45
RV2	0.66	0.69	0.75	0.74	0.71	0.54
RV1	0.66	0.74	0.73	0.75	0.72	0.53
RV4	0.66	0.74	0.72	0.74	0.73	0.51
CS1	0.51	0.49	0.64	0.62	0.48	0.42
CS3	0.51	0.51	0.63	0.60	0.48	0.43
CS2	0.52	0.54	0.63	0.60	0.51	0.43

download these results as csv

2005 baseline: 0.753 (CD)

KT

Algorithm	mean fm	mean pr	mean rc	BD mean fm	SD mean fm	HH mean fm
CW1	0.48	0.40	0.67	0.59	0.44	0.40
CW3	0.48	0.43	0.62	0.58	0.42	0.41
CW2	0.52	0.48	0.64	0.60	0.53	0.41
RV3	0.62	0.73	0.60	0.77	0.63	0.46
RV2	0.63	0.66	0.65	0.76	0.68	0.45
RV1	0.65	0.73	0.64	0.80	0.68	0.47
RV4	0.65	0.72	0.63	0.79	0.68	0.44
CS1	0.53	0.48	0.63	0.71	0.50	0.38
CS3	0.56	0.52	0.65	0.71	0.53	0.40
CS2	0.55	0.52	0.61	0.70	0.52	0.39

download these results as csv

2005 baseline: 0.617 (YGO)

RBMA

Algorithm	mean fm	mean pr	mean rc	BD mean fm	SD mean fm	HH mean fm
CW1	0.50	0.46	0.61	0.71	0.35	0.39
CW3	0.54	0.51	0.63	0.75	0.30	0.47
CW2	0.54	0.52	0.61	0.73	0.37	0.46
RV3	0.69	0.71	0.73	0.89	0.49	0.55
RV2	0.70	0.68	0.78	0.91	0.60	0.55
RV1	0.72	0.74	0.75	0.91	0.62	0.56
RV4	0.72	0.73	0.76	0.92	0.64	0.57
CS1	0.66	0.60	0.79	0.88	0.45	0.57
CS3	0.66	0.60	0.81	0.87	0.49	0.58
CS2	0.64	0.60	0.72	0.87	0.43	0.54

download these results as csv

MEDLEY

Algorithm	mean fm	mean pr	mean rc	BD mean fm	SD mean fm	HH mean fm
CW1	0.62	0.61	0.68	0.76	0.52	0.53
CW3	0.59	0.56	0.66	0.71	0.49	0.52
CW2	0.62	0.62	0.65	0.75	0.55	0.52
RV3	0.69	0.79	0.66	0.74	0.62	0.57
RV2	0.66	0.77	0.63	0.60	0.62	0.64
RV1	0.73	0.78	0.73	0.75	0.70	0.60
RV4	0.70	0.79	0.68	0.70	0.68	0.61
CS1	0.68	0.65	0.76	0.83	0.60	0.57
CS3	0.74	0.70	0.82	0.84	0.67	0.65
CS2	0.72	0.71	0.76	0.82	0.62	0.65

download these results as csv

GEN

Algorithm	mean fm	mean pr	mean rc	BD mean fm	SD mean fm	HH mean fm
CW1	0.60	0.53	0.76	0.80	0.64	0.33
CW3	0.63	0.60	0.72	0.79	0.66	0.36
CW2	0.65	0.65	0.72	0.84	0.74	0.33
RV3	0.76	0.73	0.83	0.90	0.77	0.50
RV2	0.70	0.63	0.83	0.89	0.75	0.38
RV1	0.78	0.74	0.86	0.91	0.80	0.50
RV4	0.76	0.72	0.84	0.90	0.79	0.48
CS1	0.68	0.59	0.84	0.90	0.73	0.37
CS3	0.69	0.61	0.85	0.86	0.75	0.39
CS2	0.72	0.65	0.84	0.89	0.74	0.42

download these results as csv