2018:Automatic Lyrics-to-Audio Alignment Results

General Legend

Sub code	Submission name	Abstract	Contributors
CW1	HMM-based Alignment subtask1	[PDF]	Chung-Che Wang
CW2	HMM-based Alignment monophone acoustic models subtask2	PDF	Chung-Che Wang
CW3	HMM-based Alignment bi-phone acoustic models subtask2	PDF	Chung-Che Wang
GSLW1	GMM-HMM (SAT) Models subtask2	PDF	Chitralekha Gupta, Bidisha Sharma, Haizhou Li, Ye Wang
GSLW2	SAT+DNN Models subtask2	PDF	Chitralekha Gupta, Bidisha Sharma, Haizhou Li, Ye Wang
GSLW3	Non-vocal suppression and SAT Models subtask 2	PDF	Chitralekha Gupta, Bidisha Sharma, Haizhou Li, Ye Wang
FFJ1	subtask 1 & 2	[PDF]	Yang-Bin Dell Fan, Zhe-Cheng Fan, Jyh-Shing Roger Jang

Results

Subtask2: English pop songs

Hansen's dataset a cappella

Summary Results

Submission	Mean ASE	Mean PCS	Mean PCETW
CW2	0.35	0.65	0.79
CW3	0.47	0.62	0.81
GSLW1	2.66	0.39	0.48
GSLW2	2.90	0.35	0.40
GSLW3	5.80	0.31	0.31

download these results as csv

Per-track results

CW2

Track	ASE	PCS	PCETW
Madonna-Beautiful_Stranger_full_ending	0.31	0.570093890373057	0.777372262773723
i_kissed_a_girl	0.2	0.703915182929027	0.848484848484848
clocks_cut	0.19	0.790849995302038	0.835294117647059
rehab	0.17	0.805194335473958	0.865131578947369
rolling_in_the_deep	0.82	0.481665469290785	0.680555555555556
sunrise	0.52	0.513409547058522	0.672
this_afternoon	0.18	0.68360542512406	0.895555555555555
trick_me	0.5	0.530746028428777	0.772413793103448
umbrella	0.52	0.546212118854114	0.72
viva_la_vida	0.13	0.842945012210246	0.879432624113475

download these results as csv

CW3

Track	ASE	PCS	PCETW
Madonna-Beautiful_Stranger_full_ending	0.32	0.545755317403897	0.744525547445255
i_kissed_a_girl	0.25	0.674245470835476	0.837121212121212
clocks_cut	0.15	0.767154471687807	0.894117647058824
rehab	0.13	0.796814864279409	0.898026315789474
rolling_in_the_deep	0.57	0.522259080218718	0.727777777777778
sunrise	1.72	0.267711468622025	0.504
this_afternoon	0.15	0.683714791923987	0.915555555555556
trick_me	0.86	0.562015684740021	0.875862068965517
umbrella	0.4	0.616793375576461	0.8425
viva_la_vida	0.17	0.78921921137274	0.875886524822695

download these results as csv

GSLW1

Track	ASE	PCS	PCETW
Madonna-Beautiful_Stranger_full_ending	0.27	0.543259128122919	0.805860805860806
i_kissed_a_girl	0.11	0.763207570129874	0.946969696969697
clocks_cut	0.63	0.554917222456744	0.905882352941176
rehab	2.07	0.071219687000756	0.05921052631579
rolling_in_the_deep	3.15	0.009252640391624	0.027777777777778
sunrise	3.68	0.127399217474657	0.08
this_afternoon	13.61	0	0
trick_me	2.97	0.080867269977835	0
umbrella	0.08	0.795244553082193	0.97323600973236
viva_la_vida	0.04	0.926735844657678	0.98936170212766

download these results as csv

GSLW2

Track	ASE	PCS	PCETW
Madonna-Beautiful_Stranger_full_ending	0.48	0.47449184033124	0.684981684981685
i_kissed_a_girl	0.34	0.647207424371483	0.829545454545455
clocks_cut	2.33	0.570135233602421	0.717647058823529
rehab	0.85	0.144820599809062	0.006578947368421
rolling_in_the_deep	3.19	0.016695413804996	0.013888888888889
sunrise	4.44	0.041273457518474	0.008
this_afternoon	13.66	0.006072269630639	0
trick_me	2.98	0.058593676899486	0.006896551724138
umbrella	0.48	0.788270711351441	0.788321167883212
viva_la_vida	0.2	0.766924833336262	0.968085106382979

download these results as csv

GSLW3

Track	ASE	PCS	PCETW
Madonna-Beautiful_Stranger_full_ending	19.85	0.002186924613191	0
i_kissed_a_girl	7.61	0.026256826598641	0.035294117647059
clocks_cut	0.85	0.144820599809062	0.006578947368421
rehab	9.5	0.010902142506288	0.013888888888889
rolling_in_the_deep	4	0.186314997894924	0
sunrise	13.06	0.028738675715158	0.057777777777778
this_afternoon	2.97	0.080867269977835	0
trick_me	0.08	0.795244553082193	0.97323600973236
umbrella	0.04	0.926735844657678	0.98936170212766
viva_la_vida	0.04	0.926735844658	0.99

download these results as csv