2017:Automatic Lyrics-to-Audio Alignment Results

General Legend

Sub code	Submission name	Abstract	Contributors
AK1	HMM-based Alignment	PDF	Anna Kruspe
AK2	DTW-based Alignment	PDF	Anna Kruspe
AK3	Levenshtein-based Alignment	PDF	Anna Kruspe
DMS1	Automatic Lyrics-to-Audio Alignment with Harmonic Modeling	PDF	Georgi Dzhambazov, Xavier Serra
DMS2	Automatic Lyrics-to-Audio Alignment with Source Separation	PDF	Georgi Dzhambazov, Marius Miron

Results

Hansen's Dataset A cappella

Summary Results

file /nema-raid/www/mirex/results/2017/ala/summary_results.csv not found

Per-song results

AK1

Track	Average absolute error	Percentage of correct segments
clocks	41.510	0.008
i_kissed_a_girl	0.180	0.721
rehab	0.040	0.927
rolling_in_the_deep	0.860	0.438
sunrise	0.670	0.700
this_afternoon	0.990	0.599
trick_me	0.170	0.751
umbrella	1.450	0.462
viva_la_vida	0.120	0.842

download these results as csv

AK2

Track	Average absolute error	Percentage of correct segments
clocks	73.560	0.008
i_kissed_a_girl	0.270	0.626
rehab	0.290	0.795
rolling_in_the_deep	3.930	0.284
sunrise	0.470	0.761
this_afternoon	1.820	0.385
trick_me	0.110	0.804
umbrella	2.040	0.297
viva_la_vida	5.470	0.209

download these results as csv

AK3

Track	Average absolute error	Percentage of correct segments
clocks	21.890	0.152
i_kissed_a_girl	0.140	0.704
rehab	0.070	0.889
rolling_in_the_deep	1.060	0.489
sunrise	0.760	0.627
this_afternoon	0.260	0.545
trick_me	0.140	0.762
umbrella	1.300	0.489
viva_la_vida	0.210	0.742

download these results as csv

DMS1 file /nema-raid/www/mirex/results/2017/ala/results_dms1_acap.csv not found

DMS2 file /nema-raid/www/mirex/results/2017/ala/results_dms2_acap.csv not found

Hansen's Dataset

Summary Results

Submission	Mean error	Median error	St. dev. error	Mean percentage	Median percentage	St. dev. percentage
AK1	13.96	7.64	12.73	0.12	0.06	0.12
AK2	27.94	19.58	31.86	0.10	0.03	0.13
AK3	7.34	4.55	7.71	0.25	0.28	0.15
DMS1	26.70	14.94	29.97	0.04	0.02	0.05
DMS2	10.57	2.02	23.30	0.34	0.44	0.18

download these results as csv

Per-song results

AK1

Track	Average absolute error	Percentage of correct segments
clocks	42.760	0.002
i_kissed_a_girl	7.640	0.052
rehab	6.040	0.061
rolling_in_the_deep	2.990	0.245
sunrise	3.240	0.308
this_afternoon	2.650	0.277
trick_me	18.130	0.078
umbrella	16.330	0.014
viva_la_vida	25.820	0.009

download these results as csv

AK2

Track	Average absolute error	Percentage of correct segments
clocks	107.720	0.001
i_kissed_a_girl	6.590	0.067
rehab	5.780	0.164
rolling_in_the_deep	31.660	0.002
sunrise	4.260	0.405
this_afternoon	24.200	0.029
trick_me	1.800	0.231
umbrella	49.870	0.004
viva_la_vida	19.580	0.017

download these results as csv

DMS1 file /nema-raid/www/mirex/results/2017/ala/results_dms1_hansen.csv not found

DMS2 file /nema-raid/www/mirex/results/2017/ala/results_dms2_hansen.csv not found

Mauchs's Dataset

Summary Results

Submission	Mean error	Median error	St. dev. error	Mean percentage	Median percentage	St. dev. percentage
AK1	17.70	10.14	17.01	0.08	0.04	0.10
AK2	22.23	16.38	22.08	0.02	0.00	0.04
AK3	9.03	7.52	7.23	0.15	0.15	0.10
DMS1	14.91	10.14	15.30	0.04	0.03	0.04
DMS2	11.64	5.12	13.31	0.14	0.14	0.10

download these results as csv

Per-song results

AK1

Track	Average absolute error	Percentage of correct segments
Abba.KnowingMeKnowingYou	9.400	0.064
Bangles.EternalFlame	38.270	0.007
Blondie.CallMe	34.340	0.011
Duffy.WarwickAvenue	7.200	0.176
DuranDuran.OrdinaryWorld	12.780	0.020
FranzFerdinand.DoYouWantTo	5.520	0.046
Martika.ToySoldiers	20.050	0.001
Muse.GuidingLight	66.170	0.002
OtisRedding.TheDockOfTheBay	0.920	0.348
Queen.WeAreTheChampions	6.430	0.088
RM-P082	43.130	0.034
RM-P084	9.520	0.101
RobertPalmer.AddictedToLove	10.750	0.019
Santana.BlackMagicWoman	39.870	0.004
SimonAndGarfunkel.Cecilia	5.940	0.041
TakeThat.BackForGood	3.090	0.125
TinaTurner.WhatsLoveGotToDoWithIt	10.850	0.113
Toto.Africa	4.650	0.299
U2.WithOrWithoutYou	19.570	0.024
Zweieck.She	5.610	0.174

download these results as csv

AK2 file /nema-raid/www/mirex/results/2017/ala/results_alignD_mauch.csv not found

DMS1 file /nema-raid/www/mirex/results/2017/ala/results_dms1_mauch.csv not found

DMS2 file /nema-raid/www/mirex/results/2017/ala/results_dms2_mauch.csv not found