2019:Automatic Lyrics-to-Audio Alignment Results

From MIREX Wiki
Revision as of 07:53, 5 November 2019 by Georgi Dzhambazov (talk | contribs) (→‎Hansen's dataset)

General Legend

Sub code Submission name Abstract Contributors
GYL1 NUS PDF Chitralekha Gupta, Haizhou Li, Emre Yilmaz
ED1 Audio2Lyrics_emirdemirel PDF Emir Demirel
SDE1 PDF Daniel Stoller, Simon Durand, Sebastian Ewert
SDE2 PDF Daniel Stoller, Simon Durand, Sebastian Ewert
LJ2 Force Alignment with Kaldi PDF Chuan You Lin, Jyh-Shing Roger Jang, Huang Hsiang-Yu

Results

Hansen's dataset a cappella

Summary Results

Submission Mean AAE Mean MAE Mean PCS Mean PCETW
GYL1 0.13 0.03 0.79 0.97
ED1 0.28 0.04 0.74 0.93
SDE2 0.21 0.08 0.47 0.94

download these results as csv

Per-track results

GYL1

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct estimates with tolerance window
clocks_cut 0.287 0.023 0.750 0.953
i_kissed_a_girl 0.096 0.053 0.786 0.947
Madonna-Beautiful_Stranger_full_ending 0.076 0.034 0.787 0.960
rehab 0.035 0.018 0.905 0.990
rolling_in_the_deep 0.133 0.038 0.646 0.939
sunrise 0.515 0.019 0.587 0.896
this_afternoon 0.034 0.028 0.903 1.000
trick_me 0.031 0.022 0.903 1.000
umbrella 0.055 0.041 0.738 0.988
viva_la_vida 0.054 0.033 0.911 0.979

download these results as csv

ED1

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct estimates with tolerance window
clocks_cut 1.190 0.037 0.497 0.871
i_kissed_a_girl 0.102 0.053 0.769 0.966
Madonna-Beautiful_Stranger_full_ending 0.110 0.042 0.757 0.923
rehab 0.036 0.020 0.935 0.993
rolling_in_the_deep 0.371 0.046 0.624 0.858
sunrise 0.644 0.034 0.591 0.832
this_afternoon 0.068 0.035 0.822 0.976
trick_me 0.152 0.033 0.703 0.938
umbrella 0.111 0.053 0.740 0.944
viva_la_vida 0.054 0.030 0.915 0.979

download these results as csv

SDE2

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct estimates with tolerance window
clocks_cut 0.288 0.073 0.507 0.953
i_kissed_a_girl 0.087 0.077 0.556 1.000
Madonna-Beautiful_Stranger_full_ending 0.101 0.067 0.405 0.963
rehab 0.130 0.083 0.490 0.958
rolling_in_the_deep 0.173 0.067 0.461 0.939
sunrise 0.542 0.069 0.449 0.840
this_afternoon 0.098 0.077 0.513 0.987
trick_me 0.276 0.096 0.407 0.914
umbrella 0.225 0.104 0.351 0.832
viva_la_vida 0.137 0.071 0.610 0.982

download these results as csv


Hansen's dataset

Summary Results

Submission Mean AAE Mean MAE Mean PCS Mean PCETW
GYL1 0.10 0.04 0.78 0.97
ED1 3.47 0.26 0.49 0.69
SDE2 0.39 0.09 0.44 0.88

download these results as csv

Per-track results

GYL1

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct estimates with tolerance window
clocks_cut 0.028 0.021 0.801 1.000
i_kissed_a_girl 0.060 0.051 0.858 0.992
Madonna-Beautiful_Stranger_full_ending 0.080 0.036 0.765 0.933
rehab 0.049 0.042 0.850 1.000
rolling_in_the_deep 0.111 0.035 0.709 0.964
sunrise 0.348 0.046 0.702 0.888
this_afternoon 0.049 0.041 0.869 1.000
trick_me 0.158 0.051 0.648 0.959
umbrella 0.043 0.028 0.770 0.985
viva_la_vida 0.088 0.085 0.858 0.993

download these results as csv

ED1

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct estimates with tolerance window
clocks_cut 2.046 0.042 0.567 0.847
i_kissed_a_girl 0.202 0.074 0.683 0.894
Madonna-Beautiful_Stranger_full_ending 11.740 0.244 0.379 0.530
rehab 0.195 0.053 0.736 0.895
rolling_in_the_deep 1.238 0.067 0.462 0.689
sunrise 0.745 0.065 0.539 0.776
this_afternoon 7.727 0.581 0.331 0.469
trick_me 2.304 0.103 0.373 0.655
umbrella 0.841 0.059 0.565 0.742
viva_la_vida 7.645 1.307 0.227 0.394

download these results as csv

SDE2

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct estimates with tolerance window
clocks_cut 0.205 0.071 0.560 0.929
i_kissed_a_girl 0.107 0.085 0.550 0.977
Madonna-Beautiful_Stranger_full_ending 0.164 0.078 0.375 0.910
rehab 0.242 0.095 0.417 0.882
rolling_in_the_deep 0.185 0.071 0.441 0.917
sunrise 0.938 0.082 0.431 0.784
this_afternoon 0.140 0.092 0.433 0.934
trick_me 0.600 0.122 0.248 0.728
umbrella 1.212 0.113 0.301 0.742
viva_la_vida 0.115 0.080 0.624 0.961

download these results as csv

Mauch's dataset

Summary Results

file /nema-raid/www/mirex/results/2019/ala/mauch/summary_mauch.csv not found

Per-track results

CW2 file /nema-raid/www/mirex/results/2019/ala/mauch/CW2_mauch.csv not found

CW3 file /nema-raid/www/mirex/results/2019/ala/mauch/CW3_mauch.csv not found

GSLW1 file /nema-raid/www/mirex/results/2019/ala/mauch/GSLW1_mauch.csv not found

GSLW2 file /nema-raid/www/mirex/results/2019/ala/mauch/GSLW2_mauch.csv not found

GSLW3

Track ASE PCS PCETW
Abba.KnowingMeKnowingYou 16.78 0.013470170808295 0
Bangles.EternalFlame 11.14 0.02898885485713 0.027450980392157
Blondie.CallMe 38.38 0 0
Duffy.WarwickAvenue 22.44 0.002410707267485 0.003787878787879
DuranDuran.OrdinaryWorld 26.87 0.026182638371089 0.030651340996169
FranzFerdinand-DoYouWanTo 13.38 0.00161317780798 0
Martika.ToySoldiers 21.94 0.0166667440527 0.03
Muse.GuidingLight 19.4 0.023893393487038 0.008620689655172
OtisRedding.TheDockOfTheBay 41.62 0 0
RM-P082 36.45 0.002038977644714 0
RM-P084 9.48 0.08661632622508 0.2
Queen.WeAreTheChampions 26.9 0 0
RobertPalmer.AddictedToLove 31.52 0 0
Santana.BlackMagicWoman 29.5 0.123035938934082 0
SimonAndGarfunkel.Cecilia 38.23 0 0
TakeThat.BackForGood 10.99 0.028435153463603 0.047619047619048
TinaTurner.WhatsLoveGotToDoWithIt 25.93 0.02372512809696 0.015479876160991
Toto.Africa 11.81 0.002388174061774 0.018939393939394
U2.WithOrWithoutYou 14.81 0.011272516767769 0.005235602094241
Zweieck.She 22.05 0.00600489576593 0.008583690987124

download these results as csv


Gracenote dataset

Summary Results

file /nema-raid/www/mirex/results/2019/ala/gracenote/summary_gracenote.csv not found

Per-track results

CW2 file /nema-raid/www/mirex/results/2019/ala/gracenote/CW2_gracenote.csv not found

CW3 file /nema-raid/www/mirex/results/2019/ala/gracenote/CW3_gracenote.csv not found

GSLW1 file /nema-raid/www/mirex/results/2019/ala/gracenote/GSLW1_gracenote.csv not found

GSLW2 file /nema-raid/www/mirex/results/2019/ala/gracenote/GSLW2_gracenote.csv not found

GSLW3 file /nema-raid/www/mirex/results/2019/ala/gracenote/GSLW3_gracenote.csv not found

Retrieved from "https://music-ir.org/mirex/w/index.php?title=2019:Automatic_Lyrics-to-Audio_Alignment_Results&oldid=13131"