2019:Automatic Lyrics-to-Audio Alignment Results
From MIREX Wiki
Revision as of 07:52, 5 November 2019 by Georgi Dzhambazov (talk | contribs)
Contents
General Legend
| Sub code | Submission name | Abstract | Contributors |
|---|---|---|---|
| GYL1 | NUS | Chitralekha Gupta, Haizhou Li, Emre Yilmaz | |
| ED1 | Audio2Lyrics_emirdemirel | Emir Demirel | |
| SDE1 | Daniel Stoller, Simon Durand, Sebastian Ewert | ||
| SDE2 | Daniel Stoller, Simon Durand, Sebastian Ewert | ||
| LJ2 | Force Alignment with Kaldi | Chuan You Lin, Jyh-Shing Roger Jang, Huang Hsiang-Yu |
Results
Hansen's dataset a cappella
Summary Results
| Submission | Mean AAE | Mean MAE | Mean PCS | Mean PCETW |
|---|---|---|---|---|
| GYL1 | 0.13 | 0.03 | 0.79 | 0.97 |
| ED1 | 0.28 | 0.04 | 0.74 | 0.93 |
| SDE2 | 0.21 | 0.08 | 0.47 | 0.94 |
Per-track results
GYL1
| Track | Average absolute error | Median absolute error | Percentage of correct segments | Percentage of correct estimates with tolerance window |
|---|---|---|---|---|
| clocks_cut | 0.287 | 0.023 | 0.750 | 0.953 |
| i_kissed_a_girl | 0.096 | 0.053 | 0.786 | 0.947 |
| Madonna-Beautiful_Stranger_full_ending | 0.076 | 0.034 | 0.787 | 0.960 |
| rehab | 0.035 | 0.018 | 0.905 | 0.990 |
| rolling_in_the_deep | 0.133 | 0.038 | 0.646 | 0.939 |
| sunrise | 0.515 | 0.019 | 0.587 | 0.896 |
| this_afternoon | 0.034 | 0.028 | 0.903 | 1.000 |
| trick_me | 0.031 | 0.022 | 0.903 | 1.000 |
| umbrella | 0.055 | 0.041 | 0.738 | 0.988 |
| viva_la_vida | 0.054 | 0.033 | 0.911 | 0.979 |
ED1
| Track | Average absolute error | Median absolute error | Percentage of correct segments | Percentage of correct estimates with tolerance window |
|---|---|---|---|---|
| clocks_cut | 1.190 | 0.037 | 0.497 | 0.871 |
| i_kissed_a_girl | 0.102 | 0.053 | 0.769 | 0.966 |
| Madonna-Beautiful_Stranger_full_ending | 0.110 | 0.042 | 0.757 | 0.923 |
| rehab | 0.036 | 0.020 | 0.935 | 0.993 |
| rolling_in_the_deep | 0.371 | 0.046 | 0.624 | 0.858 |
| sunrise | 0.644 | 0.034 | 0.591 | 0.832 |
| this_afternoon | 0.068 | 0.035 | 0.822 | 0.976 |
| trick_me | 0.152 | 0.033 | 0.703 | 0.938 |
| umbrella | 0.111 | 0.053 | 0.740 | 0.944 |
| viva_la_vida | 0.054 | 0.030 | 0.915 | 0.979 |
SDE2
| Track | Average absolute error | Median absolute error | Percentage of correct segments | Percentage of correct estimates with tolerance window |
|---|---|---|---|---|
| clocks_cut | 0.288 | 0.073 | 0.507 | 0.953 |
| i_kissed_a_girl | 0.087 | 0.077 | 0.556 | 1.000 |
| Madonna-Beautiful_Stranger_full_ending | 0.101 | 0.067 | 0.405 | 0.963 |
| rehab | 0.130 | 0.083 | 0.490 | 0.958 |
| rolling_in_the_deep | 0.173 | 0.067 | 0.461 | 0.939 |
| sunrise | 0.542 | 0.069 | 0.449 | 0.840 |
| this_afternoon | 0.098 | 0.077 | 0.513 | 0.987 |
| trick_me | 0.276 | 0.096 | 0.407 | 0.914 |
| umbrella | 0.225 | 0.104 | 0.351 | 0.832 |
| viva_la_vida | 0.137 | 0.071 | 0.610 | 0.982 |
Hansen's dataset
Summary Results
| Submission | Mean AAE | Mean MAE | Mean PCS | Mean PCETW |
|---|---|---|---|---|
| GYL1 | 0.10 | 0.04 | 0.78 | 0.97 |
| ED1 | 3.47 | 0.26 | 0.49 | 0.69 |
| SDE2 | 0.39 | 0.09 | 0.44 | 0.88 |
Per-track results
Per-track results
GYL1
| Track | Average absolute error | Median absolute error | Percentage of correct segments | Percentage of correct estimates with tolerance window |
|---|---|---|---|---|
| clocks_cut | 0.028 | 0.021 | 0.801 | 1.000 |
| i_kissed_a_girl | 0.060 | 0.051 | 0.858 | 0.992 |
| Madonna-Beautiful_Stranger_full_ending | 0.080 | 0.036 | 0.765 | 0.933 |
| rehab | 0.049 | 0.042 | 0.850 | 1.000 |
| rolling_in_the_deep | 0.111 | 0.035 | 0.709 | 0.964 |
| sunrise | 0.348 | 0.046 | 0.702 | 0.888 |
| this_afternoon | 0.049 | 0.041 | 0.869 | 1.000 |
| trick_me | 0.158 | 0.051 | 0.648 | 0.959 |
| umbrella | 0.043 | 0.028 | 0.770 | 0.985 |
| viva_la_vida | 0.088 | 0.085 | 0.858 | 0.993 |
ED1
| Track | Average absolute error | Median absolute error | Percentage of correct segments | Percentage of correct estimates with tolerance window |
|---|---|---|---|---|
| clocks_cut | 2.046 | 0.042 | 0.567 | 0.847 |
| i_kissed_a_girl | 0.202 | 0.074 | 0.683 | 0.894 |
| Madonna-Beautiful_Stranger_full_ending | 11.740 | 0.244 | 0.379 | 0.530 |
| rehab | 0.195 | 0.053 | 0.736 | 0.895 |
| rolling_in_the_deep | 1.238 | 0.067 | 0.462 | 0.689 |
| sunrise | 0.745 | 0.065 | 0.539 | 0.776 |
| this_afternoon | 7.727 | 0.581 | 0.331 | 0.469 |
| trick_me | 2.304 | 0.103 | 0.373 | 0.655 |
| umbrella | 0.841 | 0.059 | 0.565 | 0.742 |
| viva_la_vida | 7.645 | 1.307 | 0.227 | 0.394 |
SDE2
| Track | Average absolute error | Median absolute error | Percentage of correct segments | Percentage of correct estimates with tolerance window |
|---|---|---|---|---|
| clocks_cut | 0.205 | 0.071 | 0.560 | 0.929 |
| i_kissed_a_girl | 0.107 | 0.085 | 0.550 | 0.977 |
| Madonna-Beautiful_Stranger_full_ending | 0.164 | 0.078 | 0.375 | 0.910 |
| rehab | 0.242 | 0.095 | 0.417 | 0.882 |
| rolling_in_the_deep | 0.185 | 0.071 | 0.441 | 0.917 |
| sunrise | 0.938 | 0.082 | 0.431 | 0.784 |
| this_afternoon | 0.140 | 0.092 | 0.433 | 0.934 |
| trick_me | 0.600 | 0.122 | 0.248 | 0.728 |
| umbrella | 1.212 | 0.113 | 0.301 | 0.742 |
| viva_la_vida | 0.115 | 0.080 | 0.624 | 0.961 |
Mauch's dataset
Summary Results
file /nema-raid/www/mirex/results/2019/ala/mauch/summary_mauch.csv not found
Per-track results
CW2 file /nema-raid/www/mirex/results/2019/ala/mauch/CW2_mauch.csv not found
CW3 file /nema-raid/www/mirex/results/2019/ala/mauch/CW3_mauch.csv not found
GSLW1 file /nema-raid/www/mirex/results/2019/ala/mauch/GSLW1_mauch.csv not found
GSLW2 file /nema-raid/www/mirex/results/2019/ala/mauch/GSLW2_mauch.csv not found
GSLW3
| Track | ASE | PCS | PCETW |
|---|---|---|---|
| Abba.KnowingMeKnowingYou | 16.78 | 0.013470170808295 | 0 |
| Bangles.EternalFlame | 11.14 | 0.02898885485713 | 0.027450980392157 |
| Blondie.CallMe | 38.38 | 0 | 0 |
| Duffy.WarwickAvenue | 22.44 | 0.002410707267485 | 0.003787878787879 |
| DuranDuran.OrdinaryWorld | 26.87 | 0.026182638371089 | 0.030651340996169 |
| FranzFerdinand-DoYouWanTo | 13.38 | 0.00161317780798 | 0 |
| Martika.ToySoldiers | 21.94 | 0.0166667440527 | 0.03 |
| Muse.GuidingLight | 19.4 | 0.023893393487038 | 0.008620689655172 |
| OtisRedding.TheDockOfTheBay | 41.62 | 0 | 0 |
| RM-P082 | 36.45 | 0.002038977644714 | 0 |
| RM-P084 | 9.48 | 0.08661632622508 | 0.2 |
| Queen.WeAreTheChampions | 26.9 | 0 | 0 |
| RobertPalmer.AddictedToLove | 31.52 | 0 | 0 |
| Santana.BlackMagicWoman | 29.5 | 0.123035938934082 | 0 |
| SimonAndGarfunkel.Cecilia | 38.23 | 0 | 0 |
| TakeThat.BackForGood | 10.99 | 0.028435153463603 | 0.047619047619048 |
| TinaTurner.WhatsLoveGotToDoWithIt | 25.93 | 0.02372512809696 | 0.015479876160991 |
| Toto.Africa | 11.81 | 0.002388174061774 | 0.018939393939394 |
| U2.WithOrWithoutYou | 14.81 | 0.011272516767769 | 0.005235602094241 |
| Zweieck.She | 22.05 | 0.00600489576593 | 0.008583690987124 |
Gracenote dataset
Summary Results
file /nema-raid/www/mirex/results/2019/ala/gracenote/summary_gracenote.csv not found
Per-track results
CW2 file /nema-raid/www/mirex/results/2019/ala/gracenote/CW2_gracenote.csv not found
CW3 file /nema-raid/www/mirex/results/2019/ala/gracenote/CW3_gracenote.csv not found
GSLW1 file /nema-raid/www/mirex/results/2019/ala/gracenote/GSLW1_gracenote.csv not found
GSLW2 file /nema-raid/www/mirex/results/2019/ala/gracenote/GSLW2_gracenote.csv not found
GSLW3 file /nema-raid/www/mirex/results/2019/ala/gracenote/GSLW3_gracenote.csv not found
