Difference between revisions of "2020:Automatic Lyrics-to-Audio Alignment Results"

From MIREX Wiki
(→‎Per-track results)
(→‎Per-track results)
Line 98: Line 98:
 
====Per-track results====
 
====Per-track results====
 
GGL1
 
GGL1
−
<csv>2020/ala/MauchsDataset/GGL1/metrics/results.csv</csv>
+
<csv>2020/ala/MauchsDataset/GGL1/results.csv</csv>
  
 
GGL2
 
GGL2
−
<csv>2020/ala/MauchsDataset/GGL2/metrics/results.csv</csv>
+
<csv>2020/ala/MauchsDataset/GGL2/results.csv</csv>
  
 
ZWZL1
 
ZWZL1
−
<csv>2020/ala/MauchsDataset/ZWZL1/metrics/results.csv</csv>
+
<csv>2020/ala/MauchsDataset/ZWZL1/results.csv</csv>
  
  
 
ZWZL2
 
ZWZL2
−
<csv>2020/ala/MauchsDataset/ZWZL2/metrics/results.csv</csv>
+
<csv>2020/ala/MauchsDataset/ZWZL2/results.csv</csv>
  
 
ZWZL3
 
ZWZL3
−
<csv>2020/ala/MauchsDataset/ZWZL3/metrics/results.csv</csv>
+
<csv>2020/ala/MauchsDataset/ZWZL3/results.csv</csv>
  
 
DDA1
 
DDA1
−
<csv>2020/ala/MauchsDataset/DDA1/metrics/results.csv</csv>
+
<csv>2020/ala/MauchsDataset/DDA1/results.csv</csv>
  
 
===Jamendo dataset===
 
===Jamendo dataset===

Revision as of 18:38, 16 October 2020

General Legend

Sub code Submission name Abstract Contributors
GGL1 NUS PDF Chitralekha Gupta, Haizhou Li
GGL2 NUS PDF Chitralekha Gupta, Haizhou Li
ZWZL1 ZWZL1 PDF [], [], []
ZWZL2 ZWZL2 PDF [], [], []
ZWZL3 ZWZL3 PDF [], [], []
DDA1 Audio2Lyrics_emirdemirel PDF Emir Demirel
CC1 Mir lab PDF [Chun-Hao]

Results

UNDER CONSTRUCTION...

Hansen's dataset a cappella

Summary Results

Submission Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
GGL1 0.09 0.03 0.86 0.98
GGL2 0.13 0.03 0.79 0.97
ZWZL1 0.17 0.03 0.79 0.96
ZWZL2 0.11 0.03 0.84 0.97
ZWZL3 0.14 0.03 0.84 0.96
DDA1 0.93 0.95 0.21 0.91

download these results as csv

Per-track results

GGL1

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
clocks_cut 0.036 0.029 0.844 1.000
i_kissed_a_girl 0.071 0.068 0.852 0.996
Madonna-Beautiful_Stranger_full_ending 0.050 0.037 0.785 0.997
rehab 0.059 0.042 0.837 0.987
rolling_in_the_deep 0.119 0.036 0.701 0.961
sunrise 0.313 0.048 0.666 0.888
this_afternoon 0.042 0.028 0.875 0.998
trick_me 0.140 0.049 0.669 0.976
viva_la_vida 0.038 0.037 0.937 1.000

download these results as csv

GGL2

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
clocks_cut 0.028 0.021 0.801 1.000
i_kissed_a_girl 0.060 0.051 0.858 0.992
Madonna-Beautiful_Stranger_full_ending 0.080 0.036 0.765 0.933
rehab 0.049 0.042 0.850 1.000
rolling_in_the_deep 0.111 0.035 0.709 0.964
sunrise 0.348 0.046 0.702 0.888
this_afternoon 0.049 0.041 0.869 1.000
trick_me 0.158 0.051 0.648 0.959
umbrella 0.055 0.041 0.738 0.988
viva_la_vida 0.088 0.085 0.858 0.993

download these results as csv

ZWZL1

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
rolling_in_the_deep 0.145 0.036 0.666 0.928
rehab 0.094 0.044 0.816 0.948
trick_me 0.398 0.061 0.557 0.876
Madonna-Beautiful_Stranger_full_ending 0.144 0.046 0.779 0.890
viva_la_vida 0.129 0.091 0.798 0.982
clocks_cut 0.068 0.031 0.809 0.941
sunrise 0.630 0.049 0.625 0.848
i_kissed_a_girl 0.087 0.062 0.774 0.951
this_afternoon 1.398 0.049 0.731 0.898
umbrella 0.104 0.032 0.792 0.946

download these results as csv


ZWZL2

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
rolling_in_the_deep 0.193 0.034 0.639 0.911
rehab 0.083 0.036 0.805 0.954
trick_me 0.427 0.062 0.571 0.897
Madonna-Beautiful_Stranger_full_ending 0.112 0.040 0.781 0.887
viva_la_vida 0.121 0.105 0.818 0.965
clocks_cut 0.395 0.022 0.834 0.965
sunrise 0.593 0.052 0.662 0.856
i_kissed_a_girl 0.234 0.072 0.648 0.871
this_afternoon 0.200 0.035 0.781 0.965
umbrella 0.056 0.028 0.783 0.964

download these results as csv

ZWZL3

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
rolling_in_the_deep 0.232 0.035 0.629 0.906
rehab 0.085 0.041 0.778 0.948
trick_me 0.308 0.063 0.571 0.907
Madonna-Beautiful_Stranger_full_ending 0.158 0.043 0.780 0.867
viva_la_vida 0.158 0.099 0.762 0.972
clocks_cut 0.092 0.022 0.821 0.953
sunrise 0.692 0.053 0.652 0.824
i_kissed_a_girl 0.182 0.074 0.687 0.894
this_afternoon 0.201 0.040 0.768 0.954
umbrella 0.057 0.028 0.780 0.966

download these results as csv

DDA1

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
clocks_cut 0.120 0.027 0.228 0.988
i_kissed_a_girl 0.122 0.054 0.132 0.924
Madonna-Beautiful_Stranger_full_ending 0.000 0.000 NaN 0.000
rehab 0.081 0.042 0.233 0.944
rolling_in_the_deep 0.108 0.038 0.115 0.944
sunrise 0.228 0.043 0.295 0.896
this_afternoon 0.062 0.040 0.193 0.989
trick_me 0.331 0.054 0.168 0.907
umbrella 0.106 0.036 0.248 0.908
viva_la_vida 0.414 0.102 0.205 0.911

download these results as csv

Hansen's dataset

Summary Results

Submission Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
GGL1 0.10 0.04 0.80 0.98
GGL2 0.10 0.04 0.78 0.97
ZWZL1 0.32 0.05 0.73 0.92
ZWZL2 0.24 0.05 0.73 0.92
ZWZL3 0.22 0.05 0.72 0.92
DDA1 0.17 0.05 0.20 0.93

download these results as csv

Per-track results

GGL1

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
clocks_cut 0.036 0.029 0.844 1.000
i_kissed_a_girl 0.071 0.068 0.852 0.996
Madonna-Beautiful_Stranger_full_ending 0.050 0.037 0.785 0.997
rehab 0.059 0.042 0.837 0.987
rolling_in_the_deep 0.119 0.036 0.701 0.961
sunrise 0.313 0.048 0.666 0.888
this_afternoon 0.042 0.028 0.875 0.998
trick_me 0.140 0.049 0.669 0.976
viva_la_vida 0.038 0.037 0.937 1.000

download these results as csv

GGL2

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
clocks_cut 0.028 0.021 0.801 1.000
i_kissed_a_girl 0.060 0.051 0.858 0.992
Madonna-Beautiful_Stranger_full_ending 0.080 0.036 0.765 0.933
rehab 0.049 0.042 0.850 1.000
rolling_in_the_deep 0.111 0.035 0.709 0.964
sunrise 0.348 0.046 0.702 0.888
this_afternoon 0.049 0.041 0.869 1.000
trick_me 0.158 0.051 0.648 0.959
umbrella 0.055 0.041 0.738 0.988
viva_la_vida 0.088 0.085 0.858 0.993

download these results as csv

ZWZL1

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
rolling_in_the_deep 0.145 0.036 0.666 0.928
rehab 0.094 0.044 0.816 0.948
trick_me 0.398 0.061 0.557 0.876
Madonna-Beautiful_Stranger_full_ending 0.144 0.046 0.779 0.890
viva_la_vida 0.129 0.091 0.798 0.982
clocks_cut 0.068 0.031 0.809 0.941
sunrise 0.630 0.049 0.625 0.848
i_kissed_a_girl 0.087 0.062 0.774 0.951
this_afternoon 1.398 0.049 0.731 0.898
umbrella 0.104 0.032 0.792 0.946

download these results as csv


ZWZL2

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
rolling_in_the_deep 0.193 0.034 0.639 0.911
rehab 0.083 0.036 0.805 0.954
trick_me 0.427 0.062 0.571 0.897
Madonna-Beautiful_Stranger_full_ending 0.112 0.040 0.781 0.887
viva_la_vida 0.121 0.105 0.818 0.965
clocks_cut 0.395 0.022 0.834 0.965
sunrise 0.593 0.052 0.662 0.856
i_kissed_a_girl 0.234 0.072 0.648 0.871
this_afternoon 0.200 0.035 0.781 0.965
umbrella 0.056 0.028 0.783 0.964

download these results as csv

ZWZL3

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
rolling_in_the_deep 0.232 0.035 0.629 0.906
rehab 0.085 0.041 0.778 0.948
trick_me 0.308 0.063 0.571 0.907
Madonna-Beautiful_Stranger_full_ending 0.158 0.043 0.780 0.867
viva_la_vida 0.158 0.099 0.762 0.972
clocks_cut 0.092 0.022 0.821 0.953
sunrise 0.692 0.053 0.652 0.824
i_kissed_a_girl 0.182 0.074 0.687 0.894
this_afternoon 0.201 0.040 0.768 0.954
umbrella 0.057 0.028 0.780 0.966

download these results as csv

DDA1

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
clocks_cut 0.120 0.027 0.228 0.988
i_kissed_a_girl 0.122 0.054 0.132 0.924
Madonna-Beautiful_Stranger_full_ending 0.000 0.000 NaN 0.000
rehab 0.081 0.042 0.233 0.944
rolling_in_the_deep 0.108 0.038 0.115 0.944
sunrise 0.228 0.043 0.295 0.896
this_afternoon 0.062 0.040 0.193 0.989
trick_me 0.331 0.054 0.168 0.907
umbrella 0.106 0.036 0.248 0.908
viva_la_vida 0.414 0.102 0.205 0.911

download these results as csv

Mauch's dataset

Summary Results

Submission Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
GGL1 0.22 0.10 NA 0.91
GGL2 0.19 0.10 NA 0.91
ZWZL1 1.33 0.76 NA 0.80
ZWZL2 0.41 0.10 NA 0.87
ZWZL3 0.42 0.10 NA 0.86
DDA1 0.61 0.11 NA 0.86

download these results as csv

Per-track results

GGL1

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
Abba.KnowingMeKnowingYou 0.066 0.056 NaN 0.995
Bangles.EternalFlame 0.226 0.185 NaN 0.819
Blondie.CallMe 0.353 0.106 NaN 0.907
Duffy.WarwickAvenue 0.058 0.047 NaN 0.989
DuranDuran.OrdinaryWorld 0.203 0.062 NaN 0.950
FranzFerdinand.DoYouWantTo 0.385 0.115 NaN 0.750
Martika.ToySoldiers 0.148 0.091 NaN 0.917
Muse.GuidingLight 0.279 0.061 NaN 0.928
OtisRedding.TheDockOfTheBay 0.225 0.187 NaN 0.829
p082m 0.100 0.059 NaN 0.982
p084m 0.194 0.050 NaN 0.994
Queen.WeAreTheChampions 0.089 0.061 NaN 0.962
RobertPalmer.AddictedToLove 0.144 0.134 NaN 0.974
Santana.BlackMagicWoman 0.479 0.154 NaN 0.825
SimonAndGarfunkel.Cecilia 0.748 0.076 NaN 0.659
TakeThat.BackForGood 0.121 0.046 NaN 0.926
TinaTurner.WhatsLoveGotToDoWithIt 0.179 0.153 NaN 0.944
Toto.Africa 0.109 0.107 NaN 0.996
U2.WithOrWithoutYou 0.282 0.099 NaN 0.911
Zweieck.She 0.093 0.053 NaN 0.961

download these results as csv

GGL2

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
Abba.KnowingMeKnowingYou 0.073 0.060 NaN 0.989
Bangles.EternalFlame 0.220 0.178 NaN 0.815
Blondie.CallMe 0.455 0.126 NaN 0.863
Duffy.WarwickAvenue 0.057 0.045 NaN 0.989
DuranDuran.OrdinaryWorld 0.109 0.070 NaN 0.969
FranzFerdinand.DoYouWantTo 0.362 0.129 NaN 0.743
Martika.ToySoldiers 0.149 0.105 NaN 0.898
Muse.GuidingLight 0.201 0.059 NaN 0.964
OtisRedding.TheDockOfTheBay 0.205 0.165 NaN 0.873
p082m 0.091 0.055 NaN 0.985
p084m 0.062 0.051 NaN 0.997
Queen.WeAreTheChampions 0.134 0.059 NaN 0.930
RobertPalmer.AddictedToLove 0.157 0.148 NaN 0.963
Santana.BlackMagicWoman 0.203 0.171 NaN 0.800
SimonAndGarfunkel.Cecilia 0.566 0.081 NaN 0.659
TakeThat.BackForGood 0.122 0.047 NaN 0.929
TinaTurner.WhatsLoveGotToDoWithIt 0.191 0.171 NaN 0.944
Toto.Africa 0.094 0.089 NaN 1.000
U2.WithOrWithoutYou 0.324 0.093 NaN 0.901
Zweieck.She 0.076 0.057 NaN 0.979

download these results as csv

ZWZL1

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
SimonAndGarfunkel.Cecilia 0.560 0.105 NaN 0.650
FranzFerdinand.DoYouWantTo 0.352 0.122 NaN 0.745
Queen.WeAreTheChampions 0.326 0.075 NaN 0.843
DuranDuran.OrdinaryWorld 1.470 0.090 NaN 0.835
TakeThat.BackForGood 0.167 0.053 NaN 0.913
Abba.KnowingMeKnowingYou 0.121 0.064 NaN 0.942
Santana.BlackMagicWoman 18.449 13.136 NaN 0.042
Duffy.WarwickAvenue 0.298 0.052 NaN 0.913
Toto.Africa 0.201 0.100 NaN 0.947
Blondie.CallMe 0.891 0.134 NaN 0.745
p084m 0.274 0.056 NaN 0.918
Bangles.EternalFlame 0.403 0.199 NaN 0.746
p082m 0.209 0.065 NaN 0.942
Muse.GuidingLight 0.621 0.080 NaN 0.838
TinaTurner.WhatsLoveGotToDoWithIt 0.327 0.167 NaN 0.864
OtisRedding.TheDockOfTheBay 0.214 0.169 NaN 0.934
RobertPalmer.AddictedToLove 0.255 0.150 NaN 0.895
Zweieck.She 0.344 0.069 NaN 0.871
U2.WithOrWithoutYou 0.439 0.108 NaN 0.832
Martika.ToySoldiers 0.590 0.154 NaN 0.606

download these results as csv


ZWZL2

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
SimonAndGarfunkel.Cecilia 2.592 0.169 NaN 0.547
FranzFerdinand.DoYouWantTo 0.392 0.114 NaN 0.785
Queen.WeAreTheChampions 0.192 0.062 NaN 0.919
DuranDuran.OrdinaryWorld 0.233 0.066 NaN 0.927
TakeThat.BackForGood 0.118 0.040 NaN 0.921
Abba.KnowingMeKnowingYou 0.106 0.060 NaN 0.942
Santana.BlackMagicWoman 0.533 0.156 NaN 0.817
Duffy.WarwickAvenue 0.108 0.044 NaN 0.970
Toto.Africa 0.129 0.109 NaN 0.989
Blondie.CallMe 0.837 0.127 NaN 0.672
p084m 0.222 0.048 NaN 0.970
Bangles.EternalFlame 0.277 0.178 NaN 0.804
p082m 0.132 0.053 NaN 0.969
Muse.GuidingLight 0.576 0.070 NaN 0.901
TinaTurner.WhatsLoveGotToDoWithIt 0.222 0.157 NaN 0.913
OtisRedding.TheDockOfTheBay 0.223 0.190 NaN 0.873
RobertPalmer.AddictedToLove 0.181 0.146 NaN 0.898
Zweieck.She 0.137 0.057 NaN 0.940
U2.WithOrWithoutYou 0.550 0.095 NaN 0.880
Martika.ToySoldiers 0.367 0.115 NaN 0.693

download these results as csv

ZWZL3

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
SimonAndGarfunkel.Cecilia 2.355 0.133 NaN 0.574
FranzFerdinand.DoYouWantTo 0.318 0.114 NaN 0.782
Queen.WeAreTheChampions 0.243 0.062 NaN 0.892
DuranDuran.OrdinaryWorld 0.213 0.068 NaN 0.931
TakeThat.BackForGood 0.117 0.044 NaN 0.913
Abba.KnowingMeKnowingYou 0.114 0.065 NaN 0.953
Santana.BlackMagicWoman 0.593 0.165 NaN 0.800
Duffy.WarwickAvenue 0.074 0.045 NaN 0.970
Toto.Africa 0.158 0.105 NaN 0.966
Blondie.CallMe 0.770 0.133 NaN 0.711
p084m 0.096 0.046 NaN 0.960
Bangles.EternalFlame 0.244 0.181 NaN 0.804
p082m 0.099 0.055 NaN 0.957
Muse.GuidingLight 1.043 0.080 NaN 0.811
TinaTurner.WhatsLoveGotToDoWithIt 0.293 0.163 NaN 0.885
OtisRedding.TheDockOfTheBay 0.212 0.184 NaN 0.878
RobertPalmer.AddictedToLove 0.216 0.145 NaN 0.881
Zweieck.She 0.176 0.064 NaN 0.888
U2.WithOrWithoutYou 0.584 0.097 NaN 0.890
Martika.ToySoldiers 0.406 0.109 NaN 0.760

download these results as csv

DDA1

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
Muse.GuidingLight 0.189 0.060 NaN 0.964
Abba.KnowingMeKnowingYou 0.194 0.072 NaN 0.932
Bangles.EternalFlame 0.353 0.191 NaN 0.765
Blondie.CallMe 0.305 0.116 NaN 0.804
Duffy.WarwickAvenue 0.057 0.041 NaN 0.989
DuranDuran.OrdinaryWorld 0.325 0.074 NaN 0.920
FranzFerdinand.DoYouWantTo 0.331 0.124 NaN 0.740
Martika.ToySoldiers 0.403 0.135 NaN 0.720
OtisRedding.TheDockOfTheBay 0.200 0.169 NaN 0.906
p082m 0.159 0.052 NaN 0.951
p084m 0.091 0.053 NaN 0.976
Queen.WeAreTheChampions 0.146 0.065 NaN 0.935
RobertPalmer.AddictedToLove 1.276 0.194 NaN 0.693
Santana.BlackMagicWoman 0.518 0.165 NaN 0.792
SimonAndGarfunkel.Cecilia 6.721 0.155 NaN 0.543
TakeThat.BackForGood 0.157 0.051 NaN 0.899
TinaTurner.WhatsLoveGotToDoWithIt 0.215 0.173 NaN 0.941
Toto.Africa 0.099 0.093 NaN 0.996
U2.WithOrWithoutYou 0.220 0.112 NaN 0.880
Zweieck.She 0.182 0.069 NaN 0.910

download these results as csv

Jamendo dataset

Summary Results

Submission Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
GGL1 0.33 0.04 NA 0.94
GGL2 0.22 0.05 NA 0.94
ZWZL1 1.11 0.08 NA 0.81
ZWZL2 0.61 0.06 NA 0.88
ZWZL3 0.64 0.07 NA 0.86
DDA1 0.50 0.09 NA 0.84

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/GGL2/metrics/results.csv not found

ZWZL1 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/ZWZL1/metrics/results.csv not found


ZWZL2 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/ZWZL2/metrics/results.csv not found

ZWZL3 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/ZWZL3/metrics/results.csv not found

DDA1 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/DDA1/metrics/results.csv not found

Retrieved from "https://music-ir.org/mirex/w/index.php?title=2020:Automatic_Lyrics-to-Audio_Alignment_Results&oldid=13311"