Difference between revisions of "2020:Automatic Lyrics-to-Audio Alignment Results"

From MIREX Wiki
(→‎Per-track results)
(→‎Per-track results)
Line 73: Line 73:
  
 
GGL1
 
GGL1
−
<csv>2020/ala/HansensDataset/GGL1/metrics/results.csv</csv>
+
<csv>2020/ala/HansensDataset/GGL1/results.csv</csv>
  
 
GGL2
 
GGL2
−
<csv>2020/ala/HansensDataset/GGL2/metrics/results.csv</csv>
+
<csv>2020/ala/HansensDataset/GGL2/results.csv</csv>
  
 
ZWZL1
 
ZWZL1
−
<csv>2020/ala/HansensDataset/ZWZL1/metrics/results.csv</csv>
+
<csv>2020/ala/HansensDataset/ZWZL1/results.csv</csv>
  
  
 
ZWZL2
 
ZWZL2
−
<csv>2020/ala/HansensDataset/ZWZL2/metrics/results.csv</csv>
+
<csv>2020/ala/HansensDataset/ZWZL2/results.csv</csv>
  
 
ZWZL3
 
ZWZL3
−
<csv>2020/ala/HansensDataset/ZWZL3/metrics/results.csv</csv>
+
<csv>2020/ala/HansensDataset/ZWZL3/results.csv</csv>
  
 
DDA1
 
DDA1
−
<csv>2020/ala/HansensDataset/DDA1/metrics/results.csv</csv>
+
<csv>2020/ala/HansensDataset/DDA1/results.csv</csv>
  
 
===Mauch's dataset===
 
===Mauch's dataset===

Revision as of 18:38, 16 October 2020

General Legend

Sub code Submission name Abstract Contributors
GGL1 NUS PDF Chitralekha Gupta, Haizhou Li
GGL2 NUS PDF Chitralekha Gupta, Haizhou Li
ZWZL1 ZWZL1 PDF [], [], []
ZWZL2 ZWZL2 PDF [], [], []
ZWZL3 ZWZL3 PDF [], [], []
DDA1 Audio2Lyrics_emirdemirel PDF Emir Demirel
CC1 Mir lab PDF [Chun-Hao]

Results

UNDER CONSTRUCTION...

Hansen's dataset a cappella

Summary Results

Submission Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
GGL1 0.09 0.03 0.86 0.98
GGL2 0.13 0.03 0.79 0.97
ZWZL1 0.17 0.03 0.79 0.96
ZWZL2 0.11 0.03 0.84 0.97
ZWZL3 0.14 0.03 0.84 0.96
DDA1 0.93 0.95 0.21 0.91

download these results as csv

Per-track results

GGL1

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
clocks_cut 0.036 0.029 0.844 1.000
i_kissed_a_girl 0.071 0.068 0.852 0.996
Madonna-Beautiful_Stranger_full_ending 0.050 0.037 0.785 0.997
rehab 0.059 0.042 0.837 0.987
rolling_in_the_deep 0.119 0.036 0.701 0.961
sunrise 0.313 0.048 0.666 0.888
this_afternoon 0.042 0.028 0.875 0.998
trick_me 0.140 0.049 0.669 0.976
viva_la_vida 0.038 0.037 0.937 1.000

download these results as csv

GGL2

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
clocks_cut 0.028 0.021 0.801 1.000
i_kissed_a_girl 0.060 0.051 0.858 0.992
Madonna-Beautiful_Stranger_full_ending 0.080 0.036 0.765 0.933
rehab 0.049 0.042 0.850 1.000
rolling_in_the_deep 0.111 0.035 0.709 0.964
sunrise 0.348 0.046 0.702 0.888
this_afternoon 0.049 0.041 0.869 1.000
trick_me 0.158 0.051 0.648 0.959
umbrella 0.055 0.041 0.738 0.988
viva_la_vida 0.088 0.085 0.858 0.993

download these results as csv

ZWZL1

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
rolling_in_the_deep 0.145 0.036 0.666 0.928
rehab 0.094 0.044 0.816 0.948
trick_me 0.398 0.061 0.557 0.876
Madonna-Beautiful_Stranger_full_ending 0.144 0.046 0.779 0.890
viva_la_vida 0.129 0.091 0.798 0.982
clocks_cut 0.068 0.031 0.809 0.941
sunrise 0.630 0.049 0.625 0.848
i_kissed_a_girl 0.087 0.062 0.774 0.951
this_afternoon 1.398 0.049 0.731 0.898
umbrella 0.104 0.032 0.792 0.946

download these results as csv


ZWZL2

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
rolling_in_the_deep 0.193 0.034 0.639 0.911
rehab 0.083 0.036 0.805 0.954
trick_me 0.427 0.062 0.571 0.897
Madonna-Beautiful_Stranger_full_ending 0.112 0.040 0.781 0.887
viva_la_vida 0.121 0.105 0.818 0.965
clocks_cut 0.395 0.022 0.834 0.965
sunrise 0.593 0.052 0.662 0.856
i_kissed_a_girl 0.234 0.072 0.648 0.871
this_afternoon 0.200 0.035 0.781 0.965
umbrella 0.056 0.028 0.783 0.964

download these results as csv

ZWZL3

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
rolling_in_the_deep 0.232 0.035 0.629 0.906
rehab 0.085 0.041 0.778 0.948
trick_me 0.308 0.063 0.571 0.907
Madonna-Beautiful_Stranger_full_ending 0.158 0.043 0.780 0.867
viva_la_vida 0.158 0.099 0.762 0.972
clocks_cut 0.092 0.022 0.821 0.953
sunrise 0.692 0.053 0.652 0.824
i_kissed_a_girl 0.182 0.074 0.687 0.894
this_afternoon 0.201 0.040 0.768 0.954
umbrella 0.057 0.028 0.780 0.966

download these results as csv

DDA1

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
clocks_cut 0.120 0.027 0.228 0.988
i_kissed_a_girl 0.122 0.054 0.132 0.924
Madonna-Beautiful_Stranger_full_ending 0.000 0.000 NaN 0.000
rehab 0.081 0.042 0.233 0.944
rolling_in_the_deep 0.108 0.038 0.115 0.944
sunrise 0.228 0.043 0.295 0.896
this_afternoon 0.062 0.040 0.193 0.989
trick_me 0.331 0.054 0.168 0.907
umbrella 0.106 0.036 0.248 0.908
viva_la_vida 0.414 0.102 0.205 0.911

download these results as csv

Hansen's dataset

Summary Results

Submission Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
GGL1 0.10 0.04 0.80 0.98
GGL2 0.10 0.04 0.78 0.97
ZWZL1 0.32 0.05 0.73 0.92
ZWZL2 0.24 0.05 0.73 0.92
ZWZL3 0.22 0.05 0.72 0.92
DDA1 0.17 0.05 0.20 0.93

download these results as csv

Per-track results

GGL1

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
clocks_cut 0.036 0.029 0.844 1.000
i_kissed_a_girl 0.071 0.068 0.852 0.996
Madonna-Beautiful_Stranger_full_ending 0.050 0.037 0.785 0.997
rehab 0.059 0.042 0.837 0.987
rolling_in_the_deep 0.119 0.036 0.701 0.961
sunrise 0.313 0.048 0.666 0.888
this_afternoon 0.042 0.028 0.875 0.998
trick_me 0.140 0.049 0.669 0.976
viva_la_vida 0.038 0.037 0.937 1.000

download these results as csv

GGL2

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
clocks_cut 0.028 0.021 0.801 1.000
i_kissed_a_girl 0.060 0.051 0.858 0.992
Madonna-Beautiful_Stranger_full_ending 0.080 0.036 0.765 0.933
rehab 0.049 0.042 0.850 1.000
rolling_in_the_deep 0.111 0.035 0.709 0.964
sunrise 0.348 0.046 0.702 0.888
this_afternoon 0.049 0.041 0.869 1.000
trick_me 0.158 0.051 0.648 0.959
umbrella 0.055 0.041 0.738 0.988
viva_la_vida 0.088 0.085 0.858 0.993

download these results as csv

ZWZL1

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
rolling_in_the_deep 0.145 0.036 0.666 0.928
rehab 0.094 0.044 0.816 0.948
trick_me 0.398 0.061 0.557 0.876
Madonna-Beautiful_Stranger_full_ending 0.144 0.046 0.779 0.890
viva_la_vida 0.129 0.091 0.798 0.982
clocks_cut 0.068 0.031 0.809 0.941
sunrise 0.630 0.049 0.625 0.848
i_kissed_a_girl 0.087 0.062 0.774 0.951
this_afternoon 1.398 0.049 0.731 0.898
umbrella 0.104 0.032 0.792 0.946

download these results as csv


ZWZL2

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
rolling_in_the_deep 0.193 0.034 0.639 0.911
rehab 0.083 0.036 0.805 0.954
trick_me 0.427 0.062 0.571 0.897
Madonna-Beautiful_Stranger_full_ending 0.112 0.040 0.781 0.887
viva_la_vida 0.121 0.105 0.818 0.965
clocks_cut 0.395 0.022 0.834 0.965
sunrise 0.593 0.052 0.662 0.856
i_kissed_a_girl 0.234 0.072 0.648 0.871
this_afternoon 0.200 0.035 0.781 0.965
umbrella 0.056 0.028 0.783 0.964

download these results as csv

ZWZL3

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
rolling_in_the_deep 0.232 0.035 0.629 0.906
rehab 0.085 0.041 0.778 0.948
trick_me 0.308 0.063 0.571 0.907
Madonna-Beautiful_Stranger_full_ending 0.158 0.043 0.780 0.867
viva_la_vida 0.158 0.099 0.762 0.972
clocks_cut 0.092 0.022 0.821 0.953
sunrise 0.692 0.053 0.652 0.824
i_kissed_a_girl 0.182 0.074 0.687 0.894
this_afternoon 0.201 0.040 0.768 0.954
umbrella 0.057 0.028 0.780 0.966

download these results as csv

DDA1

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
clocks_cut 0.120 0.027 0.228 0.988
i_kissed_a_girl 0.122 0.054 0.132 0.924
Madonna-Beautiful_Stranger_full_ending 0.000 0.000 NaN 0.000
rehab 0.081 0.042 0.233 0.944
rolling_in_the_deep 0.108 0.038 0.115 0.944
sunrise 0.228 0.043 0.295 0.896
this_afternoon 0.062 0.040 0.193 0.989
trick_me 0.331 0.054 0.168 0.907
umbrella 0.106 0.036 0.248 0.908
viva_la_vida 0.414 0.102 0.205 0.911

download these results as csv

Mauch's dataset

Summary Results

Submission Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
GGL1 0.22 0.10 NA 0.91
GGL2 0.19 0.10 NA 0.91
ZWZL1 1.33 0.76 NA 0.80
ZWZL2 0.41 0.10 NA 0.87
ZWZL3 0.42 0.10 NA 0.86
DDA1 0.61 0.11 NA 0.86

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/GGL2/metrics/results.csv not found

ZWZL1 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/ZWZL1/metrics/results.csv not found


ZWZL2 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/ZWZL2/metrics/results.csv not found

ZWZL3 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/ZWZL3/metrics/results.csv not found

DDA1 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/DDA1/metrics/results.csv not found

Jamendo dataset

Summary Results

Submission Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
GGL1 0.33 0.04 NA 0.94
GGL2 0.22 0.05 NA 0.94
ZWZL1 1.11 0.08 NA 0.81
ZWZL2 0.61 0.06 NA 0.88
ZWZL3 0.64 0.07 NA 0.86
DDA1 0.50 0.09 NA 0.84

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/GGL2/metrics/results.csv not found

ZWZL1 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/ZWZL1/metrics/results.csv not found


ZWZL2 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/ZWZL2/metrics/results.csv not found

ZWZL3 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/ZWZL3/metrics/results.csv not found

DDA1 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/DDA1/metrics/results.csv not found

Retrieved from "https://music-ir.org/mirex/w/index.php?title=2020:Automatic_Lyrics-to-Audio_Alignment_Results&oldid=13310"