Difference between revisions of "2019:Automatic Lyrics-to-Audio Alignment Results"

From MIREX Wiki
Line 38: Line 38:
 
====Per-track results====
 
====Per-track results====
  
−
CW2
+
GYL1
−
<csv>2019/ala/hansen/clean/CW2_hansen_clean.csv</csv>
+
<csv>2019/ala/HansensDataset_acappella/GYL1/metrics/HansensDataset_acappella_GYL1.csv</csv>
  
−
CW3
+
ED1
−
<csv>2019/ala/hansen/clean/CW3_hansen_clean.csv</csv>
+
<csv>2019/ala/HansensDataset_acappella/ED1/metrics/HansensDataset_acappella_ED1.csv</csv>
  
−
GSLW1
+
SDE2
−
<csv>2019/ala/hansen/clean/GSLW1_hansen_clean.csv</csv>
+
<csv>2019/ala/HansensDataset_acappella/SDE2/metrics/HansensDataset_acappella_SDE2.csv</csv>
−
 
 
−
GSLW2
 
−
<csv>2019/ala/hansen/clean/GSLW2_hansen_clean.csv</csv>
 
−
 
 
−
GSLW3
 
−
<csv>2019/ala/hansen/clean/GSLW3_hansen_clean.csv</csv>
 
  
  

Revision as of 07:44, 5 November 2019

General Legend

Sub code Submission name Abstract Contributors
GYL1 NUS PDF Chitralekha Gupta, Haizhou Li, Emre Yilmaz
ED1 Audio2Lyrics_emirdemirel PDF Emir Demirel
SDE1 PDF Daniel Stoller, Simon Durand, Sebastian Ewert
SDE2 PDF Daniel Stoller, Simon Durand, Sebastian Ewert
LJ2 Force Alignment with Kaldi PDF Chuan You Lin, Jyh-Shing Roger Jang, Huang Hsiang-Yu

Results

Hansen's dataset a cappella

Summary Results

Submission Mean AAE Mean MAE Mean PCS Mean PCETW
GYL1 0.13 0.03 0.79 0.97
ED1 0.28 0.04 0.74 0.93
SDE2 0.21 0.08 0.47 0.94

download these results as csv

Per-track results

GYL1

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct estimates with tolerance window
clocks_cut 0.287 0.023 0.750 0.953
i_kissed_a_girl 0.096 0.053 0.786 0.947
Madonna-Beautiful_Stranger_full_ending 0.076 0.034 0.787 0.960
rehab 0.035 0.018 0.905 0.990
rolling_in_the_deep 0.133 0.038 0.646 0.939
sunrise 0.515 0.019 0.587 0.896
this_afternoon 0.034 0.028 0.903 1.000
trick_me 0.031 0.022 0.903 1.000
umbrella 0.055 0.041 0.738 0.988
viva_la_vida 0.054 0.033 0.911 0.979

download these results as csv

ED1

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct estimates with tolerance window
clocks_cut 1.190 0.037 0.497 0.871
i_kissed_a_girl 0.102 0.053 0.769 0.966
Madonna-Beautiful_Stranger_full_ending 0.110 0.042 0.757 0.923
rehab 0.036 0.020 0.935 0.993
rolling_in_the_deep 0.371 0.046 0.624 0.858
sunrise 0.644 0.034 0.591 0.832
this_afternoon 0.068 0.035 0.822 0.976
trick_me 0.152 0.033 0.703 0.938
umbrella 0.111 0.053 0.740 0.944
viva_la_vida 0.054 0.030 0.915 0.979

download these results as csv

SDE2

Track Average absolute error Median absolute error Percentage of correct segments Percentage of correct estimates with tolerance window
clocks_cut 0.288 0.073 0.507 0.953
i_kissed_a_girl 0.087 0.077 0.556 1.000
Madonna-Beautiful_Stranger_full_ending 0.101 0.067 0.405 0.963
rehab 0.130 0.083 0.490 0.958
rolling_in_the_deep 0.173 0.067 0.461 0.939
sunrise 0.542 0.069 0.449 0.840
this_afternoon 0.098 0.077 0.513 0.987
trick_me 0.276 0.096 0.407 0.914
umbrella 0.225 0.104 0.351 0.832
viva_la_vida 0.137 0.071 0.610 0.982

download these results as csv


Hansen's dataset mix

Summary Results

file /nema-raid/www/mirex/results/2019/ala/hansen/mix/summary_hansen_mix.csv not found

Per-track results

CW2 file /nema-raid/www/mirex/results/2019/ala/hansen/mix/CW2_hansen_mix.csv not found

CW3 file /nema-raid/www/mirex/results/2019/ala/hansen/mix/CW3_hansen_mix.csv not found

GSLW1 file /nema-raid/www/mirex/results/2019/ala/hansen/mix/GSLW1_hansen_mix.csv not found

GSLW2 file /nema-raid/www/mirex/results/2019/ala/hansen/mix/GSLW2_hansen_mix.csv not found

GSLW3 file /nema-raid/www/mirex/results/2019/ala/hansen/mix/GSLW3_hansen_mix.csv not found

Mauch's dataset

Summary Results

file /nema-raid/www/mirex/results/2019/ala/mauch/summary_mauch.csv not found

Per-track results

CW2 file /nema-raid/www/mirex/results/2019/ala/mauch/CW2_mauch.csv not found

CW3 file /nema-raid/www/mirex/results/2019/ala/mauch/CW3_mauch.csv not found

GSLW1 file /nema-raid/www/mirex/results/2019/ala/mauch/GSLW1_mauch.csv not found

GSLW2 file /nema-raid/www/mirex/results/2019/ala/mauch/GSLW2_mauch.csv not found

GSLW3

Track ASE PCS PCETW
Abba.KnowingMeKnowingYou 16.78 0.013470170808295 0
Bangles.EternalFlame 11.14 0.02898885485713 0.027450980392157
Blondie.CallMe 38.38 0 0
Duffy.WarwickAvenue 22.44 0.002410707267485 0.003787878787879
DuranDuran.OrdinaryWorld 26.87 0.026182638371089 0.030651340996169
FranzFerdinand-DoYouWanTo 13.38 0.00161317780798 0
Martika.ToySoldiers 21.94 0.0166667440527 0.03
Muse.GuidingLight 19.4 0.023893393487038 0.008620689655172
OtisRedding.TheDockOfTheBay 41.62 0 0
RM-P082 36.45 0.002038977644714 0
RM-P084 9.48 0.08661632622508 0.2
Queen.WeAreTheChampions 26.9 0 0
RobertPalmer.AddictedToLove 31.52 0 0
Santana.BlackMagicWoman 29.5 0.123035938934082 0
SimonAndGarfunkel.Cecilia 38.23 0 0
TakeThat.BackForGood 10.99 0.028435153463603 0.047619047619048
TinaTurner.WhatsLoveGotToDoWithIt 25.93 0.02372512809696 0.015479876160991
Toto.Africa 11.81 0.002388174061774 0.018939393939394
U2.WithOrWithoutYou 14.81 0.011272516767769 0.005235602094241
Zweieck.She 22.05 0.00600489576593 0.008583690987124

download these results as csv


Gracenote dataset

Summary Results

file /nema-raid/www/mirex/results/2019/ala/gracenote/summary_gracenote.csv not found

Per-track results

CW2 file /nema-raid/www/mirex/results/2019/ala/gracenote/CW2_gracenote.csv not found

CW3 file /nema-raid/www/mirex/results/2019/ala/gracenote/CW3_gracenote.csv not found

GSLW1 file /nema-raid/www/mirex/results/2019/ala/gracenote/GSLW1_gracenote.csv not found

GSLW2 file /nema-raid/www/mirex/results/2019/ala/gracenote/GSLW2_gracenote.csv not found

GSLW3 file /nema-raid/www/mirex/results/2019/ala/gracenote/GSLW3_gracenote.csv not found

Retrieved from "https://music-ir.org/mirex/w/index.php?title=2019:Automatic_Lyrics-to-Audio_Alignment_Results&oldid=13129"