Difference between revisions of "2020:Automatic Lyrics-to-Audio Alignment Results"

From MIREX Wiki
(Created page with "= General Legend = {| border="1" cellspacing="0" style="text-align: left; width: 800px;" |- style="background: yellow" ! width="80" | Sub code ! width="200" | Sub...")
 
Line 30: Line 30:
  
 
     ! DDA1
 
     ! DDA1
−
     | Audio2Lyrics_emirdemirel  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/ED1.pdf PDF] || [http://www.eecs.qmul.ac.uk/profiles/demirelemir.html Emir Demirel]
+
     | Audio2Lyrics_emirdemirel  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/DDA3.pdf PDF] || [http://www.eecs.qmul.ac.uk/profiles/demirelemir.html Emir Demirel]
 
     |-
 
     |-
  
 +
    ! CC1
 +
    | Mir lab  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/CC1.pdf PDF] || [Chun-Hao]
 +
    |-
 
|}
 
|}
  
 
=Results=
 
=Results=
 +
UNDER CONSTRUCTION...
  
 
===Hansen's dataset a cappella===
 
===Hansen's dataset a cappella===
Line 58: Line 62:
 
ZWZL3
 
ZWZL3
 
<csv>2020/ala/HansensDataset/ZWZL3/metrics/results.csv</csv>
 
<csv>2020/ala/HansensDataset/ZWZL3/metrics/results.csv</csv>
 +
 +
DDA1
 +
<csv>2020/ala/HansensDataset/DDA1/metrics/results.csv</csv>
 +
 +
 +
  
  
Line 82: Line 92:
 
<csv>2020/ala/HansensDataset/ZWZL3/metrics/results.csv</csv>
 
<csv>2020/ala/HansensDataset/ZWZL3/metrics/results.csv</csv>
  
 +
DDA1
 +
<csv>2020/ala/HansensDataset/DDA1/metrics/results.csv</csv>
  
 
===Mauch's dataset===
 
===Mauch's dataset===
Line 90: Line 102:
 
====Per-track results====
 
====Per-track results====
 
GGL1
 
GGL1
−
<csv>2020/ala/HansensDataset/GGL1/metrics/results.csv</csv>
+
<csv>2020/ala/MauchsDataset/GGL1/metrics/results.csv</csv>
  
 
GGL2
 
GGL2
−
<csv>2020/ala/HansensDataset/GGL2/metrics/results.csv</csv>
+
<csv>2020/ala/MauchsDataset/GGL2/metrics/results.csv</csv>
  
 
ZWZL1
 
ZWZL1
−
<csv>2020/ala/HansensDataset/ZWZL1/metrics/results.csv</csv>
+
<csv>2020/ala/MauchsDataset/ZWZL1/metrics/results.csv</csv>
  
  
 
ZWZL2
 
ZWZL2
−
<csv>2020/ala/HansensDataset/ZWZL2/metrics/results.csv</csv>
+
<csv>2020/ala/MauchsDataset/ZWZL2/metrics/results.csv</csv>
  
 
ZWZL3
 
ZWZL3
−
<csv>2020/ala/HansensDataset/ZWZL3/metrics/results.csv</csv>
+
<csv>2020/ala/MauchsDataset/ZWZL3/metrics/results.csv</csv>
  
 +
DDA1
 +
<csv>2020/ala/MauchsDataset/DDA1/metrics/results.csv</csv>
  
 
===Jamendo dataset===
 
===Jamendo dataset===
Line 114: Line 128:
  
 
GGL1
 
GGL1
−
<csv>2020/ala/HansensDataset/GGL1/metrics/results.csv</csv>
+
<csv>2020/ala/jamendolyrics/GGL1/metrics/results.csv</csv>
  
 
GGL2
 
GGL2
−
<csv>2020/ala/HansensDataset/GGL2/metrics/results.csv</csv>
+
<csv>2020/ala/jamendolyrics/GGL2/metrics/results.csv</csv>
  
 
ZWZL1
 
ZWZL1
−
<csv>2020/ala/HansensDataset/ZWZL1/metrics/results.csv</csv>
+
<csv>2020/ala/jamendolyrics/ZWZL1/metrics/results.csv</csv>
  
  
 
ZWZL2
 
ZWZL2
−
<csv>2020/ala/HansensDataset/ZWZL2/metrics/results.csv</csv>
+
<csv>2020/ala/jamendolyrics/ZWZL2/metrics/results.csv</csv>
  
 
ZWZL3
 
ZWZL3
−
<csv>2020/ala/HansensDataset/ZWZL3/metrics/results.csv</csv>
+
<csv>2020/ala/jamendolyrics/ZWZL3/metrics/results.csv</csv>
 +
 
 +
DDA1
 +
<csv>2020/ala/jamendolyrics/DDA1/metrics/results.csv</csv>

Revision as of 10:25, 15 October 2020

General Legend

Sub code Submission name Abstract Contributors
GGL1 NUS PDF Chitralekha Gupta, Haizhou Li
GGL2 NUS PDF Chitralekha Gupta, Haizhou Li
ZWZL1 ZWZL1 PDF [], [], []
ZWZL2 ZWZL2 PDF [], [], []
ZWZL3 ZWZL3 PDF [], [], []
DDA1 Audio2Lyrics_emirdemirel PDF Emir Demirel
CC1 Mir lab PDF [Chun-Hao]

Results

UNDER CONSTRUCTION...

Hansen's dataset a cappella

Summary Results

Submission Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
GGL1 0.09 0.03 0.86 0.98
GGL2 0.13 0.03 0.79 0.97
ZWZL1 0.17 0.03 0.79 0.96
ZWZL2 0.11 0.03 0.84 0.97
ZWZL3 0.14 0.03 0.84 0.96
DDA1 0.93 0.95 0.21 0.91

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/GGL2/metrics/results.csv not found

ZWZL1 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/ZWZL1/metrics/results.csv not found


ZWZL2 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/ZWZL2/metrics/results.csv not found

ZWZL3 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/ZWZL3/metrics/results.csv not found

DDA1 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/DDA1/metrics/results.csv not found



Hansen's dataset

Summary Results

Submission Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
GGL1 0.10 0.04 0.80 0.98
GGL2 0.10 0.04 0.78 0.97
ZWZL1 0.32 0.05 0.73 0.92
ZWZL2 0.24 0.05 0.73 0.92
ZWZL3 0.22 0.05 0.72 0.92
DDA1 0.17 0.05 0.20 0.93

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/GGL2/metrics/results.csv not found

ZWZL1 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/ZWZL1/metrics/results.csv not found


ZWZL2 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/ZWZL2/metrics/results.csv not found

ZWZL3 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/ZWZL3/metrics/results.csv not found

DDA1 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/DDA1/metrics/results.csv not found

Mauch's dataset

Summary Results

Submission Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
GGL1 0.22 0.10 NA 0.91
GGL2 0.19 0.10 NA 0.91
ZWZL1 1.33 0.76 NA 0.80
ZWZL2 0.41 0.10 NA 0.87
ZWZL3 0.42 0.10 NA 0.86
DDA1 0.61 0.11 NA 0.86

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/GGL2/metrics/results.csv not found

ZWZL1 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/ZWZL1/metrics/results.csv not found


ZWZL2 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/ZWZL2/metrics/results.csv not found

ZWZL3 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/ZWZL3/metrics/results.csv not found

DDA1 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/DDA1/metrics/results.csv not found

Jamendo dataset

Summary Results

Submission Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
GGL1 0.33 0.04 NA 0.94
GGL2 0.22 0.05 NA 0.94
ZWZL1 1.11 0.08 NA 0.81
ZWZL2 0.61 0.06 NA 0.88
ZWZL3 0.64 0.07 NA 0.86
DDA1 0.50 0.09 NA 0.84

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/GGL2/metrics/results.csv not found

ZWZL1 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/ZWZL1/metrics/results.csv not found


ZWZL2 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/ZWZL2/metrics/results.csv not found

ZWZL3 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/ZWZL3/metrics/results.csv not found

DDA1 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/DDA1/metrics/results.csv not found

Retrieved from "https://music-ir.org/mirex/w/index.php?title=2020:Automatic_Lyrics-to-Audio_Alignment_Results&oldid=13307"