Difference between revisions of "2020:Lyrics Transcription Results"

From MIREX Wiki
(Created page with "TODO")
 
Line 1: Line 1:
−
TODO
+
= General Legend =
 +
 
 +
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
 +
    |- style="background: yellow"
 +
    ! width="80" | Sub code
 +
    ! width="200" | Submission name
 +
    ! width="80" style="text-align: center;" | Abstract
 +
    ! width="540" | Contributors
 +
    |-
 +
 
 +
    ! GGL1
 +
    | NUS ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/GL1.pdf PDF] || [https://www.comp.nus.edu.sg/~chitrale/ Chitralekha Gupta], [http://ece.nus.edu.sg/drupal/?q=node/159 Haizhou Li]
 +
    |-
 +
 
 +
    ! GGL2
 +
    | NUS ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/GL1.pdf PDF] || [https://www.comp.nus.edu.sg/~chitrale/ Chitralekha Gupta], [http://ece.nus.edu.sg/drupal/?q=node/159 Haizhou Li]
 +
    |-
 +
 
 +
    ! RB1
 +
    | RB1  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/RB1.pdf PDF] || []
 +
    |-
 +
 
 +
    ! DDA2
 +
    | Audio2Lyrics_emirdemirel  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/DDA1.pdf PDF] || [http://www.eecs.qmul.ac.uk/profiles/demirelemir.html Emir Demirel]
 +
    |-
 +
   
 +
! DDA3
 +
    | Audio2Lyrics_emirdemirel  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/DDA3.pdf PDF] || [http://www.eecs.qmul.ac.uk/profiles/demirelemir.html Emir Demirel]
 +
    |-
 +
 
 +
 
 +
|}
 +
 
 +
=Results=
 +
UNDER CONSTRUCTION...
 +
 
 +
===Hansen's dataset a cappella===
 +
====Summary Results====
 +
<csv>2020/lt/HansensDataset_acappella/summary_HansensDataset_acappella.csv</csv>
 +
 
 +
====Per-track results====
 +
 
 +
GGL1
 +
<csv>2020/lt/HansensDataset/GGL1/metrics/results.csv</csv>
 +
 
 +
GGL2
 +
<csv>2020/lt/HansensDataset/GGL2/metrics/results.csv</csv>
 +
 
 +
RB1
 +
<csv>2020/lt/HansensDataset/RB1/metrics/results.csv</csv>
 +
 
 +
DDA2
 +
<csv>2020/lt/HansensDataset/DDA2/metrics/results.csv</csv>
 +
 
 +
DDA3
 +
<csv>2020/lt/HansensDataset/DDA3/metrics/results.csv</csv>
 +
 
 +
 
 +
===Hansen's dataset===
 +
====Summary Results====
 +
<csv>2020/lt/HansensDataset/summary_HansensDataset.csv</csv>
 +
 
 +
====Per-track results====
 +
 
 +
GGL1
 +
<csv>2020/lt/HansensDataset/GGL1/metrics/results.csv</csv>
 +
 
 +
GGL2
 +
<csv>2020/lt/HansensDataset/GGL2/metrics/results.csv</csv>
 +
 
 +
RB1
 +
<csv>2020/lt/HansensDataset/RB1/metrics/results.csv</csv>
 +
 
 +
DDA2
 +
<csv>2020/lt/HansensDataset/DDA2/metrics/results.csv</csv>
 +
 
 +
DDA3
 +
<csv>2020/lt/HansensDataset/DDA3/metrics/results.csv</csv>
 +
 
 +
 
 +
===Mauch's dataset===
 +
 
 +
====Summary Results====
 +
<csv>2020/lt/MauchsDataset/summary_MauchsDataset.csv</csv>
 +
 
 +
====Per-track results====
 +
GGL1
 +
<csv>2020/lt/MauchsDataset/GGL1/metrics/results.csv</csv>
 +
 
 +
GGL2
 +
<csv>2020/lt/MauchsDataset/GGL2/metrics/results.csv</csv>
 +
 
 +
RB1
 +
<csv>2020/lt/MauchsDataset/RB1/metrics/results.csv</csv>
 +
 
 +
DDA2
 +
<csv>2020/lt/MauchsDataset/DDA2/metrics/results.csv</csv>
 +
 
 +
DDA3
 +
<csv>2020/lt/MauchsDataset/DDA3/metrics/results.csv</csv>
 +
 
 +
 
 +
===Jamendo dataset===
 +
 
 +
====Summary Results====
 +
<csv>2020/lt/jamendolyrics/summary_jamendolyrics.csv</csv>
 +
 
 +
====Per-track results====
 +
 
 +
GGL1
 +
<csv>2020/lt/jamendolyrics/GGL1/metrics/results.csv</csv>
 +
 
 +
GGL2
 +
<csv>2020/lt/jamendolyrics/GGL2/metrics/results.csv</csv>
 +
 
 +
RB1
 +
<csv>2020/lt/jamendolyrics/RB1/metrics/results.csv</csv>
 +
 
 +
DDA2
 +
<csv>2020/lt/jamendolyrics/DDA2/metrics/results.csv</csv>
 +
 
 +
DDA3
 +
<csv>2020/lt/jamendolyrics/DDA3/metrics/results.csv</csv>

Revision as of 09:39, 15 October 2020

General Legend

Sub code Submission name Abstract Contributors
GGL1 NUS PDF Chitralekha Gupta, Haizhou Li
GGL2 NUS PDF Chitralekha Gupta, Haizhou Li
RB1 RB1 PDF []
DDA2 Audio2Lyrics_emirdemirel PDF Emir Demirel
DDA3 Audio2Lyrics_emirdemirel PDF Emir Demirel

Results

UNDER CONSTRUCTION...

Hansen's dataset a cappella

Summary Results

Submission Avg WER Avg insertions Avg Deletions Avg Substitutions Avg TotalWords
GGL1 41.86 5.20 58.60 57.60 287.50
GGL2 47.86 4.10 90.50 43.20 287.50
RB1 52.82 12.00 48.40 84.30 287.50
DDA2 38.00 16.20 11.00 82.20 287.50
DDA3 37.02 16.40 13.40 78.10 287.50

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/GGL2/metrics/results.csv not found

RB1 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/RB1/metrics/results.csv not found

DDA2 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/DDA2/metrics/results.csv not found

DDA3 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/DDA3/metrics/results.csv not found


Hansen's dataset

Summary Results

Submission Avg WER Avg insertions Avg Deletions Avg Substitutions Avg TotalWords
GGL1 47.86 6.40 65.10 67.80 287.50
GGL2 47.86 4.10 90.50 43.20 287.50
RB1 83.43 7.60 118.30 118.10 287.50
DDA2 74.81 35.50 17.00 164.60 287.50
DDA3 77.36 6.20 100.70 114.60 287.50

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/GGL2/metrics/results.csv not found

RB1 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/RB1/metrics/results.csv not found

DDA2 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/DDA2/metrics/results.csv not found

DDA3 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/DDA3/metrics/results.csv not found


Mauch's dataset

Summary Results

Submission Avg WER Avg insertions Avg Deletions Avg Substitutions Avg TotalWords
GGL1 47.25 4.65 52.90 62.10 252.60
GGL2 49.54 4.20 61.60 58.65 252.60
RB1 84.98 7.25 84.35 121.45 252.60
DDA2 75.39 30.65 16.05 138.90 252.60
DDA3 80.66 5.35 102.70 94.60 252.60

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/lt/MauchsDataset/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/lt/MauchsDataset/GGL2/metrics/results.csv not found

RB1 file /nema-raid/www/mirex/results/2020/lt/MauchsDataset/RB1/metrics/results.csv not found

DDA2 file /nema-raid/www/mirex/results/2020/lt/MauchsDataset/DDA2/metrics/results.csv not found

DDA3 file /nema-raid/www/mirex/results/2020/lt/MauchsDataset/DDA3/metrics/results.csv not found


Jamendo dataset

Summary Results

Submission Avg WER Avg insertions Avg Deletions Avg Substitutions Avg TotalWords
GGL1 60.98 11.75 67.15 93.10 283.85
GGL2 62.46 8.05 90.05 83.80 283.85
RB1 86.70 8.70 90.60 140.60 283.85
DDA2 72.14 34.45 20.65 134.30 283.85
DDA3 73.09 7.15 85.40 103.40 283.85

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/lt/jamendolyrics/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/lt/jamendolyrics/GGL2/metrics/results.csv not found

RB1 file /nema-raid/www/mirex/results/2020/lt/jamendolyrics/RB1/metrics/results.csv not found

DDA2 file /nema-raid/www/mirex/results/2020/lt/jamendolyrics/DDA2/metrics/results.csv not found

DDA3 file /nema-raid/www/mirex/results/2020/lt/jamendolyrics/DDA3/metrics/results.csv not found

Retrieved from "https://music-ir.org/mirex/w/index.php?title=2020:Lyrics_Transcription_Results&oldid=13305"