Difference between revisions of "2021: Automatic Lyrics Transcription Results"

From MIREX Wiki
Line 26: Line 26:
 
====Summary Results====
 
====Summary Results====
  
−
| border="1" cellspacing="0" style="text-align: left; width: 800px;"
+
{| border="1" cellspacing="0" style="text-align: left; width: 200px;"
 
     |- style="background: white"
 
     |- style="background: white"
−
     ! width="200" | Submission
+
     ! width="50" | Submission
−
     ! width="100" | Avrg WER
+
     ! width="50" | Avrg WER
 
     |-
 
     |-
−
     ! RB1| Sheffield University
+
   
 +
     ! YYHL1
 +
    | 11.45
 
     |-
 
     |-
 +
   
 +
    ! YYHL3
 +
    | 12.77
 +
    |-
 +
|}
 +
 
====Per-track results====
 
====Per-track results====
  
−
GGL1
 
−
<csv>2020/lt/HansensDataset/YYHL1/results.csv</csv>
 
−
 
−
GGL2
 
−
<csv>2020/lt/HansensDataset/YYHL3/results.csv</csv>
 
−
 
−
RB1
 
−
<csv>2020/lt/HansensDataset/RB1//results.csv</csv>
 
−
 
−
DDA2
 
−
<csv>2020/lt/HansensDataset/DDA2//results.csv</csv>
 
−
 
−
DDA3
 
−
<csv>2020/lt/HansensDataset/DDA3//results.csv</csv>
 
  
  
 
===Hansen's dataset===
 
===Hansen's dataset===
 
====Summary Results====
 
====Summary Results====
−
<csv>2020/lt/HansensDataset/summary_HansensDataset.csv</csv>
+
{| border="1" cellspacing="0" style="text-align: left; width: 200px;"
−
 
+
    |- style="background: white"
 +
    ! width="50" | Submission
 +
    ! width="50" | Avrg WER
 +
    |-
 +
   
 +
    ! YYHL1
 +
    | 13.54
 +
    |-
 +
   
 +
    ! YYHL3
 +
    | 16.88
 +
    |-
 +
|}
 
====Per-track results====
 
====Per-track results====
−
 
−
GGL1
 
−
<csv>2020/lt/HansensDataset/GGL1//results.csv</csv>
 
−
 
−
GGL2
 
−
<csv>2020/lt/HansensDataset/GGL2//results.csv</csv>
 
−
 
−
RB1
 
−
<csv>2020/lt/HansensDataset/RB1//results.csv</csv>
 
−
 
−
DDA2
 
−
<csv>2020/lt/HansensDataset/DDA2//results.csv</csv>
 
−
 
−
DDA3
 
−
<csv>2020/lt/HansensDataset/DDA3//results.csv</csv>
 
  
  
Line 76: Line 67:
  
 
====Summary Results====
 
====Summary Results====
−
<csv>2020/lt/MauchsDataset/summary_MauchsDataset.csv</csv>
+
{| border="1" cellspacing="0" style="text-align: left; width: 200px;"
−
 
+
    |- style="background: white"
 +
    ! width="50" | Submission
 +
    ! width="50" | Avrg WER
 +
    |-
 +
   
 +
    ! YYHL1
 +
    | 22.11
 +
    |-
 +
   
 +
    ! YYHL3
 +
    | 26.20
 +
    |-
 +
|}
 
====Per-track results====
 
====Per-track results====
−
GGL1
 
−
<csv>2020/lt/MauchsDataset/GGL1//results.csv</csv>
 
−
 
−
GGL2
 
−
<csv>2020/lt/MauchsDataset/GGL2//results.csv</csv>
 
−
 
−
RB1
 
−
<csv>2020/lt/MauchsDataset/RB1//results.csv</csv>
 
−
 
−
DDA2
 
−
<csv>2020/lt/MauchsDataset/DDA2//results.csv</csv>
 
−
 
−
DDA3
 
−
<csv>2020/lt/MauchsDataset/DDA3//results.csv</csv>
 
−
 
  
 
===Jamendo dataset===
 
===Jamendo dataset===
  
 
====Summary Results====
 
====Summary Results====
−
<csv>2020/lt/jamendolyrics/summary_jamendolyrics.csv</csv>
+
{| border="1" cellspacing="0" style="text-align: left; width: 200px;"
−
 
+
    |- style="background: white"
 +
    ! width="50" | Submission
 +
    ! width="50" | Avrg WER
 +
    |-
 +
   
 +
    ! YYHL1
 +
    | 24.34
 +
    |-
 +
   
 +
    ! YYHL3
 +
    | 26.86
 +
    |-
 +
|}
 
====Per-track results====
 
====Per-track results====
−
 
−
GGL1
 
−
<csv>2020/lt/jamendolyrics/GGL1//results.csv</csv>
 
−
 
−
GGL2
 
−
<csv>2020/lt/jamendolyrics/GGL2//results.csv</csv>
 
−
 
−
RB1
 
−
<csv>2020/lt/jamendolyrics/RB1//results.csv</csv>
 
−
 
−
DDA2
 
−
<csv>2020/lt/jamendolyrics/DDA2//results.csv</csv>
 
−
 
−
DDA3
 
−
<csv>2020/lt/jamendolyrics/DDA3//results.csv</csv>
 

Revision as of 15:12, 13 February 2022

General Legend

Sub code Submission name Abstract Contributors
YYHL1 NetEase PDF Zhen Yang, Qichen Han, Xiang Li, Dong Liu, Peng Li
YYHL3 NetEase PDF Zhen Yang, Qichen Han, Xiang Li, Dong Liu, Peng Li


Results

Hansen's dataset a cappella

Summary Results

Submission Avrg WER
YYHL1 11.45
YYHL3 12.77

Per-track results

Hansen's dataset

Summary Results

Submission Avrg WER
YYHL1 13.54
YYHL3 16.88

Per-track results

Mauch's dataset

Summary Results

Submission Avrg WER
YYHL1 22.11
YYHL3 26.20

Per-track results

Jamendo dataset

Summary Results

Submission Avrg WER
YYHL1 24.34
YYHL3 26.86

Per-track results

Retrieved from "https://music-ir.org/mirex/w/index.php?title=2021:_Automatic_Lyrics_Transcription_Results&oldid=13557"