Difference between revisions of "2020:Lyrics Transcription Results"
| Line 22: | Line 22: | ||
! DDA2 | ! DDA2 | ||
| − | | Audio2Lyrics_emirdemirel || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/ | + | | Audio2Lyrics_emirdemirel || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/DDA3.pdf PDF] || [http://www.eecs.qmul.ac.uk/profiles/demirelemir.html Emir Demirel] |
|- | |- | ||
Revision as of 09:42, 15 October 2020
Contents
General Legend
| Sub code | Submission name | Abstract | Contributors |
|---|---|---|---|
| GGL1 | NUS | Chitralekha Gupta, Haizhou Li | |
| GGL2 | NUS | Chitralekha Gupta, Haizhou Li | |
| RB1 | RB1 | [] | |
| DDA2 | Audio2Lyrics_emirdemirel | Emir Demirel | |
| DDA3 | Audio2Lyrics_emirdemirel | Emir Demirel |
Results
UNDER CONSTRUCTION...
Hansen's dataset a cappella
Summary Results
| Submission | Avg WER | Avg insertions | Avg Deletions | Avg Substitutions | Avg TotalWords |
|---|---|---|---|---|---|
| GGL1 | 41.86 | 5.20 | 58.60 | 57.60 | 287.50 |
| GGL2 | 47.86 | 4.10 | 90.50 | 43.20 | 287.50 |
| RB1 | 52.82 | 12.00 | 48.40 | 84.30 | 287.50 |
| DDA2 | 38.00 | 16.20 | 11.00 | 82.20 | 287.50 |
| DDA3 | 37.02 | 16.40 | 13.40 | 78.10 | 287.50 |
Per-track results
GGL1 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/GGL1/metrics/results.csv not found
GGL2 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/GGL2/metrics/results.csv not found
RB1 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/RB1/metrics/results.csv not found
DDA2 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/DDA2/metrics/results.csv not found
DDA3 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/DDA3/metrics/results.csv not found
Hansen's dataset
Summary Results
| Submission | Avg WER | Avg insertions | Avg Deletions | Avg Substitutions | Avg TotalWords |
|---|---|---|---|---|---|
| GGL1 | 47.86 | 6.40 | 65.10 | 67.80 | 287.50 |
| GGL2 | 47.86 | 4.10 | 90.50 | 43.20 | 287.50 |
| RB1 | 83.43 | 7.60 | 118.30 | 118.10 | 287.50 |
| DDA2 | 74.81 | 35.50 | 17.00 | 164.60 | 287.50 |
| DDA3 | 77.36 | 6.20 | 100.70 | 114.60 | 287.50 |
Per-track results
GGL1 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/GGL1/metrics/results.csv not found
GGL2 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/GGL2/metrics/results.csv not found
RB1 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/RB1/metrics/results.csv not found
DDA2 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/DDA2/metrics/results.csv not found
DDA3 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/DDA3/metrics/results.csv not found
Mauch's dataset
Summary Results
| Submission | Avg WER | Avg insertions | Avg Deletions | Avg Substitutions | Avg TotalWords |
|---|---|---|---|---|---|
| GGL1 | 47.25 | 4.65 | 52.90 | 62.10 | 252.60 |
| GGL2 | 49.54 | 4.20 | 61.60 | 58.65 | 252.60 |
| RB1 | 84.98 | 7.25 | 84.35 | 121.45 | 252.60 |
| DDA2 | 75.39 | 30.65 | 16.05 | 138.90 | 252.60 |
| DDA3 | 80.66 | 5.35 | 102.70 | 94.60 | 252.60 |
Per-track results
GGL1 file /nema-raid/www/mirex/results/2020/lt/MauchsDataset/GGL1/metrics/results.csv not found
GGL2 file /nema-raid/www/mirex/results/2020/lt/MauchsDataset/GGL2/metrics/results.csv not found
RB1 file /nema-raid/www/mirex/results/2020/lt/MauchsDataset/RB1/metrics/results.csv not found
DDA2 file /nema-raid/www/mirex/results/2020/lt/MauchsDataset/DDA2/metrics/results.csv not found
DDA3 file /nema-raid/www/mirex/results/2020/lt/MauchsDataset/DDA3/metrics/results.csv not found
Jamendo dataset
Summary Results
| Submission | Avg WER | Avg insertions | Avg Deletions | Avg Substitutions | Avg TotalWords |
|---|---|---|---|---|---|
| GGL1 | 60.98 | 11.75 | 67.15 | 93.10 | 283.85 |
| GGL2 | 62.46 | 8.05 | 90.05 | 83.80 | 283.85 |
| RB1 | 86.70 | 8.70 | 90.60 | 140.60 | 283.85 |
| DDA2 | 72.14 | 34.45 | 20.65 | 134.30 | 283.85 |
| DDA3 | 73.09 | 7.15 | 85.40 | 103.40 | 283.85 |
Per-track results
GGL1 file /nema-raid/www/mirex/results/2020/lt/jamendolyrics/GGL1/metrics/results.csv not found
GGL2 file /nema-raid/www/mirex/results/2020/lt/jamendolyrics/GGL2/metrics/results.csv not found
RB1 file /nema-raid/www/mirex/results/2020/lt/jamendolyrics/RB1/metrics/results.csv not found
DDA2 file /nema-raid/www/mirex/results/2020/lt/jamendolyrics/DDA2/metrics/results.csv not found
DDA3 file /nema-raid/www/mirex/results/2020/lt/jamendolyrics/DDA3/metrics/results.csv not found
