2020:Lyrics Transcription Results
Contents
General Legend
| Sub code | Submission name | Abstract | Contributors |
|---|---|---|---|
| GGL1 | NUS | Chitralekha Gupta, Haizhou Li | |
| GGL2 | NUS | Chitralekha Gupta, Haizhou Li | |
| RB1 | RB1 | [] | |
| DDA2 | assumes input is polyphonic | Emir Demirel | |
| DDA3 | assumes input is acapella | Emir Demirel |
Results
UNDER CONSTRUCTION...
Hansen's dataset a cappella
Summary Results
| Submission | Avg WER | Avg insertions | Avg Deletions | Avg Substitutions | Avg TotalWords |
|---|---|---|---|---|---|
| GGL1 | 41.86 | 5.20 | 58.60 | 57.60 | 287.50 |
| GGL2 | 47.86 | 4.10 | 90.50 | 43.20 | 287.50 |
| RB1 | 52.82 | 12.00 | 48.40 | 84.30 | 287.50 |
| DDA2 | 38.00 | 16.20 | 11.00 | 82.20 | 287.50 |
| DDA3 | 37.02 | 16.40 | 13.40 | 78.10 | 287.50 |
Per-track results
GGL1 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/GGL1/metrics/results.csv not found
GGL2 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/GGL2/metrics/results.csv not found
RB1 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/RB1/metrics/results.csv not found
DDA2 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/DDA2/metrics/results.csv not found
DDA3 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/DDA3/metrics/results.csv not found
Hansen's dataset
Summary Results
| Submission | Avg WER | Avg insertions | Avg Deletions | Avg Substitutions | Avg TotalWords |
|---|---|---|---|---|---|
| GGL1 | 47.86 | 6.40 | 65.10 | 67.80 | 287.50 |
| GGL2 | 47.86 | 4.10 | 90.50 | 43.20 | 287.50 |
| RB1 | 83.43 | 7.60 | 118.30 | 118.10 | 287.50 |
| DDA2 | 74.81 | 35.50 | 17.00 | 164.60 | 287.50 |
| DDA3 | 77.36 | 6.20 | 100.70 | 114.60 | 287.50 |
Per-track results
GGL1 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/GGL1/metrics/results.csv not found
GGL2 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/GGL2/metrics/results.csv not found
RB1 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/RB1/metrics/results.csv not found
DDA2 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/DDA2/metrics/results.csv not found
DDA3 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/DDA3/metrics/results.csv not found
Mauch's dataset
Summary Results
| Submission | Avg WER | Avg insertions | Avg Deletions | Avg Substitutions | Avg TotalWords |
|---|---|---|---|---|---|
| GGL1 | 47.25 | 4.65 | 52.90 | 62.10 | 252.60 |
| GGL2 | 49.54 | 4.20 | 61.60 | 58.65 | 252.60 |
| RB1 | 84.98 | 7.25 | 84.35 | 121.45 | 252.60 |
| DDA2 | 75.39 | 30.65 | 16.05 | 138.90 | 252.60 |
| DDA3 | 80.66 | 5.35 | 102.70 | 94.60 | 252.60 |
Per-track results
GGL1 file /nema-raid/www/mirex/results/2020/lt/MauchsDataset/GGL1/metrics/results.csv not found
GGL2 file /nema-raid/www/mirex/results/2020/lt/MauchsDataset/GGL2/metrics/results.csv not found
RB1 file /nema-raid/www/mirex/results/2020/lt/MauchsDataset/RB1/metrics/results.csv not found
DDA2 file /nema-raid/www/mirex/results/2020/lt/MauchsDataset/DDA2/metrics/results.csv not found
DDA3 file /nema-raid/www/mirex/results/2020/lt/MauchsDataset/DDA3/metrics/results.csv not found
Jamendo dataset
Summary Results
| Submission | Avg WER | Avg insertions | Avg Deletions | Avg Substitutions | Avg TotalWords |
|---|---|---|---|---|---|
| GGL1 | 60.98 | 11.75 | 67.15 | 93.10 | 283.85 |
| GGL2 | 62.46 | 8.05 | 90.05 | 83.80 | 283.85 |
| RB1 | 86.70 | 8.70 | 90.60 | 140.60 | 283.85 |
| DDA2 | 72.14 | 34.45 | 20.65 | 134.30 | 283.85 |
| DDA3 | 73.09 | 7.15 | 85.40 | 103.40 | 283.85 |
Per-track results
GGL1 file /nema-raid/www/mirex/results/2020/lt/jamendolyrics/GGL1/metrics/results.csv not found
GGL2 file /nema-raid/www/mirex/results/2020/lt/jamendolyrics/GGL2/metrics/results.csv not found
RB1 file /nema-raid/www/mirex/results/2020/lt/jamendolyrics/RB1/metrics/results.csv not found
DDA2 file /nema-raid/www/mirex/results/2020/lt/jamendolyrics/DDA2/metrics/results.csv not found
DDA3 file /nema-raid/www/mirex/results/2020/lt/jamendolyrics/DDA3/metrics/results.csv not found
