Revision as of 09:55, 5 October 2015
Introduction
Description
These are the results for the 2015 running of the Singing Voice Separation task set. For more information about this task set please refer to the 2015:Singing Voice Separation page.
Legend
| Submission code
|
Submission name
|
Abstract PDF
|
Contributors
|
| FJ1
|
Submission name |
- |
Contributors
|
| FJ2
|
Submission name |
- |
Contributors
|
| IIY3
|
Submission name |
- |
Contributors
|
| IIY4
|
Submission name |
- |
Contributors
|
| MD3
|
Submission name |
- |
Contributors
|
| MD4
|
Submission name |
- |
Contributors
|
Evaluation Criteria
GNSDR = Global Normalized Signal-to-Distortion Ratio
NSDR = Normalized Signal-to-Distortion Ratio
SIR = Signal-to-Interference Ratio
SAR = Signal-to-Artifacts Ratio
Summary
Summary Results
| Algorithm |
Voice GNSDR (dB) |
Music GNSDR (dB) |
Runtime (m)
|
| FJ1 |
|
|
|
| FJ2 |
|
|
|
| IIY3 |
|
|
|
| IIY4 |
|
|
|
| MD3 |
|
|
|
| MD4 |
|
|
|
NSDR
For the Singing Voice (dB)
| Algorithm |
Mean |
SD |
Min |
Max |
Median |
| FJ1 |
6.8236 |
3.3945 |
-1.0987 |
17.087 |
6.693 |
| FJ2 |
6.3487 |
3.4062 |
-1.5522 |
16.139 |
6.3066 |
| IIY3 |
4.9862 |
3.0974 |
-1.4384 |
15.753 |
4.5152 |
| IIY4 |
5.3953 |
3.1454 |
-1.5708 |
16.296 |
5.321 |
| MD3 |
2.9831 |
3.359 |
-3.6909 |
14.99 |
2.991 |
| MD4 |
3.1022 |
2.3219 |
-1.5255 |
10.167 |
3.082 |
download these results as csv
For the Music Accompaniment (dB)
| Algorithm |
Mean |
SD |
Min |
Max |
Median |
| FJ1 |
10.135 |
2.9105 |
2.2446 |
17.147 |
10.139 |
| FJ2 |
9.8678 |
2.7308 |
3.379 |
15.962 |
9.6999 |
| IIY3 |
8.2138 |
3.5171 |
-11.987 |
14.139 |
8.8945 |
| IIY4 |
8.77 |
3.8443 |
-14.661 |
16.429 |
9.2513 |
| MD3 |
6.3671 |
3.0928 |
-1.2317 |
14.238 |
6.3533 |
| MD4 |
7.4657 |
3.8335 |
-7.6267 |
17.156 |
7.6152 |
download these results as csv
Boxplots
SIR
For the Singing Voice (dB)
| Algorithm |
Mean |
SD |
Min |
Max |
Median |
| FJ1 |
13.346 |
10.351 |
-23.786 |
37.811 |
15.755 |
| FJ2 |
13.746 |
10.18 |
-23.665 |
33.926 |
16.683 |
| IIY3 |
15.717 |
11.713 |
-27.859 |
32.436 |
18.944 |
| IIY4 |
14.626 |
11.323 |
-28.429 |
31.364 |
16.947 |
| MD3 |
11.361 |
10.162 |
-24.183 |
25.137 |
14.065 |
| MD4 |
6.6966 |
9.8508 |
-30.777 |
19.816 |
9.1638 |
download these results as csv
For the Music Accompaniment (dB)
| Algorithm |
Mean |
SD |
Min |
Max |
Median |
| FJ1 |
11.203 |
8.9932 |
-2.3519 |
43.1 |
9.5306 |
| FJ2 |
11.653 |
9.2526 |
-4.0102 |
44.696 |
9.6655 |
| IIY3 |
13.288 |
8.3022 |
1.3372 |
40.385 |
12.376 |
| IIY4 |
15.057 |
8.4537 |
2.1673 |
43.782 |
14.952 |
| MD3 |
9.7413 |
9.8699 |
-5.4239 |
46.37 |
8.2292 |
| MD4 |
16.616 |
8.4294 |
1.1789 |
41.702 |
15.186 |
download these results as csv
Boxplots
SAR
For the Singing Voice (dB)
| Algorithm |
Mean |
SD |
Min |
Max |
Median |
| FJ1 |
11.517 |
8.3821 |
-22.529 |
20.922 |
13.88 |
| FJ2 |
10.586 |
8.1887 |
-23.897 |
17.987 |
13.214 |
| IIY3 |
8.5224 |
7.4896 |
-25.194 |
17.422 |
10.527 |
| IIY4 |
9.214 |
7.6286 |
-24.313 |
17.835 |
11.522 |
| MD3 |
7.1543 |
6.743 |
-19.385 |
19.311 |
8.2378 |
| MD4 |
11.651 |
7.329 |
-13.815 |
27.014 |
12.629 |
download these results as csv
For the Music Accompaniment (dB)
| Algorithm |
Mean |
SD |
Min |
Max |
Median |
| FJ1 |
9.9624 |
3.2432 |
-0.75164 |
18.359 |
10.182 |
| FJ2 |
9.082 |
3.2594 |
0.040332 |
17.077 |
9.1409 |
| IIY3 |
5.754 |
3.3033 |
-4.0821 |
16.133 |
5.4503 |
| IIY4 |
5.9472 |
3.4381 |
-6.7539 |
16.601 |
5.9557 |
| MD3 |
5.3175 |
3.8621 |
-6.6715 |
15.684 |
5.324 |
| MD4 |
4.2005 |
3.5672 |
-5.4033 |
11.8 |
4.6933 |
download these results as csv
Boxplots
Runtime Data
| Submission Code |
Runtime (m) |
| FJ1 |
3.4014 |
| FJ2 |
2.9135 |
| IIY3 |
99.1737 |
| IIY4 |
46.6621 |
| MD3 |
121.6655 |
| MD4 |
121.1348 |
download these results as csv
