2016:Singing Voice Separation Results

Introduction

Description

These are the results for the 2016 running of the Singing Voice Separation task set. For more information about this task set please refer to the 2016:Singing Voice Separation page.

Legend

Submission code	Submission name	Abstract PDF	Contributors
GD1	Harmonic Modeling of Singing Voice for Source Separation	PDF	Georgi Dzhambazov
HC1	MIREX 2016 Submission for Singing Voice Separation	PDF	Yi-Chun Huang, Tai-Shih Chi
LCP1	Deep Clustering for Singing Voice Separation	PDF	Yi Luo, Zhuo Chen, John R. Hershey, Jonathan Le Roux, Daniel P. W. Ellis
LCP2	Deep Clustering for Singing Voice Separation	PDF	Yi Luo, Zhuo Chen, John R. Hershey, Jonathan Le Roux, Daniel P. W. Ellis
MC2	MIREX 2016 Submission for Singing Voice Separation	-	Marius Miron, Pritish Chandna
MC3	MIREX 2016 Submission for Singing Voice Separation	-	Marius Miron, Pritish Chandna
RSGP1	Singing Voice Separation Using Deep Neural Networks and F0 Estimation	PDF	Gerard Roma, Emad M. Grais, Andrew J. R. Simpson, Mark D. Plumbley

Evaluation Criteria

GNSDR = Global Normalized Signal-to-Distortion Ratio
NSDR = Normalized Signal-to-Distortion Ratio
SIR = Signal-to-Interference Ratio
SAR = Signal-to-Artifacts Ratio

Summary

Summary Results

Algorithm	Voice GNSDR (dB)	Music GNSDR (dB)	Runtime (m)
GD1	-2.2810	0.3954	26.4413
HC1	4.6309	7.8180	28.9727
LCP1	6.0726	10.9256	37.8235
LCP2	6.3414	11.1878	32.4800
MC2	5.2891	9.6678	34.8084
MC3	5.4920	9.8049	36.7194
RSGP1	3.2589	8.7664	32.3578

NSDR

For the Singing Voice (dB)

Algorithm	Mean	SD	Min	Max	Median
GD1	-2.281	3.534	-11.740	6.623	-1.935
HC1	4.631	2.903	-1.127	14.260	3.883
LCP1	6.073	3.462	-1.658	17.170	5.649
LCP2	6.341	3.370	-1.958	17.240	5.997
MC2	5.289	2.914	-1.302	12.571	4.945
MC3	5.492	2.881	-0.453	12.448	5.195
RSGP1	3.259	3.617	-14.027	12.045	3.304

download these results as csv

For the Music Accompaniment (dB)

Algorithm	Mean	SD	Min	Max	Median
GD1	0.395	1.470	-2.260	5.825	0.211
HC1	7.818	2.647	-1.258	15.861	8.046
LCP1	10.926	3.835	0.742	19.960	10.883
LCP2	11.188	3.626	2.508	19.875	11.087
MC2	9.668	3.676	-7.875	22.734	9.926
MC3	9.805	3.944	-7.679	22.453	10.099
RSGP1	8.766	3.828	-6.905	18.065	8.966

download these results as csv

Boxplots

SIR

For the Singing Voice (dB)

Algorithm	Mean	SD	Min	Max	Median
GD1	6.562	9.778	-30.324	24.205	9.043
HC1	9.762	10.006	-28.081	23.070	12.713
LCP1	13.822	10.320	-24.604	26.302	16.844
LCP2	14.518	10.163	-23.923	26.606	17.467
MC2	10.471	10.189	-29.559	28.854	12.621
MC3	10.844	10.314	-28.896	29.313	13.346
RSGP1	16.240	10.743	-26.850	33.092	18.471

download these results as csv

For the Music Accompaniment (dB)

Algorithm	Mean	SD	Min	Max	Median
GD1	1.984	9.805	-11.864	37.146	0.840
HC1	8.978	9.299	-2.271	42.987	7.576
LCP1	24.015	7.915	5.929	47.039	23.596
LCP2	25.170	7.220	11.146	48.129	24.578
MC2	19.811	6.984	2.837	42.629	19.143
MC3	19.609	7.091	2.366	43.881	18.602
RSGP1	17.737	6.484	4.017	42.258	16.593

download these results as csv

Boxplots

SAR

For the Singing Voice (dB)

Algorithm	Mean	SD	Min	Max	Median
GD1	2.394	4.562	-12.304	9.967	3.465
HC1	10.768	7.287	-19.592	20.876	12.282
LCP1	10.183	8.150	-23.437	20.348	12.538
LCP2	10.137	8.305	-22.992	20.063	12.235
MC2	11.243	7.441	-18.240	20.293	12.813
MC3	11.248	7.498	-15.216	20.749	12.811
RSGP1	6.627	7.140	-24.741	14.289	8.313

download these results as csv

For the Music Accompaniment (dB)

Algorithm	Mean	SD	Min	Max	Median
GD1	2.708	2.661	-6.024	10.608	2.948
HC1	8.019	3.476	-3.232	16.401	7.483
LCP1	7.168	3.732	-2.080	17.939	7.087
LCP2	7.346	3.483	-0.713	18.004	7.451
MC2	6.106	3.537	-2.182	13.294	6.145
MC3	6.288	3.507	-3.431	13.943	6.559
RSGP1	5.286	2.539	-1.849	13.933	5.373

download these results as csv

Boxplots

Runtime Data

Submission Code	Runtime (m)
GD1	26.4413
HC1	28.9727
LCP1	37.8235
LCP2	32.4800
MC2	34.8084
MC3	36.7194
RSGP1	32.3578

download these results as csv