2016:Singing Voice Separation Results - Revision history

Tak-Shing Chan: /* Legend */

2016-08-03T08:56:21Z

‎Legend

Tak-Shing Chan: /* Description */

2016-08-03T08:41:29Z

‎Description

Tak-Shing Chan at 08:23, 1 August 2016

2016-08-01T08:23:42Z

Tak-Shing Chan at 08:20, 1 August 2016

2016-08-01T08:20:49Z

Tak-Shing Chan: Created page with "== Introduction == === Description === These are the results for the 2016 running of the Singing Voice Separation task set. For more information about this task set please refe..."

2016-08-01T08:01:50Z

Created page with "== Introduction == === Description === These are the results for the 2016 running of the Singing Voice Separation task set. For more information about this task set please refe..."

New page

== Introduction ==

=== Description ===

These are the results for the 2016 running of the Singing Voice Separation task set. For more information about this task set please refer to the [[2016:Singing Voice Separation]] page.

=== Legend ===

{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Submission code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract PDF
! width="440" | Contributors
|-
! GD1
| HARMONIC MODELING OF SINGING VOICE FOR SOURCE SEPARATION || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/GD1.pdf PDF] || Georgi Dzhambazov
|-
! HC1
| MIREX 2016 Submission for Singing Voice Separation || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/HC1.pdf PDF] || Yi-Chun Huang, Tai-Shih Chi
|-
! LCP1
| DEEP CLUSTERING FOR SINGING VOICE SEPARATION || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/LCP1.pdf PDF] || Yi Luo, Zhuo Chen, John R. Hershey, Jonathan Le Roux, Daniel P. W. Ellis
|-
! LCP2
| DEEP CLUSTERING FOR SINGING VOICE SEPARATION || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/LCP2.pdf PDF] || Yi Luo, Zhuo Chen, John R. Hershey, Jonathan Le Roux, Daniel P. W. Ellis
|-
! MC2
| MIREX 2016 Submission for Singing Voice Separation || style="text-align: center;" | - || Marius Miron, Pritish Chandna
|-
! MC3
| MIREX 2016 Submission for Singing Voice Separation || style="text-align: center;" | - || Marius Miron, Pritish Chandna
|-
! RSGP1
| MIREX || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/RSGP1.pdf PDF] || Gerard Roma, Emad M. Grais, Andrew J. R. Simpson, Mark D. Plumbley
|}

==== Evaluation Criteria ====

'''GNSDR''' = Global Normalized Signal-to-Distortion Ratio <br />
'''NSDR''' = Normalized Signal-to-Distortion Ratio <br />
'''SIR''' = Signal-to-Interference Ratio <br />
'''SAR''' = Signal-to-Artifacts Ratio <br />

== Summary ==

=== Summary Results ===

{| class="sortable" border="1" cellspacing="0" style="text-align: left;"
|- style="background: yellow;"
! Algorithm !! Voice GNSDR (dB) !! Music GNSDR (dB) !! Runtime (m)
|-
| GD1 || -2.2810 || 0.3954 || 26.4413
|-
| HC1 || 4.6309 || 7.8180 || 28.9727
|-
| LCP1 || 6.0726 || 10.9256 || 37.8235
|-
| LCP2 || 6.3414 || 11.1878 || 32.4800
|-
| MC2 || 5.2891 || 9.6678 || 34.8084
|-
| MC3 || 5.4920 || 9.8049 || 36.7194
|-
| RSGP1 || 3.2589 || 8.7664 || 32.3578
|}

== NSDR ==

=== For the Singing Voice (dB) ===

<csv>2016/svs/nsdr-voice.csv</csv>

=== For the Music Accompaniment (dB) ===

<csv>2016/svs/nsdr-music.csv</csv>

=== Boxplots ===

[[File:2016-svs-nsdr.png]]

== SIR ==

=== For the Singing Voice (dB) ===

<csv>2016/svs/sir-voice.csv</csv>

=== For the Music Accompaniment (dB) ===

<csv>2016/svs/sir-music.csv</csv>

=== Boxplots ===

[[File:2016-svs-sir.png]]

== SAR ==

=== For the Singing Voice (dB) ===

<csv>2016/svs/sar-voice.csv</csv>

=== For the Music Accompaniment (dB) ===

<csv>2016/svs/sar-music.csv</csv>

=== Boxplots ===

[[File:2016-svs-sar.png]]

== Runtime Data ==

<csv>2016/svs/runtime.csv</csv>

@@ Line 33: / Line 33: @@
          |-
 	! RSGP1
-	| Singing Voice Separation using Deep Neural Networks and F0 Estimation || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/RSGP1.pdf PDF] || Gerard Roma, Emad M. Grais, Andrew J. R. Simpson, Mark D. Plumbley
+	| Singing Voice Separation Using Deep Neural Networks and F0 Estimation || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/RSGP1.pdf PDF] || Gerard Roma, Emad M. Grais, Andrew J. R. Simpson, Mark D. Plumbley
 	|}

@@ Line 13: / Line 13: @@
 	! width="80" style="text-align: center;" | Abstract PDF
 	! width="440" | Contributors
 	|-
 	! GD1
-	| Harmonic Modeling of Singing Voice for Source Separation || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/GD1.pdf PDF] || Georgi Dzhambazov
+	| Harmonic Modeling of Singing Voice for Source Separation || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/GD1.pdf PDF] || Georgi Dzhambazov || Unknown
          |-
 	! HC1
-	| MIREX 2016 Submission for Singing Voice Separation || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/HC1.pdf PDF] || Yi-Chun Huang, Tai-Shih Chi
+	| MIREX 2016 Submission for Singing Voice Separation || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/HC1.pdf PDF] || Yi-Chun Huang, Tai-Shih Chi || iKala
          |-
 	! LCP1
-	| Deep Clustering for Singing Voice Separation || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/LCP1.pdf PDF] || Yi Luo, Zhuo Chen, John R. Hershey, Jonathan Le Roux, Daniel P. W. Ellis
+	| Deep Clustering for Singing Voice Separation || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/LCP1.pdf PDF] || Yi Luo, Zhuo Chen, John R. Hershey, Jonathan Le Roux, Daniel P. W. Ellis || SiSEC
          |-
 	! LCP2
-	| Deep Clustering for Singing Voice Separation || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/LCP2.pdf PDF] || Yi Luo, Zhuo Chen, John R. Hershey, Jonathan Le Roux, Daniel P. W. Ellis
+	| Deep Clustering for Singing Voice Separation || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/LCP2.pdf PDF] || Yi Luo, Zhuo Chen, John R. Hershey, Jonathan Le Roux, Daniel P. W. Ellis || SiSEC
          |-
 	! MC2
-	| MIREX 2016 Submission for Singing Voice Separation || style="text-align: center;" | - || Marius Miron, Pritish Chandna
+	| MIREX 2016 Submission for Singing Voice Separation || style="text-align: center;" | - || Marius Miron, Pritish Chandna || Unknown
          |-
 	! MC3
-	| MIREX 2016 Submission for Singing Voice Separation || style="text-align: center;" | - || Marius Miron, Pritish Chandna
+	| MIREX 2016 Submission for Singing Voice Separation || style="text-align: center;" | - || Marius Miron, Pritish Chandna || Unknown
          |-
 	! RSGP1
-	| Singing Voice Separation Using Deep Neural Networks and F0 Estimation || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/RSGP1.pdf PDF] || Gerard Roma, Emad M. Grais, Andrew J. R. Simpson, Mark D. Plumbley
+	| Singing Voice Separation Using Deep Neural Networks and F0 Estimation || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/RSGP1.pdf PDF] || Gerard Roma, Emad M. Grais, Andrew J. R. Simpson, Mark D. Plumbley || iKala
 	|}

@@ Line 3: / Line 3: @@
 === Description ===
-These are the results for the 2016 running of the Singing Voice Separation task set. For more information about this task set please refer to the [[2016:Singing Voice Separation]] page.
+These are the results for the 2016 running of the Singing Voice Separation task set. The evaluation set is kindly provided by [http://mac.citi.sinica.edu.tw/ikala/ iKala]. If you need to cite this page, please also cite T.-S. Chan, T.-C. Yeh, Z.-C. Fan, H.-W. Chen, L. Su, Y.-H. Yang, and R. Jang, "Vocal activity informed singing voice separation with the iKala dataset," in Proc. IEEE Int. Conf. Acoust., Speech and Signal Process., 2015, pp. 718-722. For more information about this task set please refer to the [[2016:Singing Voice Separation]] page.
 === Legend ===

@@ Line 15: / Line 15: @@
 	|-
 	! GD1
-	| HARMONIC MODELING OF SINGING VOICE FOR SOURCE SEPARATION || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/GD1.pdf PDF] || Georgi Dzhambazov
+	| Harmonic Modeling of Singing Voice for Source Separation || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/GD1.pdf PDF] || Georgi Dzhambazov
          |-
 	! HC1
@@ Line 21: / Line 21: @@
          |-
 	! LCP1
-	| DEEP CLUSTERING FOR SINGING VOICE SEPARATION || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/LCP1.pdf PDF] || Yi Luo, Zhuo Chen, John R. Hershey, Jonathan Le Roux, Daniel P. W. Ellis
+	| Deep Clustering for Singing Voice Separation || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/LCP1.pdf PDF] || Yi Luo, Zhuo Chen, John R. Hershey, Jonathan Le Roux, Daniel P. W. Ellis
          |-
 	! LCP2
-	| DEEP CLUSTERING FOR SINGING VOICE SEPARATION || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/LCP2.pdf PDF] || Yi Luo, Zhuo Chen, John R. Hershey, Jonathan Le Roux, Daniel P. W. Ellis
+	| Deep Clustering for Singing Voice Separation || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/LCP2.pdf PDF] || Yi Luo, Zhuo Chen, John R. Hershey, Jonathan Le Roux, Daniel P. W. Ellis
          |-
 	! MC2
@@ Line 33: / Line 33: @@
          |-
 	! RSGP1
-	| MIREX || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/RSGP1.pdf PDF] || Gerard Roma, Emad M. Grais, Andrew J. R. Simpson, Mark D. Plumbley
+	| Singing Voice Separation using Deep Neural Networks and F0 Estimation || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/RSGP1.pdf PDF] || Gerard Roma, Emad M. Grais, Andrew J. R. Simpson, Mark D. Plumbley
 	|}