2015:Singing Voice Separation Results - Revision history

Tak-Shing Chan: /* Description */

2016-08-03T08:42:14Z

‎Description

Tak-Shing Chan: /* Legend */

2015-10-17T06:00:54Z

‎Legend

Tak-Shing Chan at 04:14, 6 October 2015

2015-10-06T04:14:58Z

Tak-Shing Chan: Created page with "== Introduction == === Description === These are the results for the 2015 running of the Singing Voice Separation task set. For more information about this task set please refe..."

2015-10-05T15:55:55Z

Created page with "== Introduction == === Description === These are the results for the 2015 running of the Singing Voice Separation task set. For more information about this task set please refe..."

New page

== Introduction ==

=== Description ===

These are the results for the 2015 running of the Singing Voice Separation task set. For more information about this task set please refer to the [[2015:Singing Voice Separation]] page.

=== Legend ===

{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Submission code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract PDF
! width="440" | Contributors
|-
! FJ1
| Submission name || style="text-align: center;" | - || Contributors
|-
! FJ2
| Submission name || style="text-align: center;" | - || Contributors
|-
! IIY3
| Submission name || style="text-align: center;" | - || Contributors
|-
! IIY4
| Submission name || style="text-align: center;" | - || Contributors
|-
! MD3
| Submission name || style="text-align: center;" | - || Contributors
|-
! MD4
| Submission name || style="text-align: center;" | - || Contributors
|}

==== Evaluation Criteria ====

'''GNSDR''' = Global Normalized Signal-to-Distortion Ratio <br />
'''NSDR''' = Normalized Signal-to-Distortion Ratio <br />
'''SIR''' = Signal-to-Interference Ratio <br />
'''SAR''' = Signal-to-Artifacts Ratio <br />

== Summary ==

=== Summary Results ===

{| class="sortable" border="1" cellspacing="0" style="text-align: left;"
|- style="background: yellow;"
! Algorithm !! Voice GNSDR (dB) !! Music GNSDR (dB) !! Runtime (m)
|-
| FJ1 || || ||
|-
| FJ2 || || ||
|-
| IIY3 || || ||
|-
| IIY4 || || ||
|-
| MD3 || || ||
|-
| MD4 || || ||
|}

== NSDR ==

=== For the Singing Voice (dB) ===

<csv>2015/svs/nsdr-voice.csv</csv>

=== For the Music Accompaniment (dB) ===

<csv>2015/svs/nsdr-music.csv</csv>

=== Boxplots ===

[[File:2015-svs-nsdr.png]]

== SIR ==

=== For the Singing Voice (dB) ===

<csv>2015/svs/sir-voice.csv</csv>

=== For the Music Accompaniment (dB) ===

<csv>2015/svs/sir-music.csv</csv>

=== Boxplots ===

[[File:2015-svs-sir.png]]

== SAR ==

=== For the Singing Voice (dB) ===

<csv>2015/svs/sar-voice.csv</csv>

=== For the Music Accompaniment (dB) ===

<csv>2015/svs/sar-music.csv</csv>

=== Boxplots ===

[[File:2015-svs-sar.png]]

== Runtime Data ==

<csv>2015/svs/runtime.csv</csv>

@@ Line 3: / Line 3: @@
 === Description ===
-These are the results for the 2015 running of the Singing Voice Separation task set. For more information about this task set please refer to the [[2015:Singing Voice Separation]] page.
+These are the results for the 2015 running of the Singing Voice Separation task set. The evaluation set is kindly provided by [http://mac.citi.sinica.edu.tw/ikala/ iKala]. If you need to cite this page, please also cite T.-S. Chan, T.-C. Yeh, Z.-C. Fan, H.-W. Chen, L. Su, Y.-H. Yang, and R. Jang, "Vocal activity informed singing voice separation with the iKala dataset," in Proc. IEEE Int. Conf. Acoust., Speech and Signal Process., 2015, pp. 718-722. For more information about this task set please refer to the [[2015:Singing Voice Separation]] page.
 === Legend ===

@@ Line 21: / Line 21: @@
          |-
 	! IIY3
-	| MIREX 2015 Submission for Singing Voice Separation || style="text-align: center;" | - || Yukara Ikemiya, Katsutoshi Itoyama, Kazuyoshi Yoshii
+	| MIREX2015: Singing Voice Separation || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2015/IIY3.pdf PDF] || Yukara Ikemiya, Katsutoshi Itoyama, Kazuyoshi Yoshii
          |-
 	! IIY4
-	| MIREX 2015 Submission for Singing Voice Separation || style="text-align: center;" | - || Yukara Ikemiya, Katsutoshi Itoyama, Kazuyoshi Yoshii
+	| MIREX2015: Singing Voice Separation || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2015/IIY4.pdf PDF] || Yukara Ikemiya, Katsutoshi Itoyama, Kazuyoshi Yoshii
          |-
 	! MD3

@@ Line 15: / Line 15: @@
 	|-
 	! FJ1
-	| Submission name || style="text-align: center;" | - || Contributors
+	| MIREX 2015 Submission for Singing Voice Separation || style="text-align: center;" | - || Zhe-Cheng Fan, Jyh-Shing Roger Jang
          |-
 	! FJ2
-	| Submission name || style="text-align: center;" | - || Contributors
+	| MIREX 2015 Submission for Singing Voice Separation || style="text-align: center;" | - || Zhe-Cheng Fan, Jyh-Shing Roger Jang
          |-
 	! IIY3
-	| Submission name || style="text-align: center;" | - || Contributors
+	| MIREX 2015 Submission for Singing Voice Separation || style="text-align: center;" | - || Yukara Ikemiya, Katsutoshi Itoyama, Kazuyoshi Yoshii
          |-
 	! IIY4
-	| Submission name || style="text-align: center;" | - || Contributors
+	| MIREX 2015 Submission for Singing Voice Separation || style="text-align: center;" | - || Yukara Ikemiya, Katsutoshi Itoyama, Kazuyoshi Yoshii
          |-
 	! MD3
-	| Submission name || style="text-align: center;" | - || Contributors
+	| An Ensemble Method for Learning to Extract Vocals from Polyphonic Musical Audio || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2015/MD3.pdf PDF] || Matt McVicar, Tijl De Bie
          |-
 	! MD4
-	| Submission name || style="text-align: center;" | - || Contributors
+	| An Ensemble Method for Learning to Extract Vocals from Polyphonic Musical Audio || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2015/MD4.pdf PDF] || Matt McVicar, Tijl De Bie
 	|}
@@ Line 48: / Line 48: @@
 	! Algorithm !! Voice GNSDR (dB) !! Music GNSDR (dB) !! Runtime (m)
 	|-
-	| FJ1 ||  ||  ||
+	| FJ1 || 6.8236 || 10.135 || 3.4014
 	|-
-	| FJ2 ||  ||  ||
+	| FJ2 || 6.3487 || 9.8678 || 2.9135
 	|-
-	| IIY3 ||  ||  ||
+	| IIY3 || 4.9862 || 8.2138 || 99.1737
 	|-
-	| IIY4 ||  ||  ||
+	| IIY4 || 5.3953 || 8.77 || 46.6621
 	|-
-	| MD3 ||  ||  ||
+	| MD3 || 2.9831 || 6.3671 || 121.6655
 	|-
-	| MD4 ||  ||  ||
+	| MD4 || 3.1022 || 7.4657 || 121.1348
 	|}