Difference between revisions of "2018:Music and or Speech Detection Results"

From MIREX Wiki
Line 43: Line 43:
  
 
[https://www.music-ir.org/mirex/wiki/2018:Music_and/or_Speech_Detection#Evaluation_Dataset Dataset 1]
 
[https://www.music-ir.org/mirex/wiki/2018:Music_and/or_Speech_Detection#Evaluation_Dataset Dataset 1]
 +
 +
===Segment-level Evaluation===
  
 
{| border="1" cellspacing="0" style="text-align: left; width: 240px;"
 
{| border="1" cellspacing="0" style="text-align: left; width: 240px;"
Line 48: Line 50:
 
! width="80" | Sub code  
 
! width="80" | Sub code  
 
! width="80" style="text-align: center;" | Accuracy  
 
! width="80" style="text-align: center;" | Accuracy  
−
! width="80" | Music F-measure
+
! width="80" | Music F
−
! width="80" | No Music F-measure
+
! width="80" | No Music F
 
|-
 
|-
 
! DD1
 
! DD1
Line 75: Line 77:
 
| 0.9049 || 0.8996 || 0.9097
 
| 0.9049 || 0.8996 || 0.9097
 
         |}
 
         |}
 +
 +
===Event-level Evaluation===
 +
 +
  
 
==Task 1: Speech Detection==
 
==Task 1: Speech Detection==

Revision as of 09:19, 17 September 2018

Introduction

These are the results for the 2018 running of the Music and/or Speech Detection tasks. For background information about this task set please refer to the 2018:Music and/or Speech Detection page.

General Legend

Sub code Abstract Contributors
DD1 PDF David Doukhan
JHKK1 PDF Byeong-Yong Jang, Woon-Haeng Heo, Jung-Hyun Kim, Oh-Wook Kwon
JHKK2 PDF Byeong-Yong Jang, Woon-Haeng Heo, Jung-Hyun Kim, Oh-Wook Kwon
JHKK3 PDF Byeong-Yong Jang, Woon-Haeng Heo, Jung-Hyun Kim, Oh-Wook Kwon
MM1 PDF Matija Marolt
MM2 PDF Matija Marolt
MM3 PDF Matija Marolt
LN1 PDF Minsuk Choi, Jongpil Lee, Juhan Nam
MMG1 PDF Blai Meléndez-Catalán, Emilio Molina, Emilia Gómez
MMG2 PDF Blai Meléndez-Catalán, Emilio Molina, Emilia Gómez

Task 1: Music Detection

Dataset 1

Segment-level Evaluation

Sub code Accuracy Music F No Music F
DD1 0.6860 0.5424 0.7611
JHKK1 0.7798 0.7123 0.8215
JHKK2 0.8005 0.7415 0.8375
MM1 0.6135 0.3899 0.7172
MM2 0.6807 0.5478 0.7531
MM3 0.6075 0.3124 0.7254
LN1 0.6251 0.5022 0.6987
MMG1 0.9049 0.8996 0.9097

Event-level Evaluation

Task 1: Speech Detection

Dataset 1

Sub code Accuracy Speech F-measure No Speech F-measure
DD1 0.877 0.9186 0.7493
JHKK3 0.8307 0.8795 0.7143
MM1 0.8626 0.9115 0.6948
MM2 0.8619 0.909 0.713
MM3 0.8508 0.9086 0.5966
LN1 0.6908 0.7472 0.6007
Retrieved from "https://music-ir.org/mirex/w/index.php?title=2018:Music_and_or_Speech_Detection_Results&oldid=12695"