Difference between revisions of "2015:Set List Identification Results"

From MIREX Wiki
(Created page with "== Introduction == Set List Identification was evaluated against on two data sets: ''Developing set'' and ''Testing set'' ===Developing set Information=== This set contain 3 ar...")
 
(→‎General Legend)
 
(2 intermediate revisions by the same user not shown)
Line 30: Line 30:
 
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
 
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
 
     |- style="background: yellow;"
 
     |- style="background: yellow;"
−
     ! width="80" | Sub code
+
     ! width="80" | Sub Code
−
    ! width="200" | Submission name
 
 
     ! width="80" style="text-align: center;" | Abstract  
 
     ! width="80" style="text-align: center;" | Abstract  
 
     ! width="440" | Contributors
 
     ! width="440" | Contributors
 
     |-
 
     |-
 
     ! YWYW1
 
     ! YWYW1
−
     | YWYW ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2015/YWYW1.pdf PDF] || [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://sovideo.iis.sinica.edu.tw/SLG/index.html Ju-Chiang Wang], [http://mpac.ee.ntu.edu.tw/~yihsuan/ Yi-Hsuan Yang], [http://www.iis.sinica.edu.tw Hsin-Min Wang]
+
     | style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2015/YWYW1.pdf PDF] || [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://sovideo.iis.sinica.edu.tw/SLG/index.html Ju-Chiang Wang], [http://mpac.ee.ntu.edu.tw/~yihsuan/ Yi-Hsuan Yang], [http://www.iis.sinica.edu.tw Hsin-Min Wang]
 
     |-
 
     |-
 
     ! YWYW2
 
     ! YWYW2
−
     | YWYW ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2015/YWYW2.pdf PDF] || [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://sovideo.iis.sinica.edu.tw/SLG/index.html Ju-Chiang Wang], [http://mpac.ee.ntu.edu.tw/~yihsuan/ Yi-Hsuan Yang], [http://www.iis.sinica.edu.tw Hsin-Min Wang]
+
     | style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2015/YWYW2.pdf PDF] || [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://sovideo.iis.sinica.edu.tw/SLG/index.html Ju-Chiang Wang], [http://mpac.ee.ntu.edu.tw/~yihsuan/ Yi-Hsuan Yang], [http://www.iis.sinica.edu.tw Hsin-Min Wang]
 
     |-
 
     |-
 
     ! YWYW3
 
     ! YWYW3
−
     | YWYW ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2015/YWYW3.pdf PDF] || [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://sovideo.iis.sinica.edu.tw/SLG/index.html Ju-Chiang Wang], [http://mpac.ee.ntu.edu.tw/~yihsuan/ Yi-Hsuan Yang], [http://www.iis.sinica.edu.tw Hsin-Min Wang]
+
     | style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2015/YWYW3.pdf PDF] || [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://sovideo.iis.sinica.edu.tw/SLG/index.html Ju-Chiang Wang], [http://mpac.ee.ntu.edu.tw/~yihsuan/ Yi-Hsuan Yang], [http://www.iis.sinica.edu.tw Hsin-Min Wang]
  
 
|}
 
|}
Line 49: Line 48:
  
 
===Developing Set ===
 
===Developing Set ===
 +
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
 +
    |- style="background: yellow;"
 +
    ! width="80" |
 +
    ! colspan=3 align="center" | YWYW1
 +
    ! colspan=3 align="center" | YWYW2
 +
    ! colspan=3 align="center" | YWYW3
 +
    |-
 +
    ! width="80" align="center" | Concert ID 
 +
    ! width="80" align="center" | ED
 +
    ! width="80" align="center" | sBD
 +
    ! width="80" align="center" | eBD
 +
    ! width="80" align="center" | ED
 +
    ! width="80" align="center" | sBD
 +
    ! width="80" align="center" | eBD
 +
    ! width="80" align="center" | ED
 +
    ! width="80" align="center" | sBD
 +
    ! width="80" align="center" | eBD
 +
    |-align="right"
 +
    ! 001 !! 15 !!179.252 !! 176.876 !! 19 !! 179.252 !! 176.876 !! 20 !! 1718.929 !! 1636.810
 +
    |-align="right"
 +
    ! 002 !! 12 !! 11.025 !! 21.615 !! 8 !! 11.025 !! 21.615 !! 8 !! 12.157 !! 15.076
 +
    |-align="right"
 +
    ! 024 !! 4 !! 19.124 !! 22.848 !! 5 !! 19.124 !! 22.848 !! 3 !! 108.565 !! 52.557
 +
    |-align="right"
 +
    ! 036 !! 18 !! 40.547 !! 49.772 !! 13 !! 40.547 !! 49.772 !! 12 !! 67.756 !! 59.672
 +
    |-align="right"
 +
    ! 043 !! 13 !! 341.386 !! 427.867 !! 12 !! 341.386 !! 427.867 !! 17 !! 284.778 !! 346.389
 +
    |-align="right"
 +
    ! 069 !! 16 !! 129.983 !! 162.558 !! 12 !! 129.983 !! 162.558 !! 12 !! 83.048 !! 42.002
 +
    |-align="right"
 +
    ! 073 !! 13 !! 239.447 !! 309.902 !! 12 !! 239.447 !! 309.902 !! 16 !! 63.693 !! 95.713
 +
    |-align="right"
 +
    ! Avg !! 13 !! 137.252 !! 167.349 !! 11.57 !! 137.252 !! 167.349 !! 12.57 !! 334.132 !! 321.174
 +
|}
  
 +
=== Testing Set ===
  
−
=== Testing Set ===
+
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
 +
    |- style="background: yellow;"
 +
    ! width="80" |
 +
    ! colspan=3 align="center" | YWYW1
 +
    ! colspan=3 align="center" | YWYW2
 +
    ! colspan=3 align="center" | YWYW3
 +
    |-
 +
    ! width="80" align="center" | Concert ID 
 +
    ! width="80" align="center" | ED
 +
    ! width="80" align="center" | sBD
 +
    ! width="80" align="center" | eBD
 +
    ! width="80" align="center" | ED
 +
    ! width="80" align="center" | sBD
 +
    ! width="80" align="center" | eBD
 +
    ! width="80" align="center" | ED
 +
    ! width="80" align="center" | sBD
 +
    ! width="80" align="center" | eBD
 +
    |-align="right"
 +
    ! 004 !! 6 !! 85.644 !! 33.271 !! 7 !! 85.644 !! 33.271 !! 8 !! 490.658 !! 445.986
 +
    |-align="right"
 +
    ! 005 !! 20 !! 304.753 !! 413.590 !! 18 !! 304.753 !! 413.590 !! 16 !! 144.300 !! 185.604
 +
    |-align="right"
 +
    ! 009 !! 13 !! 21.407 !! 66.230 !! 8 !! 21.407 !! 66.230 !! 11 !! 38.930 !! 51.577
 +
    |-align="right"
 +
    ! 031 !! 10 !! 51.801 !! 71.234 !! 6 !! 51.801 !! 71.234 !! 8 !! 117.670 !! 63.418
 +
    |-align="right"
 +
    ! 046 !! 5 !! 11.912 !! 24.883 !! 10 !! 11.912 !! 24.883 !! 13 !! 840.530 !! 818.607
 +
    |-align="right"
 +
    ! 047 !! 9 !! 59.835 !! 36.959 !! 11 !! 59.835 !! 36.959 !! 18 !! 195.221 !! 131.040
 +
    |-align="right"
 +
    ! 048 !! 14 !! 117.165 !! 125.612 !! 14 !! 117.165 !! 125.612 !! 14 !! 132.044 !! 157.874
 +
    |-align="right"
 +
    ! 065 !! 7 !! 178.820 !! 255.402 !! 7 !! 178.820 !! 255.402 !! 6 !! 155.572 !! 227.516
 +
    |-align="right"
 +
    ! 066 !! 9 !! 23.994 !! 23.699 !! 7 !! 23.994 !! 23.699 !! 8 !! 1371.639 !! 1372.828
 +
    |-align="right"
 +
    ! 067 !! 11 !! 241.434 !! 301.096 !! 9 !! 241.434 !! 301.096 !! 9 !! 107.313 !! 93.293
 +
    |-align="right"
 +
    ! 070 !! 12 !! 69.243 !! 96.336 !! 12 !! 69.243 !! 96.336 !! 11 !! 80.615 !! 98.123
 +
    |-align="right"
 +
    ! 076 !! 7 !! 206.096 !! 315.669 !! 5 !! 206.096 !! 315.669 !! 7 !! 128.045 !! 78.691
 +
    |-align="right"
 +
    ! 077 !! 13 !! 290.077 !! 278.479 !! 12 !! 290.077 !! 278.479 !! 13 !! 315.441 !! 290.992
 +
    |-align="right"
 +
    ! Avg !! 10.46 !! 127.860 !! 157.112 !! 9.69 !! 127.860 !! 157.112 !! 10.92 !! 316.768 !! 308.888
 +
 
 +
|}
  
−
===Mixed Set===
+
===Summary===
 +
{| border="1" cellspacing="0" style="text-align: left; width: 320px;"
 +
    |- style="background: yellow;"
 +
! width="80" | Sub Code
 +
! width="80" | Avg ED
 +
! width="80" | Avg sBD
 +
! width="80" | Avg eBD
 +
|-align="right"
 +
! YWYW1 !! 11.35 !! 131.147 !! 160.695
 +
|-align="right"
 +
! YWYW2 !! 10.35 !! 131.147 !! 160.695
 +
|-align="right"
 +
! YWYW3 !! 11.50 !! 322.845 !! 313.188
  
  
 
[[Category: Results]]
 
[[Category: Results]]

Latest revision as of 01:35, 21 October 2015

Introduction

Set List Identification was evaluated against on two data sets: Developing set and Testing set

Developing set Information

This set contain 3 artists and 7 live concerts, the following information would be release (Dropbox)

  • artist
  • live concert name and links
  • studio collection list
  • start/end time tags

We extract features for the convenience of participants, the links is the tool we used. (Dropbox)

Collection statistics:

  • 3 artists
  • 7 live concerts
  • 279 tracks

Testing set Information

This set contain 7 artists and 13 live concerts, no information would be release.

Collection statistics:

  • 7 artists
  • 13 live concerts
  • 873 tracks


General Legend

Sub Code Abstract Contributors
YWYW1 PDF Ming-Chi Yen, Ju-Chiang Wang, Yi-Hsuan Yang, Hsin-Min Wang
YWYW2 PDF Ming-Chi Yen, Ju-Chiang Wang, Yi-Hsuan Yang, Hsin-Min Wang
YWYW3 PDF Ming-Chi Yen, Ju-Chiang Wang, Yi-Hsuan Yang, Hsin-Min Wang

Results

Developing Set

YWYW1 YWYW2 YWYW3
Concert ID ED sBD eBD ED sBD eBD ED sBD eBD
001 15 179.252 176.876 19 179.252 176.876 20 1718.929 1636.810
002 12 11.025 21.615 8 11.025 21.615 8 12.157 15.076
024 4 19.124 22.848 5 19.124 22.848 3 108.565 52.557
036 18 40.547 49.772 13 40.547 49.772 12 67.756 59.672
043 13 341.386 427.867 12 341.386 427.867 17 284.778 346.389
069 16 129.983 162.558 12 129.983 162.558 12 83.048 42.002
073 13 239.447 309.902 12 239.447 309.902 16 63.693 95.713
Avg 13 137.252 167.349 11.57 137.252 167.349 12.57 334.132 321.174

Testing Set

YWYW1 YWYW2 YWYW3
Concert ID ED sBD eBD ED sBD eBD ED sBD eBD
004 6 85.644 33.271 7 85.644 33.271 8 490.658 445.986
005 20 304.753 413.590 18 304.753 413.590 16 144.300 185.604
009 13 21.407 66.230 8 21.407 66.230 11 38.930 51.577
031 10 51.801 71.234 6 51.801 71.234 8 117.670 63.418
046 5 11.912 24.883 10 11.912 24.883 13 840.530 818.607
047 9 59.835 36.959 11 59.835 36.959 18 195.221 131.040
048 14 117.165 125.612 14 117.165 125.612 14 132.044 157.874
065 7 178.820 255.402 7 178.820 255.402 6 155.572 227.516
066 9 23.994 23.699 7 23.994 23.699 8 1371.639 1372.828
067 11 241.434 301.096 9 241.434 301.096 9 107.313 93.293
070 12 69.243 96.336 12 69.243 96.336 11 80.615 98.123
076 7 206.096 315.669 5 206.096 315.669 7 128.045 78.691
077 13 290.077 278.479 12 290.077 278.479 13 315.441 290.992
Avg 10.46 127.860 157.112 9.69 127.860 157.112 10.92 316.768 308.888

Summary

Sub Code Avg ED Avg sBD Avg eBD
YWYW1 11.35 131.147 160.695
YWYW2 10.35 131.147 160.695
YWYW3 11.50 322.845 313.188
Retrieved from "https://music-ir.org/mirex/w/index.php?title=2015:Set_List_Identification_Results&oldid=11529"