2015:Audio Cover Song Identification Results - Revision history

Peter Organisciak: /* General Legend */

2015-10-21T04:06:14Z

‎General Legend

Peter Organisciak: /* General Legend */

2015-10-21T04:02:39Z

‎General Legend

Peter Organisciak: /* General Legend */

2015-10-21T04:02:16Z

‎General Legend

Peter Organisciak at 04:01, 21 October 2015

2015-10-21T04:01:15Z

Peter Organisciak: Created page with "== Introduction == Audio Cover Song (ACS) Identification was evaluated against two datasets: ''Mixed Collection'' and ''Sapp's Mazurka Collection''. ===Mixed Collection Informa..."

2015-10-21T01:49:50Z

Created page with "== Introduction == Audio Cover Song (ACS) Identification was evaluated against two datasets: ''Mixed Collection'' and ''Sapp's Mazurka Collection''. ===Mixed Collection Informa..."

New page

== Introduction ==

Audio Cover Song (ACS) Identification was evaluated against two datasets: ''Mixed Collection'' and ''Sapp's Mazurka Collection''.

===Mixed Collection Information===
This is the "original" ACS collection. Within the 1000 pieces in the Audio Cover Song database, there are embedded 30 different "cover songs" each represented by 11 different "versions" for a total of 330 audio files (16bit, monophonic, 22.05khz, wav). The "cover songs" represent a variety of genres (e.g., classical, jazz, gospel, rock, folk-rock, etc.) and the variations span a variety of styles and orchestrations.

Using each of these cover song files in turn as the "seed/query" file, we will examine the returned lists of items for the presence of the other 10 versions of the "seed/query" file.

===Sapp's Mazurka Collection Information ===
In addition to our original ACS dataset, we used the [http://www.mazurka.org.uk/ Mazurka.org dataset] put together by Craig Sapp. We randomly chose 11 versions from 49 mazurkas and ran it as a separate ACS subtask. Systems returned a distance matrix of 539x539 from which we located the ranks of each of the associated cover versions.

== General Legend ==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! YCW1
| MCY_COVER || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2015/YCW1.pdf PDF] || [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://slam.iis.sinica.edu.tw/ Chuan-Yau Chan], [http://www.iis.sinica.edu.tw Hsin-Min Wang]
|-
! CYWW1
| CYC_COVER || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2015/CYWW1.pdf PDF] || [http://slam.iis.sinica.edu.tw/ Chuan-Yau Chan], [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://sovideo.iis.sinica.edu.tw/SLG/index.html Ju-Chiang Wang], [http://www.iis.sinica.edu.tw Hsin-Min Wang]

|}

== Results ==

===Mixed Collection===

====Summary Results====
<csv p=2>2015/acs/coversong1000.summary.csv</csv>

====Number of Correct Covers at Rank X Returned in Top Ten====
<csv>2015/acs/coversong1000.toptendist.csv</csv>

====Average Performance per Query Group====
<csv p=2>2015/acs/coversong1000.precision.groups.csv</csv>

===Sapp's Mazuraka Collection===

====Summary results====
<csv p=2>2015/acs/mazurkas.summary.csv</csv>

====Number of Correct Covers at Rank X Returned in Top Ten====
<csv>2015/acs/mazurkas.toptendist.csv</csv>

====Average Performance per Query Group====
<csv p=2>2015/acs/mazurkas.precision.groups.csv</csv>

==Individual Results Files==

===Mixed Collection===
'''Average Precision by Query'''

'''CT1''' : [https://music-ir.org/mirex/results/2015/acs/CT1.coversong1000.avgprec.txt Ming-Chi Yen, Chuan-Yau Chan, Hsin-Min Wang] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2015/acs/CYWW1.coversong1000.avgprec.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''Rank Lists'''

'''CT1''' : [https://music-ir.org/mirex/results/2015/acs/CT1.coversong1000.ranklist.txt Ming-Chi Yen, Chuan-Yau Chan, Hsin-Min Wang] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2015/acs/CYWW1.coversong1000.ranklist.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

===Sapp's Mazurka Collection===

'''Average Precision by Query'''

'''CT1''' : [https://music-ir.org/mirex/results/2015/acs/CT1.mazurkas.avgprec.txt Ming-Chi Yen, Chuan-Yau Chan, Hsin-Min Wang] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2015/acs/CYWW1.mazurkas.avgprec.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''Rank Lists'''

'''CT1''' : [https://music-ir.org/mirex/results/2015/acs/CT1.mazurkas.ranklist.txt Ming-Chi Yen, Chuan-Yau Chan, Hsin-Min Wang] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2015/acs/CYWW1.mazurkas.ranklist.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 
[[Category: Results]]

@@ Line 21: / Line 21: @@
      |-
      ! CT1
-     | 	MFCCShapeSSM ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2015/CT1.pdf PDF] || Christopher Tralie
+     | 	MFCCShapeSSM ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2015/CT1.pdf PDF] || [http://www.ctralie.com/ Christopher Tralie]
      |-
      ! YWW1

@@ Line 24: / Line 24: @@
      |-
      ! YWW1
-     | 	YWW ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2015/YWW1.pdf PDF] | [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://sovideo.iis.sinica.edu.tw/SLG/index.html Ju-Chiang Wang], [http://www.iis.sinica.edu.tw 	Hsin-Min Wang]
+     | 	YWW ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2015/YWW1.pdf PDF] || [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://sovideo.iis.sinica.edu.tw/SLG/index.html Ju-Chiang Wang], [http://www.iis.sinica.edu.tw 	Hsin-Min Wang]
      |-
      ! CYWW1

@@ Line 24: / Line 24: @@
      |-
      ! YWW1
-     | 	YWW ||  style="text-align: center;" | [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://sovideo.iis.sinica.edu.tw/SLG/index.html Ju-Chiang Wang], [http://www.iis.sinica.edu.tw 	Hsin-Min Wang]
+     | 	YWW ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2015/YWW1.pdf PDF] | [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://sovideo.iis.sinica.edu.tw/SLG/index.html Ju-Chiang Wang], [http://www.iis.sinica.edu.tw 	Hsin-Min Wang]
      |-
      ! CYWW1

@@ Line 20: / Line 20: @@
      ! width="440" | Contributors
      |-
-     ! YCW1
+     ! CT1
-     | 	MCY_COVER ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2015/YCW1.pdf PDF] || [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://slam.iis.sinica.edu.tw/  Chuan-Yau Chan], [http://www.iis.sinica.edu.tw 	Hsin-Min Wang]
+     | 	MFCCShapeSSM ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2015/CT1.pdf PDF] || Christopher Tralie
      |-
      ! CYWW1
-     | 	CYC_COVER ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2015/CYWW1.pdf PDF] || [http://slam.iis.sinica.edu.tw/  Chuan-Yau Chan], [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://sovideo.iis.sinica.edu.tw/SLG/index.html Ju-Chiang Wang], [http://www.iis.sinica.edu.tw 	Hsin-Min Wang]
+     | 	CYWW ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2015/CYWW1.pdf PDF] || [http://slam.iis.sinica.edu.tw/  Chuan-Yau Chan], [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://sovideo.iis.sinica.edu.tw/SLG/index.html Ju-Chiang Wang], [http://www.iis.sinica.edu.tw 	Hsin-Min Wang]