MIREX Wiki - User contributions [en]

2017:Audio Cover Song Identification Results

2017-10-23T09:28:12Z

ChrisTralie: /* General Legend */

2017:Audio Cover Song Identification Results

2017-10-23T08:53:43Z

ChrisTralie: /* Individual Results Files */

2017:Audio Cover Song Identification Results

2017-10-23T08:43:53Z

ChrisTralie: /* General Legend */

== Introduction ==

Audio Cover Song (ACS) Identification was evaluated against two datasets: ''Mixed Collection'' and ''Sapp's Mazurka Collection''.

===Mixed Collection Information===
This is the "original" ACS collection. Within the 1000 pieces in the Audio Cover Song database, there are embedded 30 different "cover songs" each represented by 11 different "versions" for a total of 330 audio files (16bit, monophonic, 22.05khz, wav). The "cover songs" represent a variety of genres (e.g., classical, jazz, gospel, rock, folk-rock, etc.) and the variations span a variety of styles and orchestrations.

Using each of these cover song files in turn as the "seed/query" file, we will examine the returned lists of items for the presence of the other 10 versions of the "seed/query" file.

===Sapp's Mazurka Collection Information ===
In addition to our original ACS dataset, we used the [http://www.mazurka.org.uk/ Mazurka.org dataset] put together by Craig Sapp. We randomly chose 11 versions from 49 mazurkas and ran it as a separate ACS subtask. Systems returned a distance matrix of 539x539 from which we located the ranks of each of the associated cover versions.

== General Legend ==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! CL1
| CL1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2017/CL1.pdf PDF] || [http://www.nchenecust.com Ning Chen], Mingyu Li
|-
! CT2
| SYBK1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2017/CT2.pdf PDF] || [http://www.ctralie.com Chris Tralie]
|-
! HKL1
| HKL1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2017/HKL1.pdf PDF] || Hoon Heo, Hyunwoo J. Kim, Wan Soo Kim, Kyogu Lee

|}

== Results ==

===Mixed Collection===

====Summary Results====
<csv p=2>2017/acs/csv/coversong1000.summary.csv</csv>

====Number of Correct Covers at Rank X Returned in Top Ten====
<csv>2017/acs/csv/coversong1000.toptendist.csv</csv>

====Average Performance per Query Group====
<csv p=2>2017/acs/csv/coversong1000.precision.groups.csv</csv>

===Sapp's Mazuraka Collection===

====Summary results====
<csv p=2>2017/acs/csv/mazurkas.summary.csv</csv>

====Number of Correct Covers at Rank X Returned in Top Ten====
<csv>2017/acs/csv/mazurkas.toptendist.csv</csv>

====Average Performance per Query Group====
<csv p=2>2017/acs/csv/mazurkas.precision.groups.csv</csv>

==Individual Results Files==

===Mixed Collection===
'''Average Precision by Query'''

'''CL1''' : [https://music-ir.org/mirex/results/2016/acs/CL1.coversong1000.avgprec.txt Ning Chen, Hai-Dong Xiao] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2016/acs/CYWW1.coversong1000.avgprec.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''SYBK1''' : [https://music-ir.org/mirex/results/2016/acs/SYBK1.coversong1000.avgprec.txt Diego Silva, Chin-Chia Michael Yeh, Gustavo Enrique de Almeida Prado Alves Batista, Eamonn Keogh] 

'''YWJ2''' : [https://music-ir.org/mirex/results/2016/acs/YWJ2.coversong1000.avgprec.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''YWJ3''' : [https://music-ir.org/mirex/results/2016/acs/YWJ3.coversong1000.avgprec.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''Rank Lists'''

'''CL1''' : [https://music-ir.org/mirex/results/2016/acs/CL1.coversong1000.ranklist.txt Ning Chen, Hai-Dong Xiao] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2016/acs/CYWW1.coversong1000.ranklist.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''SYBK1''' : [https://music-ir.org/mirex/results/2016/acs/SYBK1.coversong1000.ranklist.txt Diego Silva, Chin-Chia Michael Yeh, Gustavo Enrique de Almeida Prado Alves Batista, Eamonn Keogh] 

'''YWJ2''' : [https://music-ir.org/mirex/results/2016/acs/YWJ2.coversong1000.ranklist.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''YWJ3''' : [https://music-ir.org/mirex/results/2016/acs/YWJ3.coversong1000.ranklist.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

===Mazurkas===
'''Average Precision by Query'''

'''CL1''' : [https://music-ir.org/mirex/results/2016/acs/CL1.mazurkas.avgprec.txt Ning Chen, Hai-Dong Xiao] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2016/acs/CYWW1.mazurkas.avgprec.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''SYBK1''' : [https://music-ir.org/mirex/results/2016/acs/SYBK1.mazurkas.avgprec.txt Diego Silva, Chin-Chia Michael Yeh, Gustavo Enrique de Almeida Prado Alves Batista, Eamonn Keogh] 

'''YWJ2''' : [https://music-ir.org/mirex/results/2016/acs/YWJ2.mazurkas.avgprec.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''YWJ3''' : [https://music-ir.org/mirex/results/2016/acs/YWJ3.mazurkas.avgprec.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''Rank Lists'''

'''CL1''' : [https://music-ir.org/mirex/results/2016/acs/CL1.mazurkas.ranklist.txt Ning Chen, Hai-Dong Xiao] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2016/acs/CYWW1.mazurkas.ranklist.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''SYBK1''' : [https://music-ir.org/mirex/results/2016/acs/SYBK1.mazurkas.ranklist.txt Diego Silva, Chin-Chia Michael Yeh, Gustavo Enrique de Almeida Prado Alves Batista, Eamonn Keogh] 

'''YWJ2''' : [https://music-ir.org/mirex/results/2016/acs/YWJ2.mazurkas.ranklist.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''YWJ3''' : [https://music-ir.org/mirex/results/2016/acs/YWJ3.mazurkas.ranklist.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang]

2017:Audio Cover Song Identification Results

2017-10-23T08:42:14Z

ChrisTralie: /* General Legend */

== Introduction ==

Audio Cover Song (ACS) Identification was evaluated against two datasets: ''Mixed Collection'' and ''Sapp's Mazurka Collection''.

===Mixed Collection Information===
This is the "original" ACS collection. Within the 1000 pieces in the Audio Cover Song database, there are embedded 30 different "cover songs" each represented by 11 different "versions" for a total of 330 audio files (16bit, monophonic, 22.05khz, wav). The "cover songs" represent a variety of genres (e.g., classical, jazz, gospel, rock, folk-rock, etc.) and the variations span a variety of styles and orchestrations.

Using each of these cover song files in turn as the "seed/query" file, we will examine the returned lists of items for the presence of the other 10 versions of the "seed/query" file.

===Sapp's Mazurka Collection Information ===
In addition to our original ACS dataset, we used the [http://www.mazurka.org.uk/ Mazurka.org dataset] put together by Craig Sapp. We randomly chose 11 versions from 49 mazurkas and ran it as a separate ACS subtask. Systems returned a distance matrix of 539x539 from which we located the ranks of each of the associated cover versions.

== General Legend ==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! CL1
| CL1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2017/CL1.pdf PDF] || Ning Chen, Mingyu Li
|-
! CT2
| SYBK1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2017/CT2.pdf PDF] || [http://www.ctralie.com Chris Tralie]
|-
! HKL1
| HKL1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2017/HKL1.pdf PDF] || Hoon Heo, Hyunwoo J. Kim, Wan Soo Kim, Kyogu Lee

|}

== Results ==

===Mixed Collection===

====Summary Results====
<csv p=2>2017/acs/csv/coversong1000.summary.csv</csv>

====Number of Correct Covers at Rank X Returned in Top Ten====
<csv>2017/acs/csv/coversong1000.toptendist.csv</csv>

====Average Performance per Query Group====
<csv p=2>2017/acs/csv/coversong1000.precision.groups.csv</csv>

===Sapp's Mazuraka Collection===

====Summary results====
<csv p=2>2017/acs/csv/mazurkas.summary.csv</csv>

====Number of Correct Covers at Rank X Returned in Top Ten====
<csv>2017/acs/csv/mazurkas.toptendist.csv</csv>

====Average Performance per Query Group====
<csv p=2>2017/acs/csv/mazurkas.precision.groups.csv</csv>

==Individual Results Files==

===Mixed Collection===
'''Average Precision by Query'''

'''CL1''' : [https://music-ir.org/mirex/results/2016/acs/CL1.coversong1000.avgprec.txt Ning Chen, Hai-Dong Xiao] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2016/acs/CYWW1.coversong1000.avgprec.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''SYBK1''' : [https://music-ir.org/mirex/results/2016/acs/SYBK1.coversong1000.avgprec.txt Diego Silva, Chin-Chia Michael Yeh, Gustavo Enrique de Almeida Prado Alves Batista, Eamonn Keogh] 

'''YWJ2''' : [https://music-ir.org/mirex/results/2016/acs/YWJ2.coversong1000.avgprec.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''YWJ3''' : [https://music-ir.org/mirex/results/2016/acs/YWJ3.coversong1000.avgprec.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''Rank Lists'''

'''CL1''' : [https://music-ir.org/mirex/results/2016/acs/CL1.coversong1000.ranklist.txt Ning Chen, Hai-Dong Xiao] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2016/acs/CYWW1.coversong1000.ranklist.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''SYBK1''' : [https://music-ir.org/mirex/results/2016/acs/SYBK1.coversong1000.ranklist.txt Diego Silva, Chin-Chia Michael Yeh, Gustavo Enrique de Almeida Prado Alves Batista, Eamonn Keogh] 

'''YWJ2''' : [https://music-ir.org/mirex/results/2016/acs/YWJ2.coversong1000.ranklist.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''YWJ3''' : [https://music-ir.org/mirex/results/2016/acs/YWJ3.coversong1000.ranklist.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

===Mazurkas===
'''Average Precision by Query'''

'''CL1''' : [https://music-ir.org/mirex/results/2016/acs/CL1.mazurkas.avgprec.txt Ning Chen, Hai-Dong Xiao] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2016/acs/CYWW1.mazurkas.avgprec.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''SYBK1''' : [https://music-ir.org/mirex/results/2016/acs/SYBK1.mazurkas.avgprec.txt Diego Silva, Chin-Chia Michael Yeh, Gustavo Enrique de Almeida Prado Alves Batista, Eamonn Keogh] 

'''YWJ2''' : [https://music-ir.org/mirex/results/2016/acs/YWJ2.mazurkas.avgprec.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''YWJ3''' : [https://music-ir.org/mirex/results/2016/acs/YWJ3.mazurkas.avgprec.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''Rank Lists'''

'''CL1''' : [https://music-ir.org/mirex/results/2016/acs/CL1.mazurkas.ranklist.txt Ning Chen, Hai-Dong Xiao] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2016/acs/CYWW1.mazurkas.ranklist.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''SYBK1''' : [https://music-ir.org/mirex/results/2016/acs/SYBK1.mazurkas.ranklist.txt Diego Silva, Chin-Chia Michael Yeh, Gustavo Enrique de Almeida Prado Alves Batista, Eamonn Keogh] 

'''YWJ2''' : [https://music-ir.org/mirex/results/2016/acs/YWJ2.mazurkas.ranklist.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''YWJ3''' : [https://music-ir.org/mirex/results/2016/acs/YWJ3.mazurkas.ranklist.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang]

2017:Audio Cover Song Identification Results

2017-10-23T08:37:31Z

ChrisTralie: /* General Legend */

== Introduction ==

Audio Cover Song (ACS) Identification was evaluated against two datasets: ''Mixed Collection'' and ''Sapp's Mazurka Collection''.

===Mixed Collection Information===
This is the "original" ACS collection. Within the 1000 pieces in the Audio Cover Song database, there are embedded 30 different "cover songs" each represented by 11 different "versions" for a total of 330 audio files (16bit, monophonic, 22.05khz, wav). The "cover songs" represent a variety of genres (e.g., classical, jazz, gospel, rock, folk-rock, etc.) and the variations span a variety of styles and orchestrations.

Using each of these cover song files in turn as the "seed/query" file, we will examine the returned lists of items for the presence of the other 10 versions of the "seed/query" file.

===Sapp's Mazurka Collection Information ===
In addition to our original ACS dataset, we used the [http://www.mazurka.org.uk/ Mazurka.org dataset] put together by Craig Sapp. We randomly chose 11 versions from 49 mazurkas and ran it as a separate ACS subtask. Systems returned a distance matrix of 539x539 from which we located the ranks of each of the associated cover versions.

== General Legend ==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! CL1
| CL1 || style="text-align: center;" | || Ning Chen, Mingyu Li
|-
! CT2
| SYBK1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2017/CT2.pdf PDF] || [http://www.ctralie.com Chris Tralie]
|-
! HKL1
| HKL1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2017/HKL1.pdf PDF] || Hoon Heo, Hyunwoo J. Kim, Wan Soo Kim, Kyogu Lee

|}

== Results ==

===Mixed Collection===

====Summary Results====
<csv p=2>2017/acs/csv/coversong1000.summary.csv</csv>

====Number of Correct Covers at Rank X Returned in Top Ten====
<csv>2017/acs/csv/coversong1000.toptendist.csv</csv>

====Average Performance per Query Group====
<csv p=2>2017/acs/csv/coversong1000.precision.groups.csv</csv>

===Sapp's Mazuraka Collection===

====Summary results====
<csv p=2>2017/acs/csv/mazurkas.summary.csv</csv>

====Number of Correct Covers at Rank X Returned in Top Ten====
<csv>2017/acs/csv/mazurkas.toptendist.csv</csv>

====Average Performance per Query Group====
<csv p=2>2017/acs/csv/mazurkas.precision.groups.csv</csv>

==Individual Results Files==

===Mixed Collection===
'''Average Precision by Query'''

'''CL1''' : [https://music-ir.org/mirex/results/2016/acs/CL1.coversong1000.avgprec.txt Ning Chen, Hai-Dong Xiao] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2016/acs/CYWW1.coversong1000.avgprec.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''SYBK1''' : [https://music-ir.org/mirex/results/2016/acs/SYBK1.coversong1000.avgprec.txt Diego Silva, Chin-Chia Michael Yeh, Gustavo Enrique de Almeida Prado Alves Batista, Eamonn Keogh] 

'''YWJ2''' : [https://music-ir.org/mirex/results/2016/acs/YWJ2.coversong1000.avgprec.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''YWJ3''' : [https://music-ir.org/mirex/results/2016/acs/YWJ3.coversong1000.avgprec.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''Rank Lists'''

'''CL1''' : [https://music-ir.org/mirex/results/2016/acs/CL1.coversong1000.ranklist.txt Ning Chen, Hai-Dong Xiao] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2016/acs/CYWW1.coversong1000.ranklist.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''SYBK1''' : [https://music-ir.org/mirex/results/2016/acs/SYBK1.coversong1000.ranklist.txt Diego Silva, Chin-Chia Michael Yeh, Gustavo Enrique de Almeida Prado Alves Batista, Eamonn Keogh] 

'''YWJ2''' : [https://music-ir.org/mirex/results/2016/acs/YWJ2.coversong1000.ranklist.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''YWJ3''' : [https://music-ir.org/mirex/results/2016/acs/YWJ3.coversong1000.ranklist.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

===Mazurkas===
'''Average Precision by Query'''

'''CL1''' : [https://music-ir.org/mirex/results/2016/acs/CL1.mazurkas.avgprec.txt Ning Chen, Hai-Dong Xiao] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2016/acs/CYWW1.mazurkas.avgprec.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''SYBK1''' : [https://music-ir.org/mirex/results/2016/acs/SYBK1.mazurkas.avgprec.txt Diego Silva, Chin-Chia Michael Yeh, Gustavo Enrique de Almeida Prado Alves Batista, Eamonn Keogh] 

'''YWJ2''' : [https://music-ir.org/mirex/results/2016/acs/YWJ2.mazurkas.avgprec.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''YWJ3''' : [https://music-ir.org/mirex/results/2016/acs/YWJ3.mazurkas.avgprec.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''Rank Lists'''

'''CL1''' : [https://music-ir.org/mirex/results/2016/acs/CL1.mazurkas.ranklist.txt Ning Chen, Hai-Dong Xiao] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2016/acs/CYWW1.mazurkas.ranklist.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''SYBK1''' : [https://music-ir.org/mirex/results/2016/acs/SYBK1.mazurkas.ranklist.txt Diego Silva, Chin-Chia Michael Yeh, Gustavo Enrique de Almeida Prado Alves Batista, Eamonn Keogh] 

'''YWJ2''' : [https://music-ir.org/mirex/results/2016/acs/YWJ2.mazurkas.ranklist.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''YWJ3''' : [https://music-ir.org/mirex/results/2016/acs/YWJ3.mazurkas.ranklist.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang]

2016:Audio Cover Song Identification Results

2016-08-08T14:17:38Z

ChrisTralie: /* Mixed Collection */

== Introduction ==

Audio Cover Song (ACS) Identification was evaluated against two datasets: ''Mixed Collection'' and ''Sapp's Mazurka Collection''.

===Mixed Collection Information===
This is the "original" ACS collection. Within the 1000 pieces in the Audio Cover Song database, there are embedded 30 different "cover songs" each represented by 11 different "versions" for a total of 330 audio files (16bit, monophonic, 22.05khz, wav). The "cover songs" represent a variety of genres (e.g., classical, jazz, gospel, rock, folk-rock, etc.) and the variations span a variety of styles and orchestrations.

Using each of these cover song files in turn as the "seed/query" file, we will examine the returned lists of items for the presence of the other 10 versions of the "seed/query" file.

===Sapp's Mazurka Collection Information ===
In addition to our original ACS dataset, we used the [http://www.mazurka.org.uk/ Mazurka.org dataset] put together by Craig Sapp. We randomly chose 11 versions from 49 mazurkas and ran it as a separate ACS subtask. Systems returned a distance matrix of 539x539 from which we located the ranks of each of the associated cover versions.

== General Legend ==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! CL1
| CL1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/CL1.pdf PDF] || Ning Chen, Hai-Dong Xiao
|-
! YWJ2
| YWJ2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/YWJ2.pdf PDF] || [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://www.iis.sinica.edu.tw Hsin-Min Wang], [http://mirlab.org/jang/ Jyh-Shing Roger Jang]
|-
! YWJ3
| YWJ3 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/YWJ3.pdf PDF] || [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://www.iis.sinica.edu.tw Hsin-Min Wang], [http://mirlab.org/jang/ Jyh-Shing Roger Jang]
|-
! CYWW1
| CYWW1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/CYWW1.pdf PDF] || [http://slam.iis.sinica.edu.tw/ Chuan-Yau Chan], [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://sovideo.iis.sinica.edu.tw/SLG/index.html Ju-Chiang Wang], [http://www.iis.sinica.edu.tw Hsin-Min Wang]
|-
! SYBK1
| SYBK1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/SYBK1.pdf PDF] || [http://sites.labic.icmc.usp.br/dfs Diego Silva], [http://www.cs.ucr.edu/~myeh003/ Chin-Chia Michael Yeh], [https://www.icmc.usp.br/~gbatista/ Gustavo Enrique de Almeida Prado Alves Batista], [http://www.cs.ucr.edu/~eamonn/ Eamonn Keogh]

|}

== Results ==

===Mixed Collection===

====Summary Results====
<csv p=2>2016/acs/coversong1000.summary.csv</csv>

====Number of Correct Covers at Rank X Returned in Top Ten====
<csv>2016/acs/coversong1000.toptendist.csv</csv>

====Average Performance per Query Group====
<csv p=2>2016/acs/coversong1000.precision.groups.csv</csv>

===Sapp's Mazuraka Collection===

====Summary results====
<csv p=2>2016/acs/mazurkas.summary.csv</csv>

====Number of Correct Covers at Rank X Returned in Top Ten====
<csv>2016/acs/mazurkas.toptendist.csv</csv>

====Average Performance per Query Group====
<csv p=2>2016/acs/mazurkas.precision.groups.csv</csv>

==Individual Results Files==

===Mixed Collection===
'''Average Precision by Query'''

'''CL1''' : [https://music-ir.org/mirex/results/2016/acs/CL1.coversong1000.avgprec.txt Ning Chen, Hai-Dong Xiao] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2016/acs/CYWW1.coversong1000.avgprec.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''SYBK1''' : [https://music-ir.org/mirex/results/2016/acs/SYBK1.coversong1000.avgprec.txt Diego Silva, Chin-Chia Michael Yeh, Gustavo Enrique de Almeida Prado Alves Batista, Eamonn Keogh] 

'''YWJ2''' : [https://music-ir.org/mirex/results/2016/acs/YWJ2.coversong1000.avgprec.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''YWJ3''' : [https://music-ir.org/mirex/results/2016/acs/YWJ3.coversong1000.avgprec.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''Rank Lists'''

'''CL1''' : [https://music-ir.org/mirex/results/2016/acs/CL1.coversong1000.ranklist.txt Ning Chen, Hai-Dong Xiao] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2016/acs/CYWW1.coversong1000.ranklist.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''SYBK1''' : [https://music-ir.org/mirex/results/2016/acs/SYBK1.coversong1000.ranklist.txt Diego Silva, Chin-Chia Michael Yeh, Gustavo Enrique de Almeida Prado Alves Batista, Eamonn Keogh] 

'''YWJ2''' : [https://music-ir.org/mirex/results/2016/acs/YWJ2.coversong1000.ranklist.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''YWJ3''' : [https://music-ir.org/mirex/results/2016/acs/YWJ3.coversong1000.ranklist.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

===Mazurkas===
'''Average Precision by Query'''

'''CL1''' : [https://music-ir.org/mirex/results/2016/acs/CL1.mazurkas.avgprec.txt Ning Chen, Hai-Dong Xiao] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2016/acs/CYWW1.mazurkas.avgprec.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''SYBK1''' : [https://music-ir.org/mirex/results/2016/acs/SYBK1.mazurkas.avgprec.txt Diego Silva, Chin-Chia Michael Yeh, Gustavo Enrique de Almeida Prado Alves Batista, Eamonn Keogh] 

'''YWJ2''' : [https://music-ir.org/mirex/results/2016/acs/YWJ2.mazurkas.avgprec.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''YWJ3''' : [https://music-ir.org/mirex/results/2016/acs/YWJ3.mazurkas.avgprec.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''Rank Lists'''

'''CL1''' : [https://music-ir.org/mirex/results/2016/acs/CL1.mazurkas.ranklist.txt Ning Chen, Hai-Dong Xiao] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2016/acs/CYWW1.mazurkas.ranklist.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''SYBK1''' : [https://music-ir.org/mirex/results/2016/acs/SYBK1.mazurkas.ranklist.txt Diego Silva, Chin-Chia Michael Yeh, Gustavo Enrique de Almeida Prado Alves Batista, Eamonn Keogh] 

'''YWJ2''' : [https://music-ir.org/mirex/results/2016/acs/YWJ2.mazurkas.ranklist.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''YWJ3''' : [https://music-ir.org/mirex/results/2016/acs/YWJ3.mazurkas.ranklist.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang]

2016:Audio Cover Song Identification Results

2016-08-08T14:16:00Z

ChrisTralie: /* Mixed Collection */

== Introduction ==

Audio Cover Song (ACS) Identification was evaluated against two datasets: ''Mixed Collection'' and ''Sapp's Mazurka Collection''.

===Mixed Collection Information===
This is the "original" ACS collection. Within the 1000 pieces in the Audio Cover Song database, there are embedded 30 different "cover songs" each represented by 11 different "versions" for a total of 330 audio files (16bit, monophonic, 22.05khz, wav). The "cover songs" represent a variety of genres (e.g., classical, jazz, gospel, rock, folk-rock, etc.) and the variations span a variety of styles and orchestrations.

Using each of these cover song files in turn as the "seed/query" file, we will examine the returned lists of items for the presence of the other 10 versions of the "seed/query" file.

===Sapp's Mazurka Collection Information ===
In addition to our original ACS dataset, we used the [http://www.mazurka.org.uk/ Mazurka.org dataset] put together by Craig Sapp. We randomly chose 11 versions from 49 mazurkas and ran it as a separate ACS subtask. Systems returned a distance matrix of 539x539 from which we located the ranks of each of the associated cover versions.

== General Legend ==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! CL1
| CL1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/CL1.pdf PDF] || Ning Chen, Hai-Dong Xiao
|-
! YWJ2
| YWJ2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/YWJ2.pdf PDF] || [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://www.iis.sinica.edu.tw Hsin-Min Wang], [http://mirlab.org/jang/ Jyh-Shing Roger Jang]
|-
! YWJ3
| YWJ3 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/YWJ3.pdf PDF] || [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://www.iis.sinica.edu.tw Hsin-Min Wang], [http://mirlab.org/jang/ Jyh-Shing Roger Jang]
|-
! CYWW1
| CYWW1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/CYWW1.pdf PDF] || [http://slam.iis.sinica.edu.tw/ Chuan-Yau Chan], [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://sovideo.iis.sinica.edu.tw/SLG/index.html Ju-Chiang Wang], [http://www.iis.sinica.edu.tw Hsin-Min Wang]
|-
! SYBK1
| SYBK1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/SYBK1.pdf PDF] || [http://sites.labic.icmc.usp.br/dfs Diego Silva], [http://www.cs.ucr.edu/~myeh003/ Chin-Chia Michael Yeh], [https://www.icmc.usp.br/~gbatista/ Gustavo Enrique de Almeida Prado Alves Batista], [http://www.cs.ucr.edu/~eamonn/ Eamonn Keogh]

|}

== Results ==

===Mixed Collection===

====Summary Results====
<csv p=2>2016/acs/coversong1000.summary.csv</csv>

====Number of Correct Covers at Rank X Returned in Top Ten====
<csv>2016/acs/coversong1000.toptendist.csv</csv>

====Average Performance per Query Group====
<csv p=2>2016/acs/coversong1000.precision.groups.csv</csv>

===Sapp's Mazuraka Collection===

====Summary results====
<csv p=2>2016/acs/mazurkas.summary.csv</csv>

====Number of Correct Covers at Rank X Returned in Top Ten====
<csv>2016/acs/mazurkas.toptendist.csv</csv>

====Average Performance per Query Group====
<csv p=2>2016/acs/mazurkas.precision.groups.csv</csv>

==Individual Results Files==

===Mixed Collection===
'''Average Precision by Query'''

'''CL1''' : [https://music-ir.org/mirex/results/2016/acs/CL1.coversong1000.avgprec.txt Ning Chen, Hai-Dong Xiao] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2016/acs/CYWW1.coversong1000.avgprec.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''SYBK1''' : [https://music-ir.org/mirex/results/2016/acs/SYBK1.coversong1000.avgprec.txt Diego Silva, Chin-Chia Michael Yeh, Gustavo Enrique de Almeida Prado Alves Batista, Eamonn Keogh] 

'''YWJ2''' : [https://music-ir.org/mirex/results/2016/acs/YWJ2.coversong1000.avgprec.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''YWJ3''' : [https://music-ir.org/mirex/results/2016/acs/YWJ3.coversong1000.avgprec.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''Rank Lists'''

'''CL1''' : [https://music-ir.org/mirex/results/2016/acs/CL1.coversong1000.ranklist.txt Ning Chen, Hai-Dong Xiao] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2016/acs/CYWW1.coversong1000.ranklist.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''SYBK1''' : [https://music-ir.org/mirex/results/2016/acs/SYBK1.coversong1000.ranklist.txt Diego Silva, Chin-Chia Michael Yeh, Gustavo Enrique de Almeida Prado Alves Batista, Eamonn Keogh] 

'''YWJ2''' : [https://music-ir.org/mirex/results/2016/acs/YWJ2.coversong1000.ranklist.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''YWJ3''' : [https://music-ir.org/mirex/results/2016/acs/YWJ3.coversong1000.ranklist.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang]

2016:Audio Cover Song Identification Results

2016-08-04T20:18:04Z

ChrisTralie: /* Mixed Collection */

== Introduction ==

Audio Cover Song (ACS) Identification was evaluated against two datasets: ''Mixed Collection'' and ''Sapp's Mazurka Collection''.

===Mixed Collection Information===
This is the "original" ACS collection. Within the 1000 pieces in the Audio Cover Song database, there are embedded 30 different "cover songs" each represented by 11 different "versions" for a total of 330 audio files (16bit, monophonic, 22.05khz, wav). The "cover songs" represent a variety of genres (e.g., classical, jazz, gospel, rock, folk-rock, etc.) and the variations span a variety of styles and orchestrations.

Using each of these cover song files in turn as the "seed/query" file, we will examine the returned lists of items for the presence of the other 10 versions of the "seed/query" file.

===Sapp's Mazurka Collection Information ===
In addition to our original ACS dataset, we used the [http://www.mazurka.org.uk/ Mazurka.org dataset] put together by Craig Sapp. We randomly chose 11 versions from 49 mazurkas and ran it as a separate ACS subtask. Systems returned a distance matrix of 539x539 from which we located the ranks of each of the associated cover versions.

== General Legend ==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! CL1
| CL1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/CL1.pdf PDF] || Ning Chen, Hai-Dong Xiao
|-
! YWJ2
| YWJ2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/YWJ2.pdf PDF] || [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://www.iis.sinica.edu.tw Hsin-Min Wang], [http://mirlab.org/jang/ Jyh-Shing Roger Jang]
|-
! YWJ3
| YWJ3 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/YWJ3.pdf PDF] || [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://www.iis.sinica.edu.tw Hsin-Min Wang], [http://mirlab.org/jang/ Jyh-Shing Roger Jang]
|-
! CYWW1
| CYWW1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/CYWW1.pdf PDF] || [http://slam.iis.sinica.edu.tw/ Chuan-Yau Chan], [http://slam.iis.sinica.edu.tw/index.htm Ming-Chi Yen], [http://sovideo.iis.sinica.edu.tw/SLG/index.html Ju-Chiang Wang], [http://www.iis.sinica.edu.tw Hsin-Min Wang]
|-
! SYBK1
| SYBK1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2016/SYBK1.pdf PDF] || [http://sites.labic.icmc.usp.br/dfs Diego Silva], [http://www.cs.ucr.edu/~myeh003/ Chin-Chia Michael Yeh], [https://www.icmc.usp.br/~gbatista/ Gustavo Enrique de Almeida Prado Alves Batista], [http://www.cs.ucr.edu/~eamonn/ Eamonn Keogh]

|}

== Results ==

===Mixed Collection===

====Summary Results====
<csv p=2>2016/acs/coversong1000.summary.csv</csv>

====Number of Correct Covers at Rank X Returned in Top Ten====
<csv>2016/acs/coversong1000.toptendist.csv</csv>

====Average Performance per Query Group====
<csv p=2>2016/acs/coversong1000.precision.groups.csv</csv>

==Individual Results Files==

===Mixed Collection===
'''Average Precision by Query'''

'''CL1''' : [https://music-ir.org/mirex/results/2016/acs/CL1.coversong1000.avgprec.txt Ning Chen, Hai-Dong Xiao] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2016/acs/CYWW1.coversong1000.avgprec.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''SYBK1''' : [https://music-ir.org/mirex/results/2016/acs/SYBK1.coversong1000.avgprec.txt Diego Silva, Chin-Chia Michael Yeh, Gustavo Enrique de Almeida Prado Alves Batista, Eamonn Keogh] 

'''YWJ2''' : [https://music-ir.org/mirex/results/2016/acs/YWJ2.coversong1000.avgprec.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''YWJ3''' : [https://music-ir.org/mirex/results/2016/acs/YWJ3.coversong1000.avgprec.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''Rank Lists'''

'''CL1''' : [https://music-ir.org/mirex/results/2016/acs/CL1.coversong1000.ranklist.txt Ning Chen, Hai-Dong Xiao] 

'''CYWW1''' : [https://music-ir.org/mirex/results/2016/acs/CYWW1.coversong1000.ranklist.txt Chuan-Yau Chan, Ming-Chi Yen, Ju-Chiang Wang, Hsin-Min Wang] 

'''SYBK1''' : [https://music-ir.org/mirex/results/2016/acs/SYBK1.coversong1000.ranklist.txt Diego Silva, Chin-Chia Michael Yeh, Gustavo Enrique de Almeida Prado Alves Batista, Eamonn Keogh] 

'''YWJ2''' : [https://music-ir.org/mirex/results/2016/acs/YWJ2.coversong1000.ranklist.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang] 

'''YWJ3''' : [https://music-ir.org/mirex/results/2016/acs/YWJ3.coversong1000.ranklist.txt Ming-Chi Yen, Hsin-Min Wang, Jyh-Shing Roger Jang]

2016:Audio Cover Song Identification Results

2016-08-04T20:14:22Z

ChrisTralie: /* Mixed Collection */

2016:Audio Cover Song Identification Results

2016-08-04T20:12:47Z

ChrisTralie: /* Mixed Collection */

2016:Audio Cover Song Identification Results

2016-08-04T19:16:29Z

ChrisTralie: /* General Legend */