2020:Audio Cover Song Identification Results - Revision history

Yun Hao at 05:51, 15 October 2020

2020-10-15T05:51:50Z

Yun Hao: Undo revision 13301 by Yun Hao (talk)

2020-10-15T05:48:25Z

Undo revision 13301 by Yun Hao (talk)

Yun Hao: /* General Legend */

2020-10-15T05:33:54Z

‎General Legend

Yun Hao: Created page with "== Introduction == Audio Cover Song (ACS) Identification was evaluated against two datasets: ''Mixed Collection'' and ''Sapp's Mazurka Collection''. ===Mixed Collection Info..."

2020-10-12T18:43:45Z

Created page with "== Introduction == Audio Cover Song (ACS) Identification was evaluated against two datasets: ''Mixed Collection'' and ''Sapp's Mazurka Collection''. ===Mixed Collection Info..."

New page

== Introduction ==

Audio Cover Song (ACS) Identification was evaluated against two datasets: ''Mixed Collection'' and ''Sapp's Mazurka Collection''.

===Mixed Collection Information===
This is the "original" ACS collection. Within the 1000 pieces in the Audio Cover Song database, there are embedded 30 different "cover songs" each represented by 11 different "versions" for a total of 330 audio files (16bit, monophonic, 22.05khz, wav). The "cover songs" represent a variety of genres (e.g., classical, jazz, gospel, rock, folk-rock, etc.) and the variations span a variety of styles and orchestrations.

Using each of these cover song files in turn as the "seed/query" file, we will examine the returned lists of items for the presence of the other 10 versions of the "seed/query" file.

===Sapp's Mazurka Collection Information ===
In addition to our original ACS dataset, we used the [http://www.mazurka.org.uk/ Mazurka.org dataset] put together by Craig Sapp. We randomly chose 11 versions from 49 mazurkas and ran it as a separate ACS subtask. Systems returned a distance matrix of 539x539 from which we located the ranks of each of the associated cover versions.

== General Legend ==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! DY1
| SinoNet || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/DY1.pdf PDF] || [https://github.com/diggerdu Xingjian Du], [http://www.icst.pku.edu.cn Zhesong Yu]
|-
! DYZC1
| CasperNet0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/DYZC1.pdf PDF] || [https://github.com/diggerdu Xingjian Du], [http://www.icst.pku.edu.cn Zhesong Yu],, [http://www.tencent.com/en-us/index.shtml Bilei Zhu], [http://www.icst.pku.edu.cn/team/content_266.htm Xiaoou Chen]
|-
! HCCL1
| CSI task based on Subspace Merging of Enhanced Cross-Similarity Graphs || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/HCCL1.pdf PDF] ||[http://cise.ecust.edu.cn/ Jingyi Hu], [http://cise.ecust.edu.cn/ Ning Chen],[http://www.ecust.edu.cn/ Jialing Cao], [http://www.ecust.edu.cn/ Han Lei]
|-
! ZL1
| ZJ_T1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/ZL1.pdf PDF] || [http://ir.netease.com/index.php/ Jian Zhao ], [http://163.com Huaping Liu]
|}

== Results ==

===Mixed Collection===

====Summary Results====
<csv p=2>2020/acs/coversong1000.summary.csv</csv>

====Number of Correct Covers at Rank X Returned in Top Ten====
<csv>2020/acs/coversong1000.toptendist.csv</csv>

====Average Performance per Query Group====
<csv p=2>2020/acs/coversong1000.precision.groups.csv</csv>

===Sapp's Mazuraka Collection===

====Summary results====
<csv p=2>2020/acs/mazurkas.summary.csv</csv>

====Number of Correct Covers at Rank X Returned in Top Ten====
<csv>2020/acs/mazurkas.toptendist.csv</csv>

====Average Performance per Query Group====
<csv p=2>2020/acs/mazurkas.precision.groups.csv</csv>

==Individual Results Files==

===Mixed Collection===
'''Average Precision by Query'''

'''DY1''' : [https://music-ir.org/mirex/results/2020/acs/DY1.coversong1000.avgprec.txt Xingjian Du, Zhesong Yu] 
'''DYZC1''' : [https://music-ir.org/mirex/results/2020/acs/DYZC1.coversong1000.avgprec.txt Xingjian Du, Zhesong Yu,, Bilei Zhu, Xiaoou Chen] 

'''ZL1''' : [https://music-ir.org/mirex/results/2020/acs/ZL1.coversong1000.avgprec.txt Jian Zhao, Huaping Liu] 

'''Rank Lists'''

'''DY1''' : [https://music-ir.org/mirex/results/2020/acs/DY1.coversong1000.ranklist.txt Xingjian Du, Zhesong Yu] 
'''DYZC1''' : [https://music-ir.org/mirex/results/2020/acs/DYZC1.coversong1000.ranklist.txt Xingjian Du, Zhesong Yu,, Bilei Zhu, Xiaoou Chen] 

'''ZL1''' : [https://music-ir.org/mirex/results/2020/acs/ZL1.coversong1000.ranklist.txt Jian Zhao, Huaping Liu] 

===Mazurkas===
'''Average Precision by Query'''
'''DY1''' : [https://music-ir.org/mirex/results/2020/acs/DY1.mazurkas.avgprec.txt Xingjian Du, Zhesong Yu] 
'''DYZC1''' : [https://music-ir.org/mirex/results/2020/acs/DYZC1.mazurkas.avgprec.txt Xingjian Du, Zhesong Yu,, Bilei Zhu, Xiaoou Chen] 
'''HCCL1''' : [https://music-ir.org/mirex/results/2020/acs/HCCL1.mazurkas.avgprec.txt Jingyi Hu, Ning Chen,Jialing Cao, Han Lei] 
'''ZL1''' : [https://music-ir.org/mirex/results/2020/acs/ZL1.mazurkas.avgprec.txt Jian Zhao, Huaping Liu] 

'''Rank Lists'''
'''DY1''' : [https://music-ir.org/mirex/results/2020/acs/DY1.mazurkas.ranklist.txt Xingjian Du, Zhesong Yu] 
'''DYZC1''' : [https://music-ir.org/mirex/results/2020/acs/DYZC1.mazurkas.ranklist.txt Xingjian Du, Zhesong Yu,, Bilei Zhu, Xiaoou Chen] 
'''HCCL1''' : [https://music-ir.org/mirex/results/2020/acs/HCCL1.mazurkas.ranklist.txt Jingyi Hu, Ning Chen,Jialing Cao, Han Lei] 
'''ZL1''' : [https://music-ir.org/mirex/results/2020/acs/ZL1.mazurkas.ranklist.txt Jian Zhao, Huaping Liu]

@@ Line 21: / Line 21: @@
      |-
      ! DY1
-     | SinoNet	 ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/DY1.pdf PDF] || [https://github.com/diggerdu Xingjian Du], [http://www.icst.pku.edu.cn Zhesong Yu]
+     | SinoNet	 ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/DY1.pdf PDF] || [http://www.icst.pku.edu.cn Zhesong Yu], Xiaoshuo Xu, [http://www.icst.pku.edu.cn/team/content_266.htm Xiaoou Chen] and Deshun Yang,
      |-
      ! DYZC1
-     | CasperNet0	 ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/DYZC1.pdf PDF] || [https://github.com/diggerdu Xingjian Du], [http://www.icst.pku.edu.cn Zhesong Yu],, [http://www.tencent.com/en-us/index.shtml Bilei Zhu], [http://www.icst.pku.edu.cn/team/content_266.htm Xiaoou Chen]
+     | CasperNet0	 ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/DYZC1.pdf PDF] || [https://github.com/diggerdu Xingjian Du], [http://www.icst.pku.edu.cn Zhesong Yu], [http://www.tencent.com/en-us/index.shtml Bilei Zhu], [http://www.icst.pku.edu.cn/team/content_266.htm Xiaoou Chen]
      |-
      ! HCCL1
@@ Line 62: / Line 62: @@
 '''Average Precision by Query'''
-'''DY1''' : [https://music-ir.org/mirex/results/2020/acs/DY1.coversong1000.avgprec.txt  Xingjian Du, Zhesong Yu] <br />
+'''DY1''' : [https://music-ir.org/mirex/results/2020/acs/DY1.coversong1000.avgprec.txt  Zhesong Yu, Xiaoshuo Xu, Xiaoou Chen, Deshun Yang] <br />
 '''DYZC1''' : [https://music-ir.org/mirex/results/2020/acs/DYZC1.coversong1000.avgprec.txt Xingjian Du, Zhesong Yu,, Bilei Zhu, Xiaoou Chen] <br />
 <!--'''HCCL1''' : [https://music-ir.org/mirex/results/2020/acs/HCCL1.coversong1000.avgprec.txt Jingyi Hu, Ning Chen,Jialing Cao, Han Lei] <br />-->
@@ Line 69: / Line 69: @@
 '''Rank Lists'''
-'''DY1''' : [https://music-ir.org/mirex/results/2020/acs/DY1.coversong1000.ranklist.txt  Xingjian Du, Zhesong Yu] <br />
+'''DY1''' : [https://music-ir.org/mirex/results/2020/acs/DY1.coversong1000.ranklist.txt  Zhesong Yu, Xiaoshuo Xu, Xiaoou Chen, Deshun Yang] <br />
 '''DYZC1''' : [https://music-ir.org/mirex/results/2020/acs/DYZC1.coversong1000.ranklist.txt Xingjian Du, Zhesong Yu,, Bilei Zhu, Xiaoou Chen] <br />
 <!--'''HCCL1''' : [https://music-ir.org/mirex/results/2020/acs/HCCL1.coversong1000.ranklist.txt Jingyi Hu, Ning Chen,Jialing Cao, Han Lei] <br />-->
@@ Line 78: / Line 78: @@
 ===Mazurkas===
 '''Average Precision by Query'''
-'''DY1''' : [https://music-ir.org/mirex/results/2020/acs/DY1.mazurkas.avgprec.txt  Xingjian Du, Zhesong Yu] <br />
+'''DY1''' : [https://music-ir.org/mirex/results/2020/acs/DY1.mazurkas.avgprec.txt  Zhesong Yu, Xiaoshuo Xu, Xiaoou Chen, Deshun Yang] <br />
 '''DYZC1''' : [https://music-ir.org/mirex/results/2020/acs/DYZC1.mazurkas.avgprec.txt Xingjian Du, Zhesong Yu,, Bilei Zhu, Xiaoou Chen] <br />
 '''HCCL1''' : [https://music-ir.org/mirex/results/2020/acs/HCCL1.mazurkas.avgprec.txt Jingyi Hu, Ning Chen,Jialing Cao, Han Lei] <br />
@@ Line 86: / Line 86: @@
 '''Rank Lists'''
-'''DY1''' : [https://music-ir.org/mirex/results/2020/acs/DY1.mazurkas.ranklist.txt  Xingjian Du, Zhesong Yu] <br />
+'''DY1''' : [https://music-ir.org/mirex/results/2020/acs/DY1.mazurkas.ranklist.txt  Zhesong Yu, Xiaoshuo Xu, Xiaoou Chen, Deshun Yang] <br />
 '''DYZC1''' : [https://music-ir.org/mirex/results/2020/acs/DYZC1.mazurkas.ranklist.txt Xingjian Du, Zhesong Yu,, Bilei Zhu, Xiaoou Chen] <br />
 '''HCCL1''' : [https://music-ir.org/mirex/results/2020/acs/HCCL1.mazurkas.ranklist.txt Jingyi Hu, Ning Chen,Jialing Cao, Han Lei] <br />
 '''ZL1''' : [https://music-ir.org/mirex/results/2020/acs/ZL1.mazurkas.ranklist.txt Jian Zhao, Huaping Liu] <br />

@@ Line 24: / Line 24: @@
      |-
      ! DYZC1
-     | CasperNet0	 ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/DYZC1.pdf PDF] || [http://www.icst.pku.edu.cn Zhesong Yu], Xiaoshuo Xu, [http://www.icst.pku.edu.cn/team/content_266.htm Xiaoou Chen] and Deshun Yang,
+     | CasperNet0	 ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/DYZC1.pdf PDF] || [https://github.com/diggerdu Xingjian Du], [http://www.icst.pku.edu.cn Zhesong Yu],, [http://www.tencent.com/en-us/index.shtml Bilei Zhu], [http://www.icst.pku.edu.cn/team/content_266.htm Xiaoou Chen]
      |-
      ! HCCL1