Yun Hao: /* Average Performance per Query Group */

2018-09-22T23:16:23Z

‎Average Performance per Query Group

Yun Hao: /* Number of Correct Covers at Rank X Returned in Top Ten */

2018-09-22T23:16:13Z

‎Number of Correct Covers at Rank X Returned in Top Ten

Yun Hao: /* Summary Results */

2018-09-22T23:16:01Z

‎Summary Results

Yun Hao: /* General Legend */

2018-09-20T19:20:17Z

‎General Legend

Yun Hao: Created page with "== Introduction == Audio Cover Song (ACS) Identification was evaluated against two datasets: ''Mixed Collection'' and ''Sapp's Mazurka Collection''. ===Mixed Collection Informa..."

2018-09-17T20:47:56Z

Created page with "== Introduction == Audio Cover Song (ACS) Identification was evaluated against two datasets: ''Mixed Collection'' and ''Sapp's Mazurka Collection''. ===Mixed Collection Informa..."

New page

== Introduction ==

Audio Cover Song (ACS) Identification was evaluated against two datasets: ''Mixed Collection'' and ''Sapp's Mazurka Collection''.

===Mixed Collection Information===
This is the "original" ACS collection. Within the 1000 pieces in the Audio Cover Song database, there are embedded 30 different "cover songs" each represented by 11 different "versions" for a total of 330 audio files (16bit, monophonic, 22.05khz, wav). The "cover songs" represent a variety of genres (e.g., classical, jazz, gospel, rock, folk-rock, etc.) and the variations span a variety of styles and orchestrations.

Using each of these cover song files in turn as the "seed/query" file, we will examine the returned lists of items for the presence of the other 10 versions of the "seed/query" file.

===Sapp's Mazurka Collection Information ===
In addition to our original ACS dataset, we used the [http://www.mazurka.org.uk/ Mazurka.org dataset] put together by Craig Sapp. We randomly chose 11 versions from 49 mazurkas and ran it as a separate ACS subtask. Systems returned a distance matrix of 539x539 from which we located the ranks of each of the associated cover versions.

== General Legend ==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! CL1
| CL1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2018/CL1.pdf PDF] || [http://cise.ecust.edu.cn/ Ning Chen], [http://www.ecust.edu.cn/ Mingyu Li]
|-
! LCLL1
| CoverNet || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2018/LCLL1.pdf PDF] ||[http://marg.snu.ac.kr juheon lee], [http://marg.snu.ac.kr Sungkyun Chang], [http://marg.snu.ac.kr Donmoon Lee], [http://marg.snu.ac.kr/people Kyogu Lee]

|}

== Results ==

===Mixed Collection===

====Summary Results====
Coming soon.
<csv p=2>2018/acs/coversong1000.summary.csv</csv>

====Number of Correct Covers at Rank X Returned in Top Ten====
Coming soon.
<csv>2018/acs/coversong1000.toptendist.csv</csv>

====Average Performance per Query Group====
Coming soon.
<csv p=2>2018/acs/coversong1000.precision.groups.csv</csv>

===Sapp's Mazuraka Collection===

====Summary results====
<csv p=2>2018/acs/mazurkas.summary.csv</csv>

====Number of Correct Covers at Rank X Returned in Top Ten====
<csv>2018/acs/mazurkas.toptendist.csv</csv>

====Average Performance per Query Group====
<csv p=2>2018/acs/mazurkas.precision.groups.csv</csv>

==Individual Results Files==

===Mixed Collection===
'''Average Precision by Query'''

'''CL1''' : [https://music-ir.org/mirex/results/2018/acs/CL1.coversong1000.avgprec.txt Ning Chen, Mingyu Li] 
'''LCLL1''' : [https://music-ir.org/mirex/results/2018/acs/LCLL1.coversong1000.avgprec.txt Juheon Lee, Sungkyun Chang, Donmoon Lee, Kyogu Lee] 

'''Rank Lists'''

'''CL1''' : [https://music-ir.org/mirex/results/2018/acs/CL1.coversong1000.ranklist.txt Ning Chen, Mingyu Li] 
'''LCLL1''' : [https://music-ir.org/mirex/results/2018/acs/LCLL1.coversong1000.ranklist.txt Juheon Lee, Sungkyun Chang, Donmoon Lee, Kyogu Lee] 

===Mazurkas===
'''Average Precision by Query'''

'''CL1''' : [https://music-ir.org/mirex/results/2018/acs/CL1.mazurkas.avgprec.txt Ning Chen, Mingyu Li] 
'''LCLL1''' : [https://music-ir.org/mirex/results/2018/acs/LCLL1.mazurkas.avgprec.txt Juheon Lee, Sungkyun Chang, Donmoon Lee, Kyogu Lee] 

'''Rank Lists'''

'''CL1''' : [https://music-ir.org/mirex/results/2018/acs/CL1.mazurkas.ranklist.txt Ning Chen, Mingyu Li] 
'''LCLL1''' : [https://music-ir.org/mirex/results/2018/acs/LCLL1.mazurkas.ranklist.txt Juheon Lee, Sungkyun Chang, Donmoon Lee, Kyogu Lee]

← Older revision		Revision as of 23:16, 22 September 2018
Line 38:		Line 38:

	====Average Performance per Query Group====		====Average Performance per Query Group====
−	~~Coming soon.~~
	<csv p=2>2018/acs/coversong1000.precision.groups.csv</csv>		<csv p=2>2018/acs/coversong1000.precision.groups.csv</csv>

← Older revision		Revision as of 23:16, 22 September 2018
Line 35:		Line 35:

	====Number of Correct Covers at Rank X Returned in Top Ten====		====Number of Correct Covers at Rank X Returned in Top Ten====
−	~~Coming soon.~~
	<csv>2018/acs/coversong1000.toptendist.csv</csv>		<csv>2018/acs/coversong1000.toptendist.csv</csv>

← Older revision		Revision as of 23:16, 22 September 2018
Line 32:		Line 32:

	====Summary Results====		====Summary Results====
−	~~Coming soon.~~
	<csv p=2>2018/acs/coversong1000.summary.csv</csv>		<csv p=2>2018/acs/coversong1000.summary.csv</csv>

@@ Line 25: / Line 25: @@
      ! LCLL1
      | 	CoverNet ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2018/LCLL1.pdf PDF] ||[http://marg.snu.ac.kr juheon lee], [http://marg.snu.ac.kr Sungkyun Chang], [http://marg.snu.ac.kr Donmoon Lee], [http://marg.snu.ac.kr/people Kyogu Lee]
 |}

2018:Audio Cover Song Identification Results - Revision history

Yun Hao: /* Average Performance per Query Group */

Yun Hao: /* Number of Correct Covers at Rank X Returned in Top Ten */

Yun Hao: /* Summary Results */

Yun Hao: /* General Legend */

Yun Hao: Created page with "== Introduction == Audio Cover Song (ACS) Identification was evaluated against two datasets: ''Mixed Collection'' and ''Sapp's Mazurka Collection''. ===Mixed Collection Informa..."