2009:Audio Chord Detection Results Per Album

Johan will post the results of his per album analysis as soon as he figures out the Wiki syntax, so come back later

Introduction

In order to compare the results of MIREX 2009 with those of MIREX 2008, the performance on just the Beatles data has te be known. The score per song has been given, but the album metadata is unavailable in the results file, which makes it less than trivial to sort the songs per album. Therefore I wrote a script which does exactly that. To save anyone else the trouble, the results as well as the scripts are posted here. --Johan

Task 1

Overview per artist

file /nema-raid/www/mirex/results/2009/http://users.elis.ugent.be/~jppauwel/mirex2009/task1.overlap.artists.csv not found

Overview per artist (merged maj/min)

file /nema-raid/www/mirex/results/2009/http://users.elis.ugent.be/~jppauwel/mirex2009/task1.overlap.artists.merged.csv not found

Detailed results per album

CH = Christopher Harte
DE = Dan Ellis
KO1 = Maksim Khadkevich, Maurizio Omologo
KO2 = Maksim Khadkevich, Maurizio Omologo
MD = Matthias Mauch, Katy Noland, Simon Dixon
OGF1 = Laurent Oudre, Yves Grenier,Cedric Fevotte (majmin)
OGF2 = Laurent Oudre, Yves Grenier,Cedric Fevotte (majmin7)
PP = Helene Papadopoulos, Geoffroy Peeters
PVM1 = Johan Pauwels, Matthias Varewyck,Jean-Pierre Martens
PVM2 = Johan Pauwels, Matthias Varewyck,Jean-Pierre Martens
RRHS1 = Thomas Rocher, Matthias Robine, Pierre Hanna,Robert Strandh
RRHS2 = Thomas Rocher, Matthias Robine, Pierre Hanna,Robert Strandh
RRHS3 = Thomas Rocher, Matthias Robine, Pierre Hanna,Robert Strandh

Task 2

Overview per artist

file /nema-raid/www/mirex/results/2009/http://users.elis.ugent.be/~jppauwel/mirex2009/task2.overlap.artists.csv not found

Overview per artist (merged maj/min)

file /nema-raid/www/mirex/results/2009/http://users.elis.ugent.be/~jppauwel/mirex2009/task2.overlap.artists.merged.csv not found

Detailed results per album

RUSUSL = J.T.Reed,Yushi Ueda,S.Siniscalchi,Yuki Uchiyama,Shigeki Sagayama,C.H.Lee
WEJ1 = Adrian Weller, Daniel Ellis, Tony Jebara
WEJ2 = Adrian Weller, Daniel Ellis, Tony Jebara
WEJ3 = Adrian Weller, Daniel Ellis, Tony Jebara
WEJ4 = Adrian Weller, Daniel Ellis, Tony Jebara

Method

A Python script was made which takes the csv-files from the results page as input, retrieves the corresponding album for each song in a dictionary, orders the songs according to the album, calculates the weighted average for each album and finally writes these to a new csv-file.
The script was written for Python 2.6 and is available for [download]. Feel free to modify/expand it.