Difference between revisions of "2009:Audio Chord Detection Results Per Album"

From MIREX Wiki
(Overview per artist)
m (Robot: Automated text replacement (-<csv([^>]*)> +<csv\1>2009/))
 
(11 intermediate revisions by 2 users not shown)
Line 1: Line 1:
 
Johan will post the results of his per album analysis as soon as he figures out the Wiki syntax, so come back later
 
Johan will post the results of his per album analysis as soon as he figures out the Wiki syntax, so come back later
 +
==Introduction==
 +
In order to compare the results of MIREX 2009 with those of MIREX 2008, the performance on just the Beatles data has te be known. The score per song has been given, but the album metadata is unavailable in the results file, which makes it less than trivial to sort the songs per album. Therefore I wrote a script which does exactly that. To save anyone else the trouble, the results as well as the scripts are posted here. --Johan
  
 
==Task 1==
 
==Task 1==
 
=====Overview per artist=====
 
=====Overview per artist=====
<csv>chord/task1/summary/task1.overall.csv</csv>
+
<csv>2009/http://users.elis.ugent.be/~jppauwel/mirex2009/task1.overlap.artists.csv</csv>
 +
 
 +
=====Overview per artist (merged maj/min)=====
 +
<csv>2009/http://users.elis.ugent.be/~jppauwel/mirex2009/task1.overlap.artists.merged.csv</csv>
  
 
=====Detailed results per album=====
 
=====Detailed results per album=====
Line 21: Line 26:
  
 
==Task 2==
 
==Task 2==
 +
=====Overview per artist=====
 +
<csv>2009/http://users.elis.ugent.be/~jppauwel/mirex2009/task2.overlap.artists.csv</csv>
 +
 +
=====Overview per artist (merged maj/min)=====
 +
<csv>2009/http://users.elis.ugent.be/~jppauwel/mirex2009/task2.overlap.artists.merged.csv</csv>
 +
 
=====Detailed results per album=====
 
=====Detailed results per album=====
 
'''RUSUSL''' = [http://users.elis.ugent.be/~jppauwel/mirex2009/RUSUSL.task1.overlap.albums.csv J.T.Reed,Yushi Ueda,S.Siniscalchi,Yuki Uchiyama,Shigeki Sagayama,C.H.Lee]<br />
 
'''RUSUSL''' = [http://users.elis.ugent.be/~jppauwel/mirex2009/RUSUSL.task1.overlap.albums.csv J.T.Reed,Yushi Ueda,S.Siniscalchi,Yuki Uchiyama,Shigeki Sagayama,C.H.Lee]<br />
Line 27: Line 38:
 
'''WEJ3''' = [http://users.elis.ugent.be/~jppauwel/mirex2009/WEJ3.task1.overlap.albums.csv Adrian Weller, Daniel Ellis, Tony Jebara]<br />
 
'''WEJ3''' = [http://users.elis.ugent.be/~jppauwel/mirex2009/WEJ3.task1.overlap.albums.csv Adrian Weller, Daniel Ellis, Tony Jebara]<br />
 
'''WEJ4''' = [http://users.elis.ugent.be/~jppauwel/mirex2009/WEJ4.task1.overlap.albums.csv Adrian Weller, Daniel Ellis, Tony Jebara]<br />
 
'''WEJ4''' = [http://users.elis.ugent.be/~jppauwel/mirex2009/WEJ4.task1.overlap.albums.csv Adrian Weller, Daniel Ellis, Tony Jebara]<br />
 +
 +
==Method==
 +
A Python script was made which takes the csv-files from the [[2009:Audio_Chord_Detection_Results | results page]] as input, retrieves the corresponding album for each song in a dictionary, orders the songs according to the album, calculates the weighted average for each album and finally writes these to a new csv-file.<br />
 +
The script was written for Python 2.6 and is available for [[http://users.elis.ugent.be/~jppauwel/mirex2009/mirexChordResultsRewriter.py download]]. Feel free to modify/expand it.

Latest revision as of 18:52, 13 May 2010

Johan will post the results of his per album analysis as soon as he figures out the Wiki syntax, so come back later

Introduction

In order to compare the results of MIREX 2009 with those of MIREX 2008, the performance on just the Beatles data has te be known. The score per song has been given, but the album metadata is unavailable in the results file, which makes it less than trivial to sort the songs per album. Therefore I wrote a script which does exactly that. To save anyone else the trouble, the results as well as the scripts are posted here. --Johan

Task 1

Overview per artist

file /nema-raid/www/mirex/results/2009/http://users.elis.ugent.be/~jppauwel/mirex2009/task1.overlap.artists.csv not found

Overview per artist (merged maj/min)

file /nema-raid/www/mirex/results/2009/http://users.elis.ugent.be/~jppauwel/mirex2009/task1.overlap.artists.merged.csv not found

Detailed results per album

CH = Christopher Harte
DE = Dan Ellis
KO1 = Maksim Khadkevich, Maurizio Omologo
KO2 = Maksim Khadkevich, Maurizio Omologo
MD = Matthias Mauch, Katy Noland, Simon Dixon
OGF1 = Laurent Oudre, Yves Grenier,Cedric Fevotte (majmin)
OGF2 = Laurent Oudre, Yves Grenier,Cedric Fevotte (majmin7)
PP = Helene Papadopoulos, Geoffroy Peeters
PVM1 = Johan Pauwels, Matthias Varewyck,Jean-Pierre Martens
PVM2 = Johan Pauwels, Matthias Varewyck,Jean-Pierre Martens
RRHS1 = Thomas Rocher, Matthias Robine, Pierre Hanna,Robert Strandh
RRHS2 = Thomas Rocher, Matthias Robine, Pierre Hanna,Robert Strandh
RRHS3 = Thomas Rocher, Matthias Robine, Pierre Hanna,Robert Strandh

Task 2

Overview per artist

file /nema-raid/www/mirex/results/2009/http://users.elis.ugent.be/~jppauwel/mirex2009/task2.overlap.artists.csv not found

Overview per artist (merged maj/min)

file /nema-raid/www/mirex/results/2009/http://users.elis.ugent.be/~jppauwel/mirex2009/task2.overlap.artists.merged.csv not found

Detailed results per album

RUSUSL = J.T.Reed,Yushi Ueda,S.Siniscalchi,Yuki Uchiyama,Shigeki Sagayama,C.H.Lee
WEJ1 = Adrian Weller, Daniel Ellis, Tony Jebara
WEJ2 = Adrian Weller, Daniel Ellis, Tony Jebara
WEJ3 = Adrian Weller, Daniel Ellis, Tony Jebara
WEJ4 = Adrian Weller, Daniel Ellis, Tony Jebara

Method

A Python script was made which takes the csv-files from the results page as input, retrieves the corresponding album for each song in a dictionary, orders the songs according to the album, calculates the weighted average for each album and finally writes these to a new csv-file.
The script was written for Python 2.6 and is available for [download]. Feel free to modify/expand it.