Difference between revisions of "2007:Audio Cover Song Identification Results"

From MIREX Wiki
Line 1: Line 1:
[[Category: Results]]
 
 
This is a placeholder template
 
This is a placeholder template
  
Line 11: Line 10:
 
====Team ID====
 
====Team ID====
  
'''SG''' = [https://www.music-ir.org/evaluation/MIREX/2007_abstracts/CS_serra.pdf Joan Serrà and Emilia Gómez]<br />
+
'''SG''' = [https://www.music-ir.org/mirex2007/abs/CS_serra.pdf Joan Serrà, Emilia Gómez]<br />
'''KP''' = [https://www.music-ir.org/evaluation/MIREX/2007_abstracts/CS_kim.pdf Youngmoo E. Kim and Daniel Perelstein] <br />
+
'''KP''' = [https://www.music-ir.org/mirex2007/abs/CS_kim.pdf Youngmoo E. Kim, Daniel Perelstein] <br />
'''EC''' = [https://www.music-ir.org/evaluation/MIREX/2007_abstracts/CS_ellis.pdf Daniel P. W. Ellis and Courtenay V. Cotton]<br />
+
'''EC''' = [https://www.music-ir.org/mirex2007/abs/CS_ellis.pdf Daniel P. W. Ellis, Courtenay V. Cotton]<br />
'''KL1''' = [https://www.music-ir.org/evaluation/MIREX/2007_abstracts/CS_lee.pdf Kyogu Lee]<br />
+
'''KL1''' = Kyogu Lee 1<br />
'''KL2''' = [https://www.music-ir.org/evaluation/MIREX/2007_abstracts/CS_lee.pdf Kyogu Lee 2]<br />
+
'''KL2''' = Kyogu Lee 2<br />
'''JEC''' = [https://www.music-ir.org/evaluation/MIREX/2007_abstracts/CS_jensen.pdf Jesper H├╕jvang Jensen, Daniel P. W. Ellis, Mads G. Christensen, S├╕ren Holdt]<br />
+
'''JEC''' = [https://www.music-ir.org/mirex2007/abs/CS_jensen.pdf Jesper H├╕jvang Jensen, Daniel P. W. Ellis, Mads G. Christensen, S├╕ren Holdt]<br />
'''M2K''' = [https://www.music-ir.org/evaluation/MIREX/2007_abstracts/CS_imirsel.pdf IMIRSEL Lab's M2K Algo]<br/>
+
'''M2K''' = IMIRSEL M2K<br/>
  
  
Line 30: Line 29:
 
<csv>cover_song_sum_friedman.csv</csv>
 
<csv>cover_song_sum_friedman.csv</csv>
 
<csv>audiocover_friedman_mrr.csv</csv>
 
<csv>audiocover_friedman_mrr.csv</csv>
 +
 +
[[Category: Results]]

Revision as of 18:44, 15 September 2007

This is a placeholder template

Introduction

These are the results for the 2007 running of the Audio Cover Song Identification task. For background information about this task set please refer to the Audio Cover Song page.

Each system was given a collection of 1000 songs which included of 30 different classes (sets) of cover songs where each class/set was represented by 11 different versions of a particular song. Each of the 330 cover songs were used as queries and the systems were required to return 10 results for each query. Systems were evaluated on the number of the songs from the same class/set as the query that were returned in the list of 10 results for each query.


General Legend

Team ID

SG = Joan Serrà, Emilia Gómez
KP = Youngmoo E. Kim, Daniel Perelstein
EC = Daniel P. W. Ellis, Courtenay V. Cotton
KL1 = Kyogu Lee 1
KL2 = Kyogu Lee 2
JEC = Jesper H├╕jvang Jensen, Daniel P. W. Ellis, Mads G. Christensen, S├╕ren Holdt
M2K = IMIRSEL M2K


Overall Summary Results

file /nema-raid/www/mirex/results/cover.overall.stats.csv not found Detailed Average Precision results, and rank lists can be found on the Audio Cover Song Identification Results - Details page

file /nema-raid/www/mirex/results/cover.rank.distributions.csv not found

The Friedman test was run in MATLAB against the Average Precision summary data over the 30 song groups.
Command: [c,m,h,gnames] = multcompare(stats, 'ctype', 'tukey-kramer','estimate', 'friedman', 'alpha', 0.05);

file /nema-raid/www/mirex/results/cover_song_sum_friedman.csv not found file /nema-raid/www/mirex/results/audiocover_friedman_mrr.csv not found