Difference between revisions of "2009:Audio Cover Song Identification Results"

From MIREX Wiki
(Individual Results Files)
(Individual Results Files)
Line 49: Line 49:
 
==Individual Results Files==
 
==Individual Results Files==
  
[https://music-ir.org/mirex/2009/results/cover/RE.mix.avgprec.txt]
+
===Mixed===
[https://music-ir.org/mirex/2009/results/cover/RE.mix.ranklist.txt]
+
'''Average Precision'''
 +
'''RE''' : [https://music-ir.org/mirex/2009/results/cover/RE.mix.avgprec.txt S. Ravuri]
 +
'''SZA''' : [https://music-ir.org/mirex/2009/results/cover/SZA.mix.avgprec.txt J. Serra et al.]
 +
'''TA''' : [https://music-ir.org/mirex/2009/results/cover/TA.mix.avgprec.txt T. Ahonen]
  
[https://music-ir.org/mirex/2009/results/cover/SZA.mix.avgprec.txt]
+
'''Rank Lists'''
[https://music-ir.org/mirex/2009/results/cover/SZA.mix.ranklist.txt]
+
'''RE''' : [https://music-ir.org/mirex/2009/results/cover/RE.mix.ranklist.txt S. Ravuri]
 +
'''SZA''' : [https://music-ir.org/mirex/2009/results/cover/SZA.mix.ranklist.txt J. Serra et al.]
 +
'''TA''' : [https://music-ir.org/mirex/2009/results/cover/TA.mix.ranklist.txt T. Ahonen]
  
[https://music-ir.org/mirex/2009/results/cover/TA.mix.avgprec.txt]
 
[https://music-ir.org/mirex/2009/results/cover/TA.mix.ranklist.txt]
 
  
 +
===Mazurkas===
 +
'''Average Precision'''
 +
'''RE''' : [https://music-ir.org/mirex/2009/results/cover/RE.maz.avgprec.txt S. Ravuri]
 +
'''SZA''' : [https://music-ir.org/mirex/2009/results/cover/SZA.maz.avgprec.txt J. Serra et al.]
 +
'''TA''' : [https://music-ir.org/mirex/2009/results/cover/TA.maz.avgprec.txt T. Ahonen]
  
[https://music-ir.org/mirex/2009/results/cover/RE.maz.avgprec.txt]
+
'''Rank Lists'''
[https://music-ir.org/mirex/2009/results/cover/RE.maz.ranklist.txt]
+
'''RE''' : [https://music-ir.org/mirex/2009/results/cover/RE.maz.ranklist.txt S. Ravuri]
 
+
'''SZA''' : [https://music-ir.org/mirex/2009/results/cover/SZA.maz.ranklist.txt J. Serra et al.]
[https://music-ir.org/mirex/2009/results/cover/SZA.maz.avgprec.txt]
+
'''TA''' : [https://music-ir.org/mirex/2009/results/cover/TA.maz.ranklist.txt T. Ahonen]
[https://music-ir.org/mirex/2009/results/cover/SZA.maz.ranklist.txt]
 
 
 
[https://music-ir.org/mirex/2009/results/cover/TA.maz.avgprec.txt]
 
[https://music-ir.org/mirex/2009/results/cover/TA.maz.ranklist.txt]
 
  
  
 
[[Category: Results]]
 
[[Category: Results]]

Revision as of 16:30, 9 October 2009

Introduction

General Legend

Team ID

RE Suman Ravuri

SZA Joan Serr`a1,2, Massimiliano Zanin3, and Ralph G. Andrzejak2

TA Teppo E. Ahonen

Results

Mixed

Summary results file /nema-raid/www/mirex/results//cover/coversong.mixed.summary.csv not found

Number of Correct Covers at Rank X Returned in Top Ten file /nema-raid/www/mirex/results/cover/coversong.toptendist.mixed.csv not found

Mazurakas

Summary results file /nema-raid/www/mirex/results//cover/coversong.mazurka.summary.csv not found

Number of Correct Covers at Rank X Returned in Top Ten file /nema-raid/www/mirex/results/cover/coversong.toptendist.mazurka.csv not found

Run Times

Friedman's Test for Significant Differences

The Friedman test was run in MATLAB against the Average Precision summary data over the 30 song groups.
Command: [c,m,h,gnames] = multcompare(stats, 'ctype', 'tukey-kramer','estimate', 'friedman', 'alpha', 0.05);

file /nema-raid/www/mirex/results/cover/coversong.friedman.anova.csv not found

file /nema-raid/www/mirex/results/cover/coversong.friedman.csv not found

File:Coversong.friedman.png

Average Performance per Query Group

These are the arithmetic means of the average precisions within each of the 30 query groups.

file /nema-raid/www/mirex/results/cover/cover.mapquerygroup.v2.csv not found

Individual Results Files

Mixed

Average Precision RE : S. Ravuri SZA : J. Serra et al. TA : T. Ahonen

Rank Lists RE : S. Ravuri SZA : J. Serra et al. TA : T. Ahonen


Mazurkas

Average Precision RE : S. Ravuri SZA : J. Serra et al. TA : T. Ahonen

Rank Lists RE : S. Ravuri SZA : J. Serra et al. TA : T. Ahonen