Difference between revisions of "2007:Audio Artist Identification Results"

From MIREX Wiki
(Team ID)
 
(21 intermediate revisions by 5 users not shown)
Line 1: Line 1:
[[Category: Results]]
 
 
==Introduction==
 
==Introduction==
These are the results for the 2007 running of the Audio Artist Identification task. For background information about this task set please refer to the [[Audio Artist Identification]] page.
+
These are the results for the 2007 running of the Audio Artist Identification task. For background information about this task set please refer to the [[2007:Audio Artist Identification]] page. The data set was 3060 30 second clips representing 102 different recording artists.
  
 
===General Legend===
 
===General Legend===
 
====Team ID====
 
====Team ID====
'''MM''' = [https://www.music-ir.org/evaluation/MIREX/2007_abstracts/AI_mandel.pdf Michael Mandel]<br />
+
'''ME''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_mandel.pdf Michael I. Mandel, Daniel P. W. Ellis]<br />
'''TL''' = [https://www.music-ir.org/evaluation/MIREX/2007_abstracts/AI_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa and Jose Manuel Inesta]<br />
+
'''TL''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel Iñesta]<br />
'''GT''' = [https://www.music-ir.org/evaluation/MIREX/2007_abstracts/AI_tzanetakis.pdf George Tzanetakis]<br />
+
'''GT''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_tzanetakis.pdf George Tzanetakis]<br />
'''KL''' = [https://www.music-ir.org/evaluation/MIREX/2007_abstracts/AI_lee.pdf Kyogu Lee]<br />
+
'''KL''' = Kyogu Lee<br />
'''IM''' = [https://www.music-ir.org/evaluation/MIREX/2007_abstracts/AI_imirsel.pdf IMIRSEL]<br />
+
'''IM''' = IMIRSEL M2K<br />
 +
 
 +
==Overall Summary Results==
 +
===MIREX 2007 Audio Artist Classification Summary Results - Raw Classification Accuracy Averaged Over Three Train/Test Folds===
 +
 
 +
<csv>2007/artist.results.csv</csv>
 +
 
 +
 
 +
===MIREX 2007 Audio Artist Classification Evaluation Logs and Confusion Matrices===
 +
[https://www.music-ir.org/mirex/results/2007/aa_imirsel_knn.eval.txt IM_knn]<br />
 +
[https://www.music-ir.org/mirex/results/2007/aa_imirsel_svm.eval.txt IM_svm]<br />
 +
[https://www.music-ir.org/mirex/results/2007/aa_lee.eval.txt KL]<br />
 +
[https://www.music-ir.org/mirex/results/2007/aa_lidy.eval.txt TL]<br />
 +
[https://www.music-ir.org/mirex/results/2007/aa_mandel_1.eval.txt ME]<br />
 +
[https://www.music-ir.org/mirex/results/2007/aa_mandel_2_spec.eval.txt ME_spec]<br />
 +
[https://www.music-ir.org/mirex/results/2007/aa_tzan.eval.txt GT]<br />
 +
 
 +
===MIREX 2007 Audio Artist Classification Run Times===
 +
 
 +
<csv>2007/artist.runtime.csv</csv>
 +
 
 +
[[Category: Results]]

Latest revision as of 17:28, 23 July 2010

Introduction

These are the results for the 2007 running of the Audio Artist Identification task. For background information about this task set please refer to the 2007:Audio Artist Identification page. The data set was 3060 30 second clips representing 102 different recording artists.

General Legend

Team ID

ME = Michael I. Mandel, Daniel P. W. Ellis
TL = Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel Iñesta
GT = George Tzanetakis
KL = Kyogu Lee
IM = IMIRSEL M2K

Overall Summary Results

MIREX 2007 Audio Artist Classification Summary Results - Raw Classification Accuracy Averaged Over Three Train/Test Folds

Participant Avg. Raw Classification Accuracy
IM_knn 35.29%
IM_svm 48.14%
KL 9.71%
TL 38.76%
ME 40.46%
ME_spec 47.16%
GT 36.70%

download these results as csv


MIREX 2007 Audio Artist Classification Evaluation Logs and Confusion Matrices

IM_knn
IM_svm
KL
TL
ME
ME_spec
GT

MIREX 2007 Audio Artist Classification Run Times

Participant Runtime (sec) / Fold
IM-knn Feat Ex: 2760 Train/Classify: 245
IM-svm Feat Ex: 2760 Train/Classify: 188
KL Feat Ex: 1806 Train/Classify: 4664
TL Feat Ex: 23631 Train/Classify: 4764
ME Feat Ex: 3403 Train/Classify: 65
ME_spec Feat Ex: 3382 Train/Classify: 64
GT Feat Ex/Train/Classify: 632

download these results as csv