Difference between revisions of "2007:Audio Artist Identification Results"
From MIREX Wiki
(→Team ID) |
(→Team ID) |
||
(15 intermediate revisions by 5 users not shown) | |||
Line 1: | Line 1: | ||
==Introduction== | ==Introduction== | ||
− | These are the results for the 2007 running of the Audio Artist Identification task. For background information about this task set please refer to the [[Audio Artist Identification]] page. | + | These are the results for the 2007 running of the Audio Artist Identification task. For background information about this task set please refer to the [[2007:Audio Artist Identification]] page. The data set was 3060 30 second clips representing 102 different recording artists. |
===General Legend=== | ===General Legend=== | ||
====Team ID==== | ====Team ID==== | ||
− | '''ME''' = [https://www.music-ir.org/ | + | '''ME''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_mandel.pdf Michael I. Mandel, Daniel P. W. Ellis]<br /> |
− | '''TL''' = [https://www.music-ir.org/ | + | '''TL''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel Iñesta]<br /> |
− | '''GT''' = [https://www.music-ir.org/ | + | '''GT''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_tzanetakis.pdf George Tzanetakis]<br /> |
'''KL''' = Kyogu Lee<br /> | '''KL''' = Kyogu Lee<br /> | ||
'''IM''' = IMIRSEL M2K<br /> | '''IM''' = IMIRSEL M2K<br /> | ||
+ | |||
+ | ==Overall Summary Results== | ||
+ | ===MIREX 2007 Audio Artist Classification Summary Results - Raw Classification Accuracy Averaged Over Three Train/Test Folds=== | ||
+ | |||
+ | <csv>2007/artist.results.csv</csv> | ||
+ | |||
+ | |||
+ | ===MIREX 2007 Audio Artist Classification Evaluation Logs and Confusion Matrices=== | ||
+ | [https://www.music-ir.org/mirex/results/2007/aa_imirsel_knn.eval.txt IM_knn]<br /> | ||
+ | [https://www.music-ir.org/mirex/results/2007/aa_imirsel_svm.eval.txt IM_svm]<br /> | ||
+ | [https://www.music-ir.org/mirex/results/2007/aa_lee.eval.txt KL]<br /> | ||
+ | [https://www.music-ir.org/mirex/results/2007/aa_lidy.eval.txt TL]<br /> | ||
+ | [https://www.music-ir.org/mirex/results/2007/aa_mandel_1.eval.txt ME]<br /> | ||
+ | [https://www.music-ir.org/mirex/results/2007/aa_mandel_2_spec.eval.txt ME_spec]<br /> | ||
+ | [https://www.music-ir.org/mirex/results/2007/aa_tzan.eval.txt GT]<br /> | ||
+ | |||
+ | ===MIREX 2007 Audio Artist Classification Run Times=== | ||
+ | |||
+ | <csv>2007/artist.runtime.csv</csv> | ||
[[Category: Results]] | [[Category: Results]] |
Latest revision as of 17:28, 23 July 2010
Contents
Introduction
These are the results for the 2007 running of the Audio Artist Identification task. For background information about this task set please refer to the 2007:Audio Artist Identification page. The data set was 3060 30 second clips representing 102 different recording artists.
General Legend
Team ID
ME = Michael I. Mandel, Daniel P. W. Ellis
TL = Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel Iñesta
GT = George Tzanetakis
KL = Kyogu Lee
IM = IMIRSEL M2K
Overall Summary Results
MIREX 2007 Audio Artist Classification Summary Results - Raw Classification Accuracy Averaged Over Three Train/Test Folds
Participant | Avg. Raw Classification Accuracy |
---|---|
IM_knn | 35.29% |
IM_svm | 48.14% |
KL | 9.71% |
TL | 38.76% |
ME | 40.46% |
ME_spec | 47.16% |
GT | 36.70% |
MIREX 2007 Audio Artist Classification Evaluation Logs and Confusion Matrices
IM_knn
IM_svm
KL
TL
ME
ME_spec
GT
MIREX 2007 Audio Artist Classification Run Times
Participant | Runtime (sec) / Fold |
---|---|
IM-knn | Feat Ex: 2760 Train/Classify: 245 |
IM-svm | Feat Ex: 2760 Train/Classify: 188 |
KL | Feat Ex: 1806 Train/Classify: 4664 |
TL | Feat Ex: 23631 Train/Classify: 4764 |
ME | Feat Ex: 3403 Train/Classify: 65 |
ME_spec | Feat Ex: 3382 Train/Classify: 64 |
GT | Feat Ex/Train/Classify: 632 |