Difference between revisions of "2007:Audio Genre Classification Results"
From MIREX Wiki
(→Introduction) |
(→Team ID) |
||
| (11 intermediate revisions by 5 users not shown) | |||
| Line 1: | Line 1: | ||
==Introduction== | ==Introduction== | ||
| − | These are the results for the 2007 running of the Audio Genre Classification task. For background information about this task set please refer to the [[Audio Genre Classification]] page. The data set consisted of 7000 30 second clips | + | These are the results for the 2007 running of the Audio Genre Classification task. For background information about this task set please refer to the [[2007:Audio Genre Classification]] page. The data set consisted of 7000 30 second clips covering the following genres (700 tracks per genre): |
| − | A : BAROQUE< | + | A : BAROQUE<br /> |
| − | B : BLUES< | + | B : BLUES<br /> |
| − | C : CLASSICAL< | + | C : CLASSICAL<br /> |
| − | D : COUNTRY< | + | D : COUNTRY<br /> |
| − | E : EDANCE< | + | E : EDANCE<br /> |
| − | F : JAZZ< | + | F : JAZZ<br /> |
| − | G : METAL< | + | G : METAL<br /> |
| − | H : RAPHIPHOP< | + | H : RAPHIPHOP<br /> |
| − | I : ROCKROLL< | + | I : ROCKROLL<br /> |
| − | J : ROMANTIC< | + | J : ROMANTIC<br /> |
| + | |||
| + | Partial scores were earned for some confusions (i.e., ROCKROLL-METAL; JAZZ-BLUES, etc.) | ||
===General Legend=== | ===General Legend=== | ||
====Team ID==== | ====Team ID==== | ||
| − | '''ME''' = [https://www.music-ir.org/ | + | '''ME''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_mandel.pdf Michael I. Mandel, Daniel P. W. Ellis]<br /> |
| − | '''TL''' = [https://www.music-ir.org/ | + | '''TL''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_lidy.pdf Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel Iñesta]<br /> |
| − | '''GT''' = [https://www.music-ir.org/ | + | '''GT''' = [https://www.music-ir.org/mirex/abstracts/2007/AI_CC_GC_MC_AS_tzanetakis.pdf George Tzanetakis]<br /> |
| − | '''GH''' = [https://www.music-ir.org/ | + | '''GH''' = [https://www.music-ir.org/mirex/abstracts/2007/GC_guaus.pdf Enric Guaus, Perfecto Herrera]<br /> |
'''IM''' = IMIRSEL M2K<br /> | '''IM''' = IMIRSEL M2K<br /> | ||
| Line 24: | Line 26: | ||
===MIREX 2007 Audio Genre Classification Summary Results - Raw and Hierarchical Classification Accuracy Averaged Over Three Train/Test Folds=== | ===MIREX 2007 Audio Genre Classification Summary Results - Raw and Hierarchical Classification Accuracy Averaged Over Three Train/Test Folds=== | ||
| − | <csv>genre.results.csv</csv> | + | <csv>2007/genre.results.csv</csv> |
===MIREX 2007 Audio Genre Classification Evaluation Logs and Confusion Matrices=== | ===MIREX 2007 Audio Genre Classification Evaluation Logs and Confusion Matrices=== | ||
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/ag_guaus.eval.txt GH]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/ag_imirsel_knn.eval.txt IM_knn]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/ag_imirsel_svm.eval.txt IM_svm]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/ag_lidy.eval.txt TL]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/ag_mandel_1.eval.txt ME]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/ag_mandel_2_spec.eval.txt ME_spec]<br /> |
| − | [https://www.music-ir.org/ | + | [https://www.music-ir.org/mirex/results/2007/ag_tzan.eval.txt GT]<br /> |
===MIREX 2007 Audio Genre Classification Run Times=== | ===MIREX 2007 Audio Genre Classification Run Times=== | ||
| − | <csv>genre.runtime.csv</csv> | + | <csv>2007/genre.runtime.csv</csv> |
[[Category: Results]] | [[Category: Results]] | ||
Latest revision as of 11:47, 26 July 2010
Contents
Introduction
These are the results for the 2007 running of the Audio Genre Classification task. For background information about this task set please refer to the 2007:Audio Genre Classification page. The data set consisted of 7000 30 second clips covering the following genres (700 tracks per genre):
A : BAROQUE
B : BLUES
C : CLASSICAL
D : COUNTRY
E : EDANCE
F : JAZZ
G : METAL
H : RAPHIPHOP
I : ROCKROLL
J : ROMANTIC
Partial scores were earned for some confusions (i.e., ROCKROLL-METAL; JAZZ-BLUES, etc.)
General Legend
Team ID
ME = Michael I. Mandel, Daniel P. W. Ellis
TL = Thomas Lidy, Andreas Rauber, Antonio Pertusa, José Manuel Iñesta
GT = George Tzanetakis
GH = Enric Guaus, Perfecto Herrera
IM = IMIRSEL M2K
Overall Summary Results
MIREX 2007 Audio Genre Classification Summary Results - Raw and Hierarchical Classification Accuracy Averaged Over Three Train/Test Folds
| Participant | Avg. Hierarchical Classification Accuracy | Avg. Raw Classification Accuracy |
|---|---|---|
| GH | 71.87% | 62.89% |
| IM_knn | 64.83% | 54.87% |
| IM_svm | 76.56% | 68.29% |
| TL | 75.57% | 66.71% |
| ME | 75.03% | 66.60% |
| ME_spec | 73.57% | 65.50% |
| GT | 74.15% | 65.34% |
MIREX 2007 Audio Genre Classification Evaluation Logs and Confusion Matrices
GH
IM_knn
IM_svm
TL
ME
ME_spec
GT
MIREX 2007 Audio Genre Classification Run Times
| Participant | Runtime (sec) / Fold |
|---|---|
| GH | Feat Ex: 22740 Train/Classify: 194 |
| IM-knn | Feat Ex: 6879 Train/Classify: 1245 |
| IM-svm | Feat Ex: 6879 Train/Classify: 51 |
| TL | Feat Ex: 54192 Train/Classify: 147 |
| ME | Feat Ex: 8166 Train/Classify: 207 |
| ME_spec | Feat Ex: 8018 Train/Classify: 210 |
| GT | Feat Ex/Train/Classify: 1442 |
