Difference between revisions of "2005:Symbolic Genre Classification Results"
From MIREX Wiki
(→Results) |
|||
Line 17: | Line 17: | ||
|---- | |---- | ||
|1 | |1 | ||
− | |McKay & Fujinaga | + | |[https://www.music-ir.org/mirex/abstracts/2005/mckay.pdf McKay & Fujinaga] |
|77.17% | |77.17% | ||
|65.28% | |65.28% | ||
|---- | |---- | ||
|2 | |2 | ||
− | |Basili, Serafini, & Stellato (NB) | + | |[https://www.music-ir.org/mirex/abstracts/2005/basili.pdf Basili, Serafini, & Stellato (NB)] |
|72.08% | |72.08% | ||
|58.53% | |58.53% | ||
Line 32: | Line 32: | ||
|---- | |---- | ||
|4 | |4 | ||
− | |Basili, Serafini, & Stellato (J48) | + | |[https://www.music-ir.org/mirex/abstracts/2005/basili.pdf Basili, Serafini, & Stellato (J48)] |
|67.14% | |67.14% | ||
|53.14% | |53.14% | ||
|---- | |---- | ||
|5 | |5 | ||
− | |Ponce de Leon & Inesta | + | |[https://www.music-ir.org/mirex/abstracts/2005/ponce.pdf Ponce de Leon & Inesta] |
|37.76% | |37.76% | ||
|26.52% | |26.52% | ||
Line 66: | Line 66: | ||
|3 days | |3 days | ||
|R | |R | ||
− | |MF_38eval.txt | + | |[https://www.music-ir.org/mirex/abstracts/2005/sym-genre/MF_38eval.txt |
|---- | |---- | ||
|2 | |2 | ||
Line 76: | Line 76: | ||
|N/A | |N/A | ||
|N/A | |N/A | ||
− | |BST_NB_38eval.txt | + | |[https://www.music-ir.org/mirex/abstracts/2005/sym-genre/BST_NB_38eval.txt BST_NB_38eval.txt] |
|---- | |---- | ||
|3 | |3 | ||
Line 86: | Line 86: | ||
|N/A | |N/A | ||
|N/A | |N/A | ||
− | |BST_J48_38eval.txt | + | |[https://www.music-ir.org/mirex/abstracts/2005/sym-genre/BST_J48_38eval.txt BST_J48_38eval.txt] |
|---- | |---- | ||
|4 | |4 | ||
Line 96: | Line 96: | ||
|15,948 | |15,948 | ||
|G | |G | ||
− | |L_38eval.txt | + | |[https://www.music-ir.org/mirex/abstracts/2005/sym-genre/L_38eval.txt L_38eval.txt] |
|---- | |---- | ||
|5 | |5 | ||
Line 106: | Line 106: | ||
|821 | |821 | ||
|L | |L | ||
− | |PI_38eval.txt | + | |[https://www.music-ir.org/mirex/abstracts/2005/sym-genre/PI_38eval.txt PI_38eval.txt] |
|---- | |---- | ||
|} | |} | ||
Line 133: | Line 133: | ||
|18,375 | |18,375 | ||
|R | |R | ||
− | |MF_9eval.txt | + | |[https://www.music-ir.org/mirex/abstracts/2005/sym-genre/MF_9eval.txt MF_9eval.txt] |
|---- | |---- | ||
|2 | |2 | ||
Line 143: | Line 143: | ||
|N/A | |N/A | ||
|N/A | |N/A | ||
− | |BST_NB_9eval.txt | + | |[https://www.music-ir.org/mirex/abstracts/2005/sym-genre/BST_NB_9eval.txt BST_NB_9eval.txt] |
|---- | |---- | ||
|3 | |3 | ||
Line 153: | Line 153: | ||
|3,777 | |3,777 | ||
|G | |G | ||
− | |L_9eval.txt | + | |[https://www.music-ir.org/mirex/abstracts/2005/sym-genre/L_9eval.txt L_9eval.txt] |
|---- | |---- | ||
|4 | |4 | ||
Line 163: | Line 163: | ||
|N/A | |N/A | ||
|N/A | |N/A | ||
− | |BST_J48_9eval.txt | + | |[https://www.music-ir.org/mirex/abstracts/2005/sym-genre/BST_J48_9eval.txt BST_J48_9eval.txt] |
|---- | |---- | ||
|5 | |5 | ||
Line 173: | Line 173: | ||
|197 | |197 | ||
|L | |L | ||
− | |PI_9eval.txt | + | |[https://www.music-ir.org/mirex/abstracts/2005/sym-genre/PI_9eval.txt PI_9eval.txt] |
|---- | |---- | ||
|} | |} |
Revision as of 11:33, 31 July 2010
Introduction
Goal: To classify MIDI recordings into genre categories.
Dataset: Two sets of genre categories were used, one consisting of 38 categories and one consisting of 9 categories. Each category was represented by 25 MIDI files.Thus, the 38 genre test contained 950 MIDI files and the 9 genre test contained 225 MIDI files.Test runs were 3-fold crossvalidated with each algorithm tested using identical training and testing data splits.
Results
Overall
OVERALL | |||
---|---|---|---|
Rank | Participant | Mean Hierarchical Classification Accuracy | Mean Raw Classification Accuracy |
1 | McKay & Fujinaga | 77.17% | 65.28% |
2 | Basili, Serafini, & Stellato (NB) | 72.08% | 58.53% |
3 | Li, M. | 67.57% | 55.90% |
4 | Basili, Serafini, & Stellato (J48) | 67.14% | 53.14% |
5 | Ponce de Leon & Inesta | 37.76% | 26.52% |
38 Classes
38 Classes | ||||||||
---|---|---|---|---|---|---|---|---|
Rank | Participant | Hierarchical Classification Accuracy | Hierarchical Classification Accuracy Std | Raw Classification Accuracy | Raw Classification Accuracy Std | Runtime (s) | Machine | Confusion Matrix Files |
1 | McKay & Fujinaga | 64.33% | 1.04 | 46.11% | 1.51 | 3 days | R | [https://www.music-ir.org/mirex/abstracts/2005/sym-genre/MF_38eval.txt |
2 | Basili, Serafini, & Stellato (NB) | 62.60% | 0.26 | 45.05% | 0.55 | N/A | N/A | BST_NB_38eval.txt |
3 | Basili, Serafini, & Stellato (J48) | 57.61% | 1.14 | 40.95% | 1.35 | N/A | N/A | BST_J48_38eval.txt |
4 | Li, M. | 54.91% | 0.66 | 39.79% | 0.87 | 15,948 | G | L_38eval.txt |
5 | Ponce de Leon & Inesta | 24.84% | 1.40 | 15.26% | 1.13 | 821 | L | PI_38eval.txt |
9 Classes
9 Classes | ||||||||
---|---|---|---|---|---|---|---|---|
Rank | Participant | Hierarchical Classification Accuracy | Hierarchical Classification Accuracy Std | Raw Classification Accuracy | Raw Classification Accuracy Std | Runtime (s) | Machine | Confusion Matrix Files |
1 | McKay & Fujinaga | 90.00% | 0.60 | 84.44% | 1.41 | 18,375 | R | MF_9eval.txt |
2 | Basili, Serafini, & Stellato (NB) | 81.56% | 0.76 | 72.00% | 0.88 | N/A | N/A | BST_NB_9eval.txt |
3 | Li, M. | 80.22% | 1.47 | 72.00% | 2.31 | 3,777 | G | L_9eval.txt |
4 | Basili, Serafini, & Stellato (J48) | 76.67% | 1.11 | 65.33% | 1.65 | N/A | N/A | BST_J48_9eval.txt |
5 | Ponce de Leon & Inesta | 50.67% | 1.26 | 37.78% | 2.30 | 197 | L | PI_9eval.txt |