================================================================================ Model name: ag_imirsel_knn Number of iterations = 3 -------------------------------------------------------------------------------- Iteration 1 Accuracy: 53.79% Accuracy (normalised for class sizes): 53.79% Hierachical Accuracy: 64.29% Hierachical Accuracy (normalised for class sizes): 64.28% Raw Confusion Matrix: Truth A B C D E F G H I J Classification A 133 0 15 4 1 4 1 2 0 45 B 0 86 1 2 4 14 0 0 1 0 C 49 20 115 5 0 11 1 0 1 86 D 17 20 0 145 15 20 8 3 61 6 E 0 0 0 0 77 0 0 10 0 0 F 3 70 1 19 6 144 0 1 1 0 G 0 1 0 2 42 0 156 31 26 0 H 0 0 0 0 45 0 2 165 2 0 I 14 15 0 47 34 20 65 20 140 2 J 18 21 102 10 9 20 1 0 1 94 Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 56.84% 0.00% 6.41% 1.71% 0.43% 1.72% 0.43% 0.86% 0.00% 19.31% B 0.00% 36.91% 0.43% 0.85% 1.72% 6.01% 0.00% 0.00% 0.43% 0.00% C 20.94% 8.58% 49.15% 2.14% 0.00% 4.72% 0.43% 0.00% 0.43% 36.91% D 7.26% 8.58% 0.00% 61.97% 6.44% 8.58% 3.42% 1.29% 26.18% 2.58% E 0.00% 0.00% 0.00% 0.00% 33.05% 0.00% 0.00% 4.31% 0.00% 0.00% F 1.28% 30.04% 0.43% 8.12% 2.58% 61.80% 0.00% 0.43% 0.43% 0.00% G 0.00% 0.43% 0.00% 0.85% 18.03% 0.00% 66.67% 13.36% 11.16% 0.00% H 0.00% 0.00% 0.00% 0.00% 19.31% 0.00% 0.85% 71.12% 0.86% 0.00% I 5.98% 6.44% 0.00% 20.09% 14.59% 8.58% 27.78% 8.62% 60.09% 0.86% J 7.69% 9.01% 43.59% 4.27% 3.86% 8.58% 0.43% 0.00% 0.43% 40.34% Matrix Key: A : BAROQUE B : BLUES C : CLASSICAL D : COUNTRY E : EDANCE F : JAZZ G : METAL H : RAPHIPHOP I : ROCKROLL J : ROMANTIC Discounted Confusion Matrix: Truth A B C D E F G H I J Classification A 166.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 121.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 173.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 145.00 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 77.00 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 151.00 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 188.50 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 165.00 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 153.00 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 159.50 Discounted Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 0.71 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 0.52 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 0.74 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 0.62 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 0.33 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 0.65 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 0.81 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.71 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.66 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.68 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- Iteration 2 Accuracy: 55.23% Accuracy (normalised for class sizes): 55.21% Hierachical Accuracy: 65.21% Hierachical Accuracy (normalised for class sizes): 65.17% Raw Confusion Matrix: Truth A B C D E F G H I J Classification A 135 4 29 6 2 1 1 1 6 10 B 0 98 0 7 1 31 0 0 4 0 C 45 11 173 7 4 17 1 0 2 93 D 1 26 0 136 17 16 8 16 50 0 E 0 0 0 0 44 0 2 11 0 0 F 2 69 0 18 10 131 1 0 10 0 G 0 0 0 6 48 0 173 15 66 0 H 0 0 0 1 47 0 3 184 2 0 I 0 6 0 39 53 18 40 6 82 0 J 51 19 32 13 7 19 3 1 10 133 Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 57.69% 1.72% 12.39% 2.58% 0.86% 0.43% 0.43% 0.43% 2.59% 4.24% B 0.00% 42.06% 0.00% 3.00% 0.43% 13.30% 0.00% 0.00% 1.72% 0.00% C 19.23% 4.72% 73.93% 3.00% 1.72% 7.30% 0.43% 0.00% 0.86% 39.41% D 0.43% 11.16% 0.00% 58.37% 7.30% 6.87% 3.45% 6.84% 21.55% 0.00% E 0.00% 0.00% 0.00% 0.00% 18.88% 0.00% 0.86% 4.70% 0.00% 0.00% F 0.85% 29.61% 0.00% 7.73% 4.29% 56.22% 0.43% 0.00% 4.31% 0.00% G 0.00% 0.00% 0.00% 2.58% 20.60% 0.00% 74.57% 6.41% 28.45% 0.00% H 0.00% 0.00% 0.00% 0.43% 20.17% 0.00% 1.29% 78.63% 0.86% 0.00% I 0.00% 2.58% 0.00% 16.74% 22.75% 7.73% 17.24% 2.56% 35.34% 0.00% J 21.79% 8.15% 13.68% 5.58% 3.00% 8.15% 1.29% 0.43% 4.31% 56.36% Matrix Key: A : BAROQUE B : BLUES C : CLASSICAL D : COUNTRY E : EDANCE F : JAZZ G : METAL H : RAPHIPHOP I : ROCKROLL J : ROMANTIC Discounted Confusion Matrix: Truth A B C D E F G H I J Classification A 183.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 132.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 203.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 136.00 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 44.00 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 146.50 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 193.00 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 184.00 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 115.00 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 184.50 Discounted Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 0.78 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 0.57 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 0.87 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 0.58 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 0.19 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 0.63 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 0.83 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.79 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.50 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.78 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- Iteration 3 Accuracy: 55.59% Accuracy (normalised for class sizes): 55.61% Hierachical Accuracy: 64.98% Hierachical Accuracy (normalised for class sizes): 65.02% Raw Confusion Matrix: Truth A B C D E F G H I J Classification A 133 1 22 8 0 9 3 0 2 51 B 0 92 0 3 0 17 3 1 1 0 C 60 16 166 10 3 15 1 1 1 44 D 1 24 1 126 17 41 2 6 38 1 E 0 1 0 0 62 4 0 17 1 0 F 2 73 0 17 5 105 2 2 5 2 G 0 2 0 5 87 4 187 25 61 1 H 0 0 0 0 37 1 4 171 0 0 I 0 5 0 51 21 13 31 11 124 1 J 36 20 43 13 2 25 1 0 2 131 Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 57.33% 0.43% 9.48% 3.43% 0.00% 3.85% 1.28% 0.00% 0.85% 22.08% B 0.00% 39.32% 0.00% 1.29% 0.00% 7.26% 1.28% 0.43% 0.43% 0.00% C 25.86% 6.84% 71.55% 4.29% 1.28% 6.41% 0.43% 0.43% 0.43% 19.05% D 0.43% 10.26% 0.43% 54.08% 7.26% 17.52% 0.85% 2.56% 16.17% 0.43% E 0.00% 0.43% 0.00% 0.00% 26.50% 1.71% 0.00% 7.26% 0.43% 0.00% F 0.86% 31.20% 0.00% 7.30% 2.14% 44.87% 0.85% 0.85% 2.13% 0.87% G 0.00% 0.85% 0.00% 2.15% 37.18% 1.71% 79.91% 10.68% 25.96% 0.43% H 0.00% 0.00% 0.00% 0.00% 15.81% 0.43% 1.71% 73.08% 0.00% 0.00% I 0.00% 2.14% 0.00% 21.89% 8.97% 5.56% 13.25% 4.70% 52.77% 0.43% J 15.52% 8.55% 18.53% 5.58% 0.85% 10.68% 0.43% 0.00% 0.85% 56.71% Matrix Key: A : BAROQUE B : BLUES C : CLASSICAL D : COUNTRY E : EDANCE F : JAZZ G : METAL H : RAPHIPHOP I : ROCKROLL J : ROMANTIC Discounted Confusion Matrix: Truth A B C D E F G H I J Classification A 181.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 128.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 198.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 126.00 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 62.00 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 113.50 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 202.50 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 171.00 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 154.50 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 178.50 Discounted Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 0.78 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 0.55 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 0.86 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 0.54 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 0.26 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 0.49 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 0.87 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.73 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.66 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.77 -------------------------------------------------------------------------------- ================================================================================ Overall Evaluation for ag_imirsel_knn -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- Overall Accuracy ag_imirsel_knn: 54.87% Standard Deviation: 0.45 Overall Accuracy (normalised for class sizes) ag_imirsel_knn: 54.87% Standard Deviation: 0.45 Hierachical Accuracy: 64.83% Standard Deviation: 0.22 Hierachical Accuracy (normalised for class sizes): 0.6482857142857144% Standard Deviation: 0.22 Raw Confusion Matrix: Truth A B C D E F G H I J Classification A 401 5 66 18 3 14 5 3 8 106 B 0 276 1 12 5 62 3 1 6 0 C 154 47 454 22 7 43 3 1 4 223 D 19 70 1 407 49 77 18 25 149 7 E 0 1 0 0 183 4 2 38 1 0 F 7 212 1 54 21 380 3 3 16 2 G 0 3 0 13 177 4 516 71 153 1 H 0 0 0 1 129 1 9 520 4 0 I 14 26 0 137 108 51 136 37 346 3 J 105 60 177 36 18 64 5 1 13 358 Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 57.29% 0.71% 9.43% 2.57% 0.43% 2.00% 0.71% 0.43% 1.14% 15.14% B 0.00% 39.43% 0.14% 1.71% 0.71% 8.86% 0.43% 0.14% 0.86% 0.00% C 22.00% 6.71% 64.86% 3.14% 1.00% 6.14% 0.43% 0.14% 0.57% 31.86% D 2.71% 10.00% 0.14% 58.14% 7.00% 11.00% 2.57% 3.57% 21.29% 1.00% E 0.00% 0.14% 0.00% 0.00% 26.14% 0.57% 0.29% 5.43% 0.14% 0.00% F 1.00% 30.29% 0.14% 7.71% 3.00% 54.29% 0.43% 0.43% 2.29% 0.29% G 0.00% 0.43% 0.00% 1.86% 25.29% 0.57% 73.71% 10.14% 21.86% 0.14% H 0.00% 0.00% 0.00% 0.14% 18.43% 0.14% 1.29% 74.29% 0.57% 0.00% I 2.00% 3.71% 0.00% 19.57% 15.43% 7.29% 19.43% 5.29% 49.43% 0.43% J 15.00% 8.57% 25.29% 5.14% 2.57% 9.14% 0.71% 0.14% 1.86% 51.14% Matrix Key: A : BAROQUE B : BLUES C : CLASSICAL D : COUNTRY E : EDANCE F : JAZZ G : METAL H : RAPHIPHOP I : ROCKROLL J : ROMANTIC Discounted Confusion Matrix: Truth A B C D E F G H I J Classification A 530.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 382.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 575.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 407.00 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 183.00 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 411.00 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 584.00 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 520.00 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 422.50 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 522.50 Discounted Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 0.76 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 0.55 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 0.82 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 0.58 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 0.26 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 0.59 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 0.83 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.74 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.60 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.75 --------------------------------------------------------------------------------