================================================================================ Model name: ag_mandel_2_spec Number of iterations = 3 -------------------------------------------------------------------------------- Iteration 1 Accuracy: 62.88% Accuracy (normalised for class sizes): 62.89% Hierachical Accuracy: 72.01% Hierachical Accuracy (normalised for class sizes): 72.01% Raw Confusion Matrix: Truth A B C D E F G H I J Classification A 177 12 15 9 20 17 7 4 10 45 B 2 158 1 8 0 22 0 0 3 0 C 18 4 95 1 0 1 0 0 0 42 D 3 7 0 147 7 6 2 10 53 1 E 10 2 0 20 169 15 17 24 17 1 F 3 41 1 12 1 159 1 2 5 1 G 0 0 0 2 4 0 130 6 26 0 H 0 1 0 6 19 1 0 178 6 0 I 3 3 0 28 12 8 77 7 113 2 J 18 5 122 1 1 4 0 1 0 141 Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 75.64% 5.15% 6.41% 3.85% 8.58% 7.30% 2.99% 1.72% 4.29% 19.31% B 0.85% 67.81% 0.43% 3.42% 0.00% 9.44% 0.00% 0.00% 1.29% 0.00% C 7.69% 1.72% 40.60% 0.43% 0.00% 0.43% 0.00% 0.00% 0.00% 18.03% D 1.28% 3.00% 0.00% 62.82% 3.00% 2.58% 0.85% 4.31% 22.75% 0.43% E 4.27% 0.86% 0.00% 8.55% 72.53% 6.44% 7.26% 10.34% 7.30% 0.43% F 1.28% 17.60% 0.43% 5.13% 0.43% 68.24% 0.43% 0.86% 2.15% 0.43% G 0.00% 0.00% 0.00% 0.85% 1.72% 0.00% 55.56% 2.59% 11.16% 0.00% H 0.00% 0.43% 0.00% 2.56% 8.15% 0.43% 0.00% 76.72% 2.58% 0.00% I 1.28% 1.29% 0.00% 11.97% 5.15% 3.43% 32.91% 3.02% 48.50% 0.86% J 7.69% 2.15% 52.14% 0.43% 0.43% 1.72% 0.00% 0.43% 0.00% 60.52% Matrix Key: A : BAROQUE B : BLUES C : CLASSICAL D : COUNTRY E : EDANCE F : JAZZ G : METAL H : RAPHIPHOP I : ROCKROLL J : ROMANTIC Discounted Confusion Matrix: Truth A B C D E F G H I J Classification A 195.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 178.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 163.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 147.00 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 169.00 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 170.00 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 168.50 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 178.00 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 126.00 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 184.50 Discounted Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 0.83 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 0.77 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 0.70 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 0.63 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 0.73 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 0.73 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 0.72 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.77 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.54 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.79 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- Iteration 2 Accuracy: 67.44% Accuracy (normalised for class sizes): 67.43% Hierachical Accuracy: 74.98% Hierachical Accuracy (normalised for class sizes): 74.95% Raw Confusion Matrix: Truth A B C D E F G H I J Classification A 181 12 27 15 12 18 6 5 18 9 B 1 166 1 10 2 35 1 0 14 0 C 20 4 181 0 1 2 2 0 0 98 D 2 4 0 161 12 2 2 6 47 0 E 0 9 0 6 158 6 14 18 11 0 F 2 25 0 9 5 160 0 0 3 3 G 0 1 0 0 8 1 153 1 36 0 H 0 1 0 2 20 0 4 195 8 0 I 1 7 0 30 14 5 50 9 93 0 J 27 4 25 0 1 4 0 0 2 126 Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 77.35% 5.15% 11.54% 6.44% 5.15% 7.73% 2.59% 2.14% 7.76% 3.81% B 0.43% 71.24% 0.43% 4.29% 0.86% 15.02% 0.43% 0.00% 6.03% 0.00% C 8.55% 1.72% 77.35% 0.00% 0.43% 0.86% 0.86% 0.00% 0.00% 41.53% D 0.85% 1.72% 0.00% 69.10% 5.15% 0.86% 0.86% 2.56% 20.26% 0.00% E 0.00% 3.86% 0.00% 2.58% 67.81% 2.58% 6.03% 7.69% 4.74% 0.00% F 0.85% 10.73% 0.00% 3.86% 2.15% 68.67% 0.00% 0.00% 1.29% 1.27% G 0.00% 0.43% 0.00% 0.00% 3.43% 0.43% 65.95% 0.43% 15.52% 0.00% H 0.00% 0.43% 0.00% 0.86% 8.58% 0.00% 1.72% 83.33% 3.45% 0.00% I 0.43% 3.00% 0.00% 12.88% 6.01% 2.15% 21.55% 3.85% 40.09% 0.00% J 11.54% 1.72% 10.68% 0.00% 0.43% 1.72% 0.00% 0.00% 0.86% 53.39% Matrix Key: A : BAROQUE B : BLUES C : CLASSICAL D : COUNTRY E : EDANCE F : JAZZ G : METAL H : RAPHIPHOP I : ROCKROLL J : ROMANTIC Discounted Confusion Matrix: Truth A B C D E F G H I J Classification A 204.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 178.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 207.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 161.00 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 158.00 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 177.50 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 178.00 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 195.00 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 111.00 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 179.50 Discounted Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 0.87 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 0.77 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 0.88 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 0.69 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 0.68 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 0.76 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 0.77 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.83 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.48 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.76 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- Iteration 3 Accuracy: 66.18% Accuracy (normalised for class sizes): 66.19% Hierachical Accuracy: 73.72% Hierachical Accuracy (normalised for class sizes): 73.75% Raw Confusion Matrix: Truth A B C D E F G H I J Classification A 173 10 18 8 7 15 11 5 11 56 B 0 165 0 11 2 24 2 1 2 5 C 32 1 192 1 0 0 0 0 0 44 D 2 17 0 149 10 12 5 4 21 0 E 1 4 0 11 151 22 16 19 23 0 F 7 32 1 8 3 138 1 1 4 3 G 0 1 0 2 11 0 148 0 62 0 H 0 1 0 1 33 5 4 200 7 0 I 0 2 0 41 15 14 46 4 105 0 J 17 1 21 1 2 4 1 0 0 123 Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 74.57% 4.27% 7.76% 3.43% 2.99% 6.41% 4.70% 2.14% 4.68% 24.24% B 0.00% 70.51% 0.00% 4.72% 0.85% 10.26% 0.85% 0.43% 0.85% 2.16% C 13.79% 0.43% 82.76% 0.43% 0.00% 0.00% 0.00% 0.00% 0.00% 19.05% D 0.86% 7.26% 0.00% 63.95% 4.27% 5.13% 2.14% 1.71% 8.94% 0.00% E 0.43% 1.71% 0.00% 4.72% 64.53% 9.40% 6.84% 8.12% 9.79% 0.00% F 3.02% 13.68% 0.43% 3.43% 1.28% 58.97% 0.43% 0.43% 1.70% 1.30% G 0.00% 0.43% 0.00% 0.86% 4.70% 0.00% 63.25% 0.00% 26.38% 0.00% H 0.00% 0.43% 0.00% 0.43% 14.10% 2.14% 1.71% 85.47% 2.98% 0.00% I 0.00% 0.85% 0.00% 17.60% 6.41% 5.98% 19.66% 1.71% 44.68% 0.00% J 7.33% 0.43% 9.05% 0.43% 0.85% 1.71% 0.43% 0.00% 0.00% 53.25% Matrix Key: A : BAROQUE B : BLUES C : CLASSICAL D : COUNTRY E : EDANCE F : JAZZ G : METAL H : RAPHIPHOP I : ROCKROLL J : ROMANTIC Discounted Confusion Matrix: Truth A B C D E F G H I J Classification A 197.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 181.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 211.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 149.00 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 151.00 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 150.00 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 171.00 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 200.00 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 136.00 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 173.00 Discounted Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 0.85 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 0.77 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 0.91 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 0.64 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 0.65 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 0.64 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 0.73 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.85 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.58 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.75 -------------------------------------------------------------------------------- ================================================================================ Overall Evaluation for ag_mandel_2_spec -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- Overall Accuracy ag_mandel_2_spec: 65.50% Standard Deviation: 1.11 Overall Accuracy (normalised for class sizes) ag_mandel_2_spec: 65.50% Standard Deviation: 1.11 Hierachical Accuracy: 73.57% Standard Deviation: 0.70 Hierachical Accuracy (normalised for class sizes): 0.7357142857142858% Standard Deviation: 0.70 Raw Confusion Matrix: Truth A B C D E F G H I J Classification A 531 34 60 32 39 50 24 14 39 110 B 3 489 2 29 4 81 3 1 19 5 C 70 9 468 2 1 3 2 0 0 184 D 7 28 0 457 29 20 9 20 121 1 E 11 15 0 37 478 43 47 61 51 1 F 12 98 2 29 9 457 2 3 12 7 G 0 2 0 4 23 1 431 7 124 0 H 0 3 0 9 72 6 8 573 21 0 I 4 12 0 99 41 27 173 20 311 2 J 62 10 168 2 4 12 1 1 2 390 Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 75.86% 4.86% 8.57% 4.57% 5.57% 7.14% 3.43% 2.00% 5.57% 15.71% B 0.43% 69.86% 0.29% 4.14% 0.57% 11.57% 0.43% 0.14% 2.71% 0.71% C 10.00% 1.29% 66.86% 0.29% 0.14% 0.43% 0.29% 0.00% 0.00% 26.29% D 1.00% 4.00% 0.00% 65.29% 4.14% 2.86% 1.29% 2.86% 17.29% 0.14% E 1.57% 2.14% 0.00% 5.29% 68.29% 6.14% 6.71% 8.71% 7.29% 0.14% F 1.71% 14.00% 0.29% 4.14% 1.29% 65.29% 0.29% 0.43% 1.71% 1.00% G 0.00% 0.29% 0.00% 0.57% 3.29% 0.14% 61.57% 1.00% 17.71% 0.00% H 0.00% 0.43% 0.00% 1.29% 10.29% 0.86% 1.14% 81.86% 3.00% 0.00% I 0.57% 1.71% 0.00% 14.14% 5.86% 3.86% 24.71% 2.86% 44.43% 0.29% J 8.86% 1.43% 24.00% 0.29% 0.57% 1.71% 0.14% 0.14% 0.29% 55.71% Matrix Key: A : BAROQUE B : BLUES C : CLASSICAL D : COUNTRY E : EDANCE F : JAZZ G : METAL H : RAPHIPHOP I : ROCKROLL J : ROMANTIC Discounted Confusion Matrix: Truth A B C D E F G H I J Classification A 597.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 538.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 582.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 457.00 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 478.00 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 497.50 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 517.50 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 573.00 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 373.00 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 537.00 Discounted Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 0.85 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 0.77 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 0.83 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 0.65 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 0.68 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 0.71 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 0.74 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.82 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.53 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.77 --------------------------------------------------------------------------------