================================================================================ Model name: ag_mandel_1 Number of iterations = 3 -------------------------------------------------------------------------------- Iteration 1 Accuracy: 64.89% Accuracy (normalised for class sizes): 64.91% Hierachical Accuracy: 74.20% Hierachical Accuracy (normalised for class sizes): 74.20% Raw Confusion Matrix: Truth A B C D E F G H I J Classification A 178 8 15 8 11 18 5 8 7 41 B 0 156 0 7 3 23 0 0 2 2 C 20 0 103 1 0 4 0 0 0 42 D 2 5 0 144 5 7 1 5 42 0 E 4 1 0 18 183 12 13 22 17 1 F 1 50 1 13 1 161 1 1 3 0 G 0 1 0 4 5 1 142 5 35 0 H 0 4 0 4 11 0 1 183 6 0 I 6 4 1 35 11 6 71 8 120 3 J 23 4 114 0 3 1 0 0 1 144 Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 76.07% 3.43% 6.41% 3.42% 4.72% 7.73% 2.14% 3.45% 3.00% 17.60% B 0.00% 66.95% 0.00% 2.99% 1.29% 9.87% 0.00% 0.00% 0.86% 0.86% C 8.55% 0.00% 44.02% 0.43% 0.00% 1.72% 0.00% 0.00% 0.00% 18.03% D 0.85% 2.15% 0.00% 61.54% 2.15% 3.00% 0.43% 2.16% 18.03% 0.00% E 1.71% 0.43% 0.00% 7.69% 78.54% 5.15% 5.56% 9.48% 7.30% 0.43% F 0.43% 21.46% 0.43% 5.56% 0.43% 69.10% 0.43% 0.43% 1.29% 0.00% G 0.00% 0.43% 0.00% 1.71% 2.15% 0.43% 60.68% 2.16% 15.02% 0.00% H 0.00% 1.72% 0.00% 1.71% 4.72% 0.00% 0.43% 78.88% 2.58% 0.00% I 2.56% 1.72% 0.43% 14.96% 4.72% 2.58% 30.34% 3.45% 51.50% 1.29% J 9.83% 1.72% 48.72% 0.00% 1.29% 0.43% 0.00% 0.00% 0.43% 61.80% Matrix Key: A : BAROQUE B : BLUES C : CLASSICAL D : COUNTRY E : EDANCE F : JAZZ G : METAL H : RAPHIPHOP I : ROCKROLL J : ROMANTIC Discounted Confusion Matrix: Truth A B C D E F G H I J Classification A 199.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 181.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 167.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 144.00 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 183.00 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 172.50 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 177.50 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 183.00 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 137.50 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 185.50 Discounted Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 0.85 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 0.78 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 0.72 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 0.62 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 0.79 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 0.74 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 0.76 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.79 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.59 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.80 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- Iteration 2 Accuracy: 67.78% Accuracy (normalised for class sizes): 67.76% Hierachical Accuracy: 75.79% Hierachical Accuracy (normalised for class sizes): 75.76% Raw Confusion Matrix: Truth A B C D E F G H I J Classification A 175 10 29 6 14 14 3 4 14 11 B 1 173 0 12 1 34 1 0 10 0 C 26 0 177 0 0 3 2 0 0 87 D 1 10 0 167 8 4 3 5 54 0 E 1 5 0 6 154 5 14 15 13 0 F 1 27 0 9 7 167 1 1 5 2 G 0 0 0 1 8 1 154 0 55 0 H 0 1 0 3 16 1 4 204 3 0 I 2 6 0 29 24 4 50 5 75 0 J 27 1 28 0 1 0 0 0 3 136 Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 74.79% 4.29% 12.39% 2.58% 6.01% 6.01% 1.29% 1.71% 6.03% 4.66% B 0.43% 74.25% 0.00% 5.15% 0.43% 14.59% 0.43% 0.00% 4.31% 0.00% C 11.11% 0.00% 75.64% 0.00% 0.00% 1.29% 0.86% 0.00% 0.00% 36.86% D 0.43% 4.29% 0.00% 71.67% 3.43% 1.72% 1.29% 2.14% 23.28% 0.00% E 0.43% 2.15% 0.00% 2.58% 66.09% 2.15% 6.03% 6.41% 5.60% 0.00% F 0.43% 11.59% 0.00% 3.86% 3.00% 71.67% 0.43% 0.43% 2.16% 0.85% G 0.00% 0.00% 0.00% 0.43% 3.43% 0.43% 66.38% 0.00% 23.71% 0.00% H 0.00% 0.43% 0.00% 1.29% 6.87% 0.43% 1.72% 87.18% 1.29% 0.00% I 0.85% 2.58% 0.00% 12.45% 10.30% 1.72% 21.55% 2.14% 32.33% 0.00% J 11.54% 0.43% 11.97% 0.00% 0.43% 0.00% 0.00% 0.00% 1.29% 57.63% Matrix Key: A : BAROQUE B : BLUES C : CLASSICAL D : COUNTRY E : EDANCE F : JAZZ G : METAL H : RAPHIPHOP I : ROCKROLL J : ROMANTIC Discounted Confusion Matrix: Truth A B C D E F G H I J Classification A 201.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 186.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 205.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 167.00 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 154.00 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 184.00 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 179.00 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 204.00 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 102.50 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 185.00 Discounted Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 0.86 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 0.80 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 0.88 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 0.72 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 0.66 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 0.79 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 0.77 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.87 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.44 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.78 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- Iteration 3 Accuracy: 67.12% Accuracy (normalised for class sizes): 67.13% Hierachical Accuracy: 75.10% Hierachical Accuracy (normalised for class sizes): 75.12% Raw Confusion Matrix: Truth A B C D E F G H I J Classification A 178 9 18 10 7 11 6 2 12 69 B 0 166 0 6 0 21 1 1 3 2 C 39 1 189 0 0 1 0 0 0 45 D 1 19 0 151 7 9 3 3 28 0 E 0 3 0 5 168 18 23 16 24 0 F 0 31 0 9 2 150 2 1 4 2 G 0 1 0 3 19 1 149 0 65 0 H 0 0 0 1 21 1 4 209 6 0 I 0 3 0 48 8 19 45 2 93 0 J 14 1 25 0 2 3 1 0 0 113 Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 76.72% 3.85% 7.76% 4.29% 2.99% 4.70% 2.56% 0.85% 5.11% 29.87% B 0.00% 70.94% 0.00% 2.58% 0.00% 8.97% 0.43% 0.43% 1.28% 0.87% C 16.81% 0.43% 81.47% 0.00% 0.00% 0.43% 0.00% 0.00% 0.00% 19.48% D 0.43% 8.12% 0.00% 64.81% 2.99% 3.85% 1.28% 1.28% 11.91% 0.00% E 0.00% 1.28% 0.00% 2.15% 71.79% 7.69% 9.83% 6.84% 10.21% 0.00% F 0.00% 13.25% 0.00% 3.86% 0.85% 64.10% 0.85% 0.43% 1.70% 0.87% G 0.00% 0.43% 0.00% 1.29% 8.12% 0.43% 63.68% 0.00% 27.66% 0.00% H 0.00% 0.00% 0.00% 0.43% 8.97% 0.43% 1.71% 89.32% 2.55% 0.00% I 0.00% 1.28% 0.00% 20.60% 3.42% 8.12% 19.23% 0.85% 39.57% 0.00% J 6.03% 0.43% 10.78% 0.00% 0.85% 1.28% 0.43% 0.00% 0.00% 48.92% Matrix Key: A : BAROQUE B : BLUES C : CLASSICAL D : COUNTRY E : EDANCE F : JAZZ G : METAL H : RAPHIPHOP I : ROCKROLL J : ROMANTIC Discounted Confusion Matrix: Truth A B C D E F G H I J Classification A 204.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 181.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 210.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 151.00 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 168.00 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 160.50 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 171.50 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 209.00 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 125.50 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 170.00 Discounted Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 0.88 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 0.78 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 0.91 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 0.65 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 0.72 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 0.69 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 0.73 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.89 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.53 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.74 -------------------------------------------------------------------------------- ================================================================================ Overall Evaluation for ag_mandel_1 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- Overall Accuracy ag_mandel_1: 66.60% Standard Deviation: 0.71 Overall Accuracy (normalised for class sizes) ag_mandel_1: 66.60% Standard Deviation: 0.71 Hierachical Accuracy: 75.03% Standard Deviation: 0.38 Hierachical Accuracy (normalised for class sizes): 0.7502857142857142% Standard Deviation: 0.37 Raw Confusion Matrix: Truth A B C D E F G H I J Classification A 531 27 62 24 32 43 14 14 33 121 B 1 495 0 25 4 78 2 1 15 4 C 85 1 469 1 0 8 2 0 0 174 D 4 34 0 462 20 20 7 13 124 0 E 5 9 0 29 505 35 50 53 54 1 F 2 108 1 31 10 478 4 3 12 4 G 0 2 0 8 32 3 445 5 155 0 H 0 5 0 8 48 2 9 596 15 0 I 8 13 1 112 43 29 166 15 288 3 J 64 6 167 0 6 4 1 0 4 393 Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 75.86% 3.86% 8.86% 3.43% 4.57% 6.14% 2.00% 2.00% 4.71% 17.29% B 0.14% 70.71% 0.00% 3.57% 0.57% 11.14% 0.29% 0.14% 2.14% 0.57% C 12.14% 0.14% 67.00% 0.14% 0.00% 1.14% 0.29% 0.00% 0.00% 24.86% D 0.57% 4.86% 0.00% 66.00% 2.86% 2.86% 1.00% 1.86% 17.71% 0.00% E 0.71% 1.29% 0.00% 4.14% 72.14% 5.00% 7.14% 7.57% 7.71% 0.14% F 0.29% 15.43% 0.14% 4.43% 1.43% 68.29% 0.57% 0.43% 1.71% 0.57% G 0.00% 0.29% 0.00% 1.14% 4.57% 0.43% 63.57% 0.71% 22.14% 0.00% H 0.00% 0.71% 0.00% 1.14% 6.86% 0.29% 1.29% 85.14% 2.14% 0.00% I 1.14% 1.86% 0.14% 16.00% 6.14% 4.14% 23.71% 2.14% 41.14% 0.43% J 9.14% 0.86% 23.86% 0.00% 0.86% 0.57% 0.14% 0.00% 0.57% 56.14% Matrix Key: A : BAROQUE B : BLUES C : CLASSICAL D : COUNTRY E : EDANCE F : JAZZ G : METAL H : RAPHIPHOP I : ROCKROLL J : ROMANTIC Discounted Confusion Matrix: Truth A B C D E F G H I J Classification A 605.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 549.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 583.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 462.00 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 505.00 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 517.00 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 528.00 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 596.00 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 365.50 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 540.50 Discounted Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 0.86 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 0.78 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 0.83 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 0.66 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 0.72 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 0.74 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 0.75 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.85 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.52 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.77 --------------------------------------------------------------------------------