================================================================================ Model name: ag_lidy Number of iterations = 3 -------------------------------------------------------------------------------- Iteration 1 Accuracy: 64.89% Accuracy (normalised for class sizes): 64.92% Hierachical Accuracy: 74.75% Hierachical Accuracy (normalised for class sizes): 74.76% Raw Confusion Matrix: Truth A B C D E F G H I J Classification A 126 0 19 1 3 5 0 0 4 23 B 0 170 0 7 0 27 0 0 2 2 C 12 0 78 0 0 1 0 0 0 40 D 0 8 3 169 5 15 4 5 69 1 E 0 0 1 3 177 8 3 25 4 2 F 1 45 4 13 4 166 1 4 6 2 G 0 2 0 0 6 1 142 2 7 0 H 0 5 0 0 17 5 4 184 1 0 I 15 1 1 40 15 3 79 12 140 1 J 80 2 128 1 6 2 1 0 0 162 Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 53.85% 0.00% 8.12% 0.43% 1.29% 2.15% 0.00% 0.00% 1.72% 9.87% B 0.00% 72.96% 0.00% 2.99% 0.00% 11.59% 0.00% 0.00% 0.86% 0.86% C 5.13% 0.00% 33.33% 0.00% 0.00% 0.43% 0.00% 0.00% 0.00% 17.17% D 0.00% 3.43% 1.28% 72.22% 2.15% 6.44% 1.71% 2.16% 29.61% 0.43% E 0.00% 0.00% 0.43% 1.28% 75.97% 3.43% 1.28% 10.78% 1.72% 0.86% F 0.43% 19.31% 1.71% 5.56% 1.72% 71.24% 0.43% 1.72% 2.58% 0.86% G 0.00% 0.86% 0.00% 0.00% 2.58% 0.43% 60.68% 0.86% 3.00% 0.00% H 0.00% 2.15% 0.00% 0.00% 7.30% 2.15% 1.71% 79.31% 0.43% 0.00% I 6.41% 0.43% 0.43% 17.09% 6.44% 1.29% 33.76% 5.17% 60.09% 0.43% J 34.19% 0.86% 54.70% 0.43% 2.58% 0.86% 0.43% 0.00% 0.00% 69.53% Matrix Key: A : BAROQUE B : BLUES C : CLASSICAL D : COUNTRY E : EDANCE F : JAZZ G : METAL H : RAPHIPHOP I : ROCKROLL J : ROMANTIC Discounted Confusion Matrix: Truth A B C D E F G H I J Classification A 172.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 192.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 151.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 169.00 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 177.00 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 179.50 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 181.50 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 184.00 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 143.50 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 193.50 Discounted Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 0.74 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 0.83 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 0.65 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 0.72 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 0.76 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 0.77 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 0.78 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.79 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.62 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.83 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- Iteration 2 Accuracy: 68.81% Accuracy (normalised for class sizes): 68.81% Hierachical Accuracy: 77.04% Hierachical Accuracy (normalised for class sizes): 77.02% Raw Confusion Matrix: Truth A B C D E F G H I J Classification A 186 0 40 0 6 2 4 0 8 50 B 1 169 0 11 1 45 0 2 8 1 C 28 2 179 0 1 3 1 0 3 72 D 3 14 1 158 4 7 0 3 47 1 E 0 1 0 3 158 3 14 13 6 0 F 0 43 0 23 5 159 1 1 13 1 G 0 0 0 1 10 0 179 0 47 0 H 0 0 0 2 24 0 2 212 1 0 I 0 2 0 32 21 13 29 3 96 1 J 16 2 14 3 3 1 2 0 3 110 Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 79.49% 0.00% 17.09% 0.00% 2.58% 0.86% 1.72% 0.00% 3.45% 21.19% B 0.43% 72.53% 0.00% 4.72% 0.43% 19.31% 0.00% 0.85% 3.45% 0.42% C 11.97% 0.86% 76.50% 0.00% 0.43% 1.29% 0.43% 0.00% 1.29% 30.51% D 1.28% 6.01% 0.43% 67.81% 1.72% 3.00% 0.00% 1.28% 20.26% 0.42% E 0.00% 0.43% 0.00% 1.29% 67.81% 1.29% 6.03% 5.56% 2.59% 0.00% F 0.00% 18.45% 0.00% 9.87% 2.15% 68.24% 0.43% 0.43% 5.60% 0.42% G 0.00% 0.00% 0.00% 0.43% 4.29% 0.00% 77.16% 0.00% 20.26% 0.00% H 0.00% 0.00% 0.00% 0.86% 10.30% 0.00% 0.86% 90.60% 0.43% 0.00% I 0.00% 0.86% 0.00% 13.73% 9.01% 5.58% 12.50% 1.28% 41.38% 0.42% J 6.84% 0.86% 5.98% 1.29% 1.29% 0.43% 0.86% 0.00% 1.29% 46.61% Matrix Key: A : BAROQUE B : BLUES C : CLASSICAL D : COUNTRY E : EDANCE F : JAZZ G : METAL H : RAPHIPHOP I : ROCKROLL J : ROMANTIC Discounted Confusion Matrix: Truth A B C D E F G H I J Classification A 208.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 190.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 206.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 158.00 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 158.00 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 181.50 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 193.50 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 212.00 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 119.50 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 171.00 Discounted Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 0.89 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 0.82 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 0.88 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 0.68 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 0.68 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 0.78 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 0.83 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.91 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.52 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.72 -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- Iteration 3 Accuracy: 66.44% Accuracy (normalised for class sizes): 66.44% Hierachical Accuracy: 74.92% Hierachical Accuracy (normalised for class sizes): 74.95% Raw Confusion Matrix: Truth A B C D E F G H I J Classification A 162 1 36 0 0 3 1 1 7 54 B 0 158 1 5 0 37 1 1 0 1 C 31 3 157 0 0 0 0 0 1 32 D 1 25 1 176 7 37 3 4 50 7 E 0 0 0 1 160 10 15 21 14 0 F 1 42 0 13 8 125 0 2 1 4 G 0 0 0 0 20 2 169 0 52 0 H 0 0 0 1 25 1 4 205 2 0 I 0 4 0 37 11 17 38 0 108 3 J 37 1 37 0 3 2 3 0 0 130 Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 69.83% 0.43% 15.52% 0.00% 0.00% 1.28% 0.43% 0.43% 2.98% 23.38% B 0.00% 67.52% 0.43% 2.15% 0.00% 15.81% 0.43% 0.43% 0.00% 0.43% C 13.36% 1.28% 67.67% 0.00% 0.00% 0.00% 0.00% 0.00% 0.43% 13.85% D 0.43% 10.68% 0.43% 75.54% 2.99% 15.81% 1.28% 1.71% 21.28% 3.03% E 0.00% 0.00% 0.00% 0.43% 68.38% 4.27% 6.41% 8.97% 5.96% 0.00% F 0.43% 17.95% 0.00% 5.58% 3.42% 53.42% 0.00% 0.85% 0.43% 1.73% G 0.00% 0.00% 0.00% 0.00% 8.55% 0.85% 72.22% 0.00% 22.13% 0.00% H 0.00% 0.00% 0.00% 0.43% 10.68% 0.43% 1.71% 87.61% 0.85% 0.00% I 0.00% 1.71% 0.00% 15.88% 4.70% 7.26% 16.24% 0.00% 45.96% 1.30% J 15.95% 0.43% 15.95% 0.00% 1.28% 0.85% 1.28% 0.00% 0.00% 56.28% Matrix Key: A : BAROQUE B : BLUES C : CLASSICAL D : COUNTRY E : EDANCE F : JAZZ G : METAL H : RAPHIPHOP I : ROCKROLL J : ROMANTIC Discounted Confusion Matrix: Truth A B C D E F G H I J Classification A 196.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 179.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 193.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 176.00 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 160.00 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 143.50 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 188.00 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 205.00 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 134.00 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 173.00 Discounted Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 0.84 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 0.76 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 0.83 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 0.76 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 0.68 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 0.61 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 0.80 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.88 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.57 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.75 -------------------------------------------------------------------------------- ================================================================================ Overall Evaluation for ag_lidy -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- Overall Accuracy ag_lidy: 66.71% Standard Deviation: 0.93 Overall Accuracy (normalised for class sizes) ag_lidy: 66.71% Standard Deviation: 0.93 Hierachical Accuracy: 75.57% Standard Deviation: 0.60 Hierachical Accuracy (normalised for class sizes): 0.7557142857142858% Standard Deviation: 0.59 Raw Confusion Matrix: Truth A B C D E F G H I J Classification A 474 1 95 1 9 10 5 1 19 127 B 1 497 1 23 1 109 1 3 10 4 C 71 5 414 0 1 4 1 0 4 144 D 4 47 5 503 16 59 7 12 166 9 E 0 1 1 7 495 21 32 59 24 2 F 2 130 4 49 17 450 2 7 20 7 G 0 2 0 1 36 3 490 2 106 0 H 0 5 0 3 66 6 10 601 4 0 I 15 7 1 109 47 33 146 15 344 5 J 133 5 179 4 12 5 6 0 3 402 Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 67.71% 0.14% 13.57% 0.14% 1.29% 1.43% 0.71% 0.14% 2.71% 18.14% B 0.14% 71.00% 0.14% 3.29% 0.14% 15.57% 0.14% 0.43% 1.43% 0.57% C 10.14% 0.71% 59.14% 0.00% 0.14% 0.57% 0.14% 0.00% 0.57% 20.57% D 0.57% 6.71% 0.71% 71.86% 2.29% 8.43% 1.00% 1.71% 23.71% 1.29% E 0.00% 0.14% 0.14% 1.00% 70.71% 3.00% 4.57% 8.43% 3.43% 0.29% F 0.29% 18.57% 0.57% 7.00% 2.43% 64.29% 0.29% 1.00% 2.86% 1.00% G 0.00% 0.29% 0.00% 0.14% 5.14% 0.43% 70.00% 0.29% 15.14% 0.00% H 0.00% 0.71% 0.00% 0.43% 9.43% 0.86% 1.43% 85.86% 0.57% 0.00% I 2.14% 1.00% 0.14% 15.57% 6.71% 4.71% 20.86% 2.14% 49.14% 0.71% J 19.00% 0.71% 25.57% 0.57% 1.71% 0.71% 0.86% 0.00% 0.43% 57.43% Matrix Key: A : BAROQUE B : BLUES C : CLASSICAL D : COUNTRY E : EDANCE F : JAZZ G : METAL H : RAPHIPHOP I : ROCKROLL J : ROMANTIC Discounted Confusion Matrix: Truth A B C D E F G H I J Classification A 576.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 562.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 551.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 503.00 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 495.00 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 504.50 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 563.00 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 601.00 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 397.00 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 537.50 Discounted Confusion Matrix percentage: Truth A B C D E F G H I J Classification A 0.82 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 B 0.00 0.80 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 C 0.00 0.00 0.79 0.00 0.00 0.00 0.00 0.00 0.00 0.00 D 0.00 0.00 0.00 0.72 0.00 0.00 0.00 0.00 0.00 0.00 E 0.00 0.00 0.00 0.00 0.71 0.00 0.00 0.00 0.00 0.00 F 0.00 0.00 0.00 0.00 0.00 0.72 0.00 0.00 0.00 0.00 G 0.00 0.00 0.00 0.00 0.00 0.00 0.80 0.00 0.00 0.00 H 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.86 0.00 0.00 I 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.57 0.00 J 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.77 --------------------------------------------------------------------------------