Difference between revisions of "2009:Audio Tag Classification (MajorMinor) Set Results"

From MIREX Wiki
(→‎Team ID)
Line 1: Line 1:
−
==General Legend==
+
==Introduction==
−
 
+
===General Legend===
−
===Team ID===
+
====Team ID====
  
 
'''BP1''' =  [[Juan Jos├⌐ Burred, Geoffroy Peeters]]<br />
 
'''BP1''' =  [[Juan Jos├⌐ Burred, Geoffroy Peeters]]<br />
 
'''BP2''' =  [[Juan Jos├⌐ Burred, Geoffroy Peeters]]<br />
 
'''BP2''' =  [[Juan Jos├⌐ Burred, Geoffroy Peeters]]<br />
−
'''CL1''' =  [[Chuan Cao,Ming Li]]<br />
+
'''CC1''' =  [[Chuan Cao, Ming Li]]<br />
−
'''CL2''' =  [[Chuan Cao,Ming Li]]<br />
+
'''CC2''' =  [[Chuan Cao, Ming Li]]<br />
−
'''CL3''' =  [[Chuan Cao,Ming Li]]<br />
+
'''CC3''' =  [[Chuan Cao, Ming Li]]<br />
−
'''CL4''' =  [[Chuan Cao,Ming Li]]<br />
+
'''CC4''' =  [[Chuan Cao, Ming Li]]<br />
 
'''GP'''  =  [[Geoffroy Peeters]]<br />
 
'''GP'''  =  [[Geoffroy Peeters]]<br />
 
'''GT1''' = [[George Tzanetakis]]<br />
 
'''GT1''' = [[George Tzanetakis]]<br />
 
'''GT2''' = [[George Tzanetakis]]<br />
 
'''GT2''' = [[George Tzanetakis]]<br />
−
'''LWW1''' = [[Hung-Yi Lo,Ju-Chiang Wang,Hsin-Min Wang]]<br />
+
'''LWW1''' = [[Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang]]<br />
−
'''LWW2''' = [[Hung-Yi Lo,Ju-Chiang Wang,Hsin-Min Wang]]<br />
+
'''LWW2''' = [[Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang]]<br />
−
'''HBC''' = [[Matthew D.Hoffman,David M. Blei,Perry R.Cook]]<br />
+
'''HCB''' = [[Matthew D.Hoffman, David M. Blei, Perry R.Cook]]<br />
 +
 
 +
==Overall Summary Results (Binary)==
 +
 
 +
<csv p=3>tag/MajorMiner/summary_binary.csv</csv>
 +
 
 +
 
 +
 
 +
===Summary Binary Relevance F-Measure (Average Across All Folds)===
 +
 
 +
<csv p=3>tag/MajorMiner/binary_avg_Fmeasure.csv</csv>
 +
 
 +
===Summary Binary Accuracy (Average Across All Folds)===
 +
 
 +
<csv p=3>tag/MajorMiner/binary_avg_Accuracy.csv</csv>
 +
 
 +
===Summary Positive Example Accuracy (Average Across All Folds)===
 +
 
 +
<csv p=3>tag/MajorMiner/binary_avg_positive_example_Accuracy.csv</csv>
 +
 
 +
===Summary Negative Example Accuracy (Average Across All Folds)===
 +
 
 +
<csv p=3>tag/MajorMiner/binary_avg_negative_example_Accuracy.csv</csv>
 +
 
 +
==Overall Summary Results (Affinity)==
 +
 
 +
<csv p=3>tag/MajorMiner/summary_affinity.csv</csv>
 +
 
 +
===Summary AUC-ROC Tag (Average Across All Folds)===
 +
 
 +
<csv p=3>tag/MajorMiner/affinity_tag_AUC_ROC.csv</csv>
 +
 
 +
==Select Friedman's Test Results==
 +
===Tag F-measure (Binary) Friedman Test===
 +
The following table and plot show the results of Friedman's ANOVA with Tukey-Kramer multiple comparisons computed over the F-measure for each '''tag''' in the test, averaged over all folds.
 +
 
 +
<csv p=3>tag/MajorMiner/binary_FMeasure.friedman.tukeyKramerHSD.csv</csv>
 +
 
 +
 
 +
https://music-ir.org/mirex/2009/results/tag/MajorMiner/small.binary_FMeasure.friedman.tukeyKramerHSD.png
 +
 
 +
===Per Track F-measure (Binary) Friedman Test===
 +
The following table and plot show the results of Friedman's ANOVA with Tukey-Kramer multiple comparisons computed over the F-measure for each '''track''' in the test, averaged over all folds.
 +
<csv p=3>tag/MajorMiner/binary_FMeasure_per_track.friedman.tukeyKramerHSD.csv</csv>
 +
 
 +
 
 +
https://music-ir.org/mirex/2009/results/tag/MajorMiner/small.binary_FMeasure_per_track.friedman.tukeyKramerHSD.png
 +
 
 +
===Per Track AUC-ROC (Affinity) Friedman Test===
 +
The following table and plot show the results of Friedman's ANOVA with Tukey-Kramer multiple comparisons computed over the Area Under the ROC curve (AUC-ROC) for each '''track/clip''' in the test, averaged over all folds.
 +
 
 +
<csv p=3>tag/MajorMiner/affinity.AUC_ROC_TRACK.friedman.tukeyKramerHSD.csv</csv>
 +
 
 +
https://music-ir.org/mirex/2009/results/tag/MajorMiner/small.affinity.AUC_ROC_TRACK.friedman.tukeyKramerHSD.png
 +
 
 +
==Assorted Results Files for Download==
 +
===General Results===
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity_tag_fold_AUC_ROC.csv affinity_tag_fold_AUC_ROC.csv]<br />
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity_clip_AUC_ROC.csv affinity_clip_AUC_ROC.csv]<br />
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/binary_per_fold_Accuracy.csv binary_per_fold_Accuracy.csv]<br />
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/binary_per_fold_Fmeasure.csv binary_per_fold_Fmeasure.csv]<br />
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/binary_per_fold_negative_example_Accuracy.csv binary_per_fold_negative_example_Accuracy.csv]<br />
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/binary_per_fold_per_track_Accuracy.csv binary_per_fold_per_track_Accuracy.csv]<br />
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/binary_per_fold_per_track_Fmeasure.csv binary_per_fold_per_track_Fmeasure.csv]<br />
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/binary_per_fold_per_track_negative_example_Accuracy.csv binary_per_fold_per_track_negative_example_Accuracy.csv]<br />
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/binary_per_fold_per_track_positive_example_Accuracy.csv binary_per_fold_per_track_positive_example_Accuracy.csv]<br />
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/binary_per_fold_positive_example_Accuracy.csv binary_per_fold_positive_example_Accuracy.csv]<br />
 +
 
 +
===Friedman's Tests Results===
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity.PrecisionAt3.friedman.tukeyKramerHSD.csv affinity.PrecisionAt3.friedman.tukeyKramerHSD.csv ]<br />
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity.PrecisionAt3.friedman.tukeyKramerHSD.png affinity.PrecisionAt3.friedman.tukeyKramerHSD.png]<br />
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity.PrecisionAt6.friedman.tukeyKramerHSD.csv affinity.PrecisionAt6.friedman.tukeyKramerHSD.csv]<br />
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity.PrecisionAt6.friedman.tukeyKramerHSD.png affinity.PrecisionAt6.friedman.tukeyKramerHSD.png]<br />
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity.PrecisionAt9.friedman.tukeyKramerHSD.csv affinity.PrecisionAt9.friedman.tukeyKramerHSD.csv]<br />
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity.PrecisionAt9.friedman.tukeyKramerHSD.png affinity.PrecisionAt9.friedman.tukeyKramerHSD.png ]<br />
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity.PrecisionAt12.friedman.tukeyKramerHSD.csv affinity.PrecisionAt12.friedman.tukeyKramerHSD.csv]<br />
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity.PrecisionAt12.friedman.tukeyKramerHSD.png affinity.PrecisionAt12.friedman.tukeyKramerHSD.png]<br />
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity.PrecisionAt15.friedman.tukeyKramerHSD.csv affinity.PrecisionAt15.friedman.tukeyKramerHSD.csv]<br />
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/affinity.PrecisionAt15.friedman.tukeyKramerHSD.png affinity.PrecisionAt15.friedman.tukeyKramerHSD.png]<br />
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/binary_Accuracy.friedman.tukeyKramerHSD.csv binary_Accuracy.friedman.tukeyKramerHSD.csv]<br />
 +
[https://music-ir.org/mirex/2009/results/tag/MajorMiner/binary_Accuracy.friedman.tukeyKramerHSD.png binary_Accuracy.friedman.tukeyKramerHSD.png]<br />
 +
 
 +
===Results By Algorithm===
 +
(.tgz format) <br />
 +
 
 +
'''BP1''' =  [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/BP1.tgz Juan Jos├⌐ Burred, Geoffroy Peeters]<br />
 +
'''BP2''' =  [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/BP2.tgz Juan Jos├⌐ Burred, Geoffroy Peeters]<br />
 +
'''CC1''' =  [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/CC1.tgz Chuan Cao, Ming Li]<br />
 +
'''CC2''' =  [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/CC2.tgz Chuan Cao, Ming Li]<br />
 +
'''CC3''' =  [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/CC3.tgz Chuan Cao, Ming Li]<br />
 +
'''CC4''' =  [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/CC4.tgz Chuan Cao, Ming Li]<br />
 +
'''GP'''  =  [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/GP.tgz Geoffroy Peeters]<br />
 +
'''GT1''' =  [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/GT1.tgz George Tzanetakis]<br />
 +
'''GT2''' = [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/GT2.tgz George Tzanetakis]<br />
 +
'''LWW1''' = [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/LWW1.tgz Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang]<br />
 +
'''LWW2''' = [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/LWW2.tgz Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang]<br />
 +
'''HCB''' = [https://www.music-ir.org/mirex/2009/results/tag/MajorMiner/HCB.tgz Matthew D.Hoffman, David M. Blei, Perry R.Cook]<br />

Revision as of 22:50, 13 October 2009

Introduction

General Legend

Team ID

BP1 = Juan José Burred, Geoffroy Peeters
BP2 = Juan José Burred, Geoffroy Peeters
CC1 = Chuan Cao, Ming Li
CC2 = Chuan Cao, Ming Li
CC3 = Chuan Cao, Ming Li
CC4 = Chuan Cao, Ming Li
GP = Geoffroy Peeters
GT1 = George Tzanetakis
GT2 = George Tzanetakis
LWW1 = Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang
LWW2 = Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang
HCB = Matthew D.Hoffman, David M. Blei, Perry R.Cook

Overall Summary Results (Binary)

file /nema-raid/www/mirex/results/tag/MajorMiner/summary_binary.csv not found


Summary Binary Relevance F-Measure (Average Across All Folds)

file /nema-raid/www/mirex/results/tag/MajorMiner/binary_avg_Fmeasure.csv not found

Summary Binary Accuracy (Average Across All Folds)

file /nema-raid/www/mirex/results/tag/MajorMiner/binary_avg_Accuracy.csv not found

Summary Positive Example Accuracy (Average Across All Folds)

file /nema-raid/www/mirex/results/tag/MajorMiner/binary_avg_positive_example_Accuracy.csv not found

Summary Negative Example Accuracy (Average Across All Folds)

file /nema-raid/www/mirex/results/tag/MajorMiner/binary_avg_negative_example_Accuracy.csv not found

Overall Summary Results (Affinity)

file /nema-raid/www/mirex/results/tag/MajorMiner/summary_affinity.csv not found

Summary AUC-ROC Tag (Average Across All Folds)

file /nema-raid/www/mirex/results/tag/MajorMiner/affinity_tag_AUC_ROC.csv not found

Select Friedman's Test Results

Tag F-measure (Binary) Friedman Test

The following table and plot show the results of Friedman's ANOVA with Tukey-Kramer multiple comparisons computed over the F-measure for each tag in the test, averaged over all folds.

file /nema-raid/www/mirex/results/tag/MajorMiner/binary_FMeasure.friedman.tukeyKramerHSD.csv not found


https://music-ir.org/mirex/2009/results/tag/MajorMiner/small.binary_FMeasure.friedman.tukeyKramerHSD.png

Per Track F-measure (Binary) Friedman Test

The following table and plot show the results of Friedman's ANOVA with Tukey-Kramer multiple comparisons computed over the F-measure for each track in the test, averaged over all folds. file /nema-raid/www/mirex/results/tag/MajorMiner/binary_FMeasure_per_track.friedman.tukeyKramerHSD.csv not found


https://music-ir.org/mirex/2009/results/tag/MajorMiner/small.binary_FMeasure_per_track.friedman.tukeyKramerHSD.png

Per Track AUC-ROC (Affinity) Friedman Test

The following table and plot show the results of Friedman's ANOVA with Tukey-Kramer multiple comparisons computed over the Area Under the ROC curve (AUC-ROC) for each track/clip in the test, averaged over all folds.

file /nema-raid/www/mirex/results/tag/MajorMiner/affinity.AUC_ROC_TRACK.friedman.tukeyKramerHSD.csv not found

https://music-ir.org/mirex/2009/results/tag/MajorMiner/small.affinity.AUC_ROC_TRACK.friedman.tukeyKramerHSD.png

Assorted Results Files for Download

General Results

affinity_tag_fold_AUC_ROC.csv
affinity_clip_AUC_ROC.csv
binary_per_fold_Accuracy.csv
binary_per_fold_Fmeasure.csv
binary_per_fold_negative_example_Accuracy.csv
binary_per_fold_per_track_Accuracy.csv
binary_per_fold_per_track_Fmeasure.csv
binary_per_fold_per_track_negative_example_Accuracy.csv
binary_per_fold_per_track_positive_example_Accuracy.csv
binary_per_fold_positive_example_Accuracy.csv

Friedman's Tests Results

affinity.PrecisionAt3.friedman.tukeyKramerHSD.csv
affinity.PrecisionAt3.friedman.tukeyKramerHSD.png
affinity.PrecisionAt6.friedman.tukeyKramerHSD.csv
affinity.PrecisionAt6.friedman.tukeyKramerHSD.png
affinity.PrecisionAt9.friedman.tukeyKramerHSD.csv
affinity.PrecisionAt9.friedman.tukeyKramerHSD.png
affinity.PrecisionAt12.friedman.tukeyKramerHSD.csv
affinity.PrecisionAt12.friedman.tukeyKramerHSD.png
affinity.PrecisionAt15.friedman.tukeyKramerHSD.csv
affinity.PrecisionAt15.friedman.tukeyKramerHSD.png
binary_Accuracy.friedman.tukeyKramerHSD.csv
binary_Accuracy.friedman.tukeyKramerHSD.png

Results By Algorithm

(.tgz format)

BP1 = Juan José Burred, Geoffroy Peeters
BP2 = Juan José Burred, Geoffroy Peeters
CC1 = Chuan Cao, Ming Li
CC2 = Chuan Cao, Ming Li
CC3 = Chuan Cao, Ming Li
CC4 = Chuan Cao, Ming Li
GP = Geoffroy Peeters
GT1 = George Tzanetakis
GT2 = George Tzanetakis
LWW1 = Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang
LWW2 = Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang
HCB = Matthew D.Hoffman, David M. Blei, Perry R.Cook

Retrieved from "https://www.music-ir.org/mirex/w/index.php?title=2009:Audio_Tag_Classification_(MajorMinor)_Set_Results&oldid=5693"