Difference between revisions of "2009:Audio Tag Classification (MajorMiner) Set Results"

From MIREX Wiki
(Tag AUC-ROC (Affinity) Friedman Test)
(Team ID)
Line 12: Line 12:
 
'''GT1''' = [[George Tzanetakis]]<br />
 
'''GT1''' = [[George Tzanetakis]]<br />
 
'''GT2''' = [[George Tzanetakis]]<br />
 
'''GT2''' = [[George Tzanetakis]]<br />
 +
'''HBC''' = [[Matthew D.Hoffman, David M. Blei, Perry R.Cook]]<br />
 
'''LWW1''' = [[Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang]]<br />
 
'''LWW1''' = [[Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang]]<br />
 
'''LWW2''' = [[Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang]]<br />
 
'''LWW2''' = [[Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang]]<br />
'''HBC''' = [[Matthew D.Hoffman, David M. Blei, Perry R.Cook]]<br />
 
  
 
==Overall Summary Results (Binary)==
 
==Overall Summary Results (Binary)==

Revision as of 22:22, 15 October 2009

Introduction

General Legend

Team ID

BP1 = Juan José Burred, Geoffroy Peeters
BP2 = Juan José Burred, Geoffroy Peeters
CC1 = Chuan Cao, Ming Li
CC2 = Chuan Cao, Ming Li
CC3 = Chuan Cao, Ming Li
CC4 = Chuan Cao, Ming Li
GP = Geoffroy Peeters
GT1 = George Tzanetakis
GT2 = George Tzanetakis
HBC = Matthew D.Hoffman, David M. Blei, Perry R.Cook
LWW1 = Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang
LWW2 = Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang

Overall Summary Results (Binary)

file /nema-raid/www/mirex/results/tag/MajorMiner/summary_binary.csv not found


Summary Binary Relevance F-Measure (Average Across All Folds)

file /nema-raid/www/mirex/results/tag/MajorMiner/binary_avg_Fmeasure.csv not found

Summary Binary Accuracy (Average Across All Folds)

file /nema-raid/www/mirex/results/tag/MajorMiner/binary_avg_Accuracy.csv not found

Summary Positive Example Accuracy (Average Across All Folds)

file /nema-raid/www/mirex/results/tag/MajorMiner/binary_avg_positive_example_Accuracy.csv not found

Summary Negative Example Accuracy (Average Across All Folds)

file /nema-raid/www/mirex/results/tag/MajorMiner/binary_avg_negative_example_Accuracy.csv not found

Overall Summary Results (Affinity)

file /nema-raid/www/mirex/results/tag/MajorMiner/summary_affinity.csv not found

Summary AUC-ROC Tag (Average Across All Folds)

file /nema-raid/www/mirex/results/tag/MajorMiner/affinity_tag_AUC_ROC.csv not found

Select Friedman's Test Results

Tag F-measure (Binary) Friedman Test

The following table and plot show the results of Friedman's ANOVA with Tukey-Kramer multiple comparisons computed over the F-measure for each tag in the test, averaged over all folds.

file /nema-raid/www/mirex/results/tag/MajorMiner/binary_FMeasure.friedman.tukeyKramerHSD.csv not found


https://music-ir.org/mirex/2009/results/tag/MajorMiner/small.binary_FMeasure.friedman.tukeyKramerHSD.png

Per Track F-measure (Binary) Friedman Test

The following table and plot show the results of Friedman's ANOVA with Tukey-Kramer multiple comparisons computed over the F-measure for each track in the test, averaged over all folds. file /nema-raid/www/mirex/results/tag/MajorMiner/binary_FMeasure_per_track.friedman.tukeyKramerHSD.csv not found


https://music-ir.org/mirex/2009/results/tag/MajorMiner/small.binary_FMeasure_per_track.friedman.tukeyKramerHSD.png

Tag AUC-ROC (Affinity) Friedman Test

The following table and plot show the results of Friedman's ANOVA with Tukey-Kramer multiple comparisons computed over the Area Under the ROC curve (AUC-ROC) for each tag in the test, averaged over all folds.

file /nema-raid/www/mirex/results/tag/MajorMiner/affinity.AUC_ROC_TAG.friedman.tukeyKramerHSD.csv not found

https://music-ir.org/mirex/2009/results/tag/MajorMiner/small.affinity.AUC_ROC_TAG.friedman.tukeyKramerHSD.png

Per Track AUC-ROC (Affinity) Friedman Test

The following table and plot show the results of Friedman's ANOVA with Tukey-Kramer multiple comparisons computed over the Area Under the ROC curve (AUC-ROC) for each track/clip in the test, averaged over all folds.

file /nema-raid/www/mirex/results/tag/MajorMiner/affinity.AUC_ROC_TRACK.friedman.tukeyKramerHSD.csv not found

https://music-ir.org/mirex/2009/results/tag/MajorMiner/small.affinity.AUC_ROC_TRACK.friedman.tukeyKramerHSD.png

Assorted Results Files for Download

General Results

affinity_tag_fold_AUC_ROC.csv
affinity_clip_AUC_ROC.csv
binary_per_fold_Accuracy.csv
binary_per_fold_Fmeasure.csv
binary_per_fold_negative_example_Accuracy.csv
binary_per_fold_per_track_Accuracy.csv
binary_per_fold_per_track_Fmeasure.csv
binary_per_fold_per_track_negative_example_Accuracy.csv
binary_per_fold_per_track_positive_example_Accuracy.csv
binary_per_fold_positive_example_Accuracy.csv

Friedman's Tests Results

affinity.PrecisionAt3.friedman.tukeyKramerHSD.csv
affinity.PrecisionAt3.friedman.tukeyKramerHSD.png
affinity.PrecisionAt6.friedman.tukeyKramerHSD.csv
affinity.PrecisionAt6.friedman.tukeyKramerHSD.png
affinity.PrecisionAt9.friedman.tukeyKramerHSD.csv
affinity.PrecisionAt9.friedman.tukeyKramerHSD.png
affinity.PrecisionAt12.friedman.tukeyKramerHSD.csv
affinity.PrecisionAt12.friedman.tukeyKramerHSD.png
affinity.PrecisionAt15.friedman.tukeyKramerHSD.csv
affinity.PrecisionAt15.friedman.tukeyKramerHSD.png
binary_Accuracy.friedman.tukeyKramerHSD.csv
binary_Accuracy.friedman.tukeyKramerHSD.png

Results By Algorithm

(.tgz format)

BP1 = Juan José Burred, Geoffroy Peeters
BP2 = Juan José Burred, Geoffroy Peeters
CC1 = Chuan Cao, Ming Li
CC2 = Chuan Cao, Ming Li
CC3 = Chuan Cao, Ming Li
CC4 = Chuan Cao, Ming Li
GP = Geoffroy Peeters
GT1 = George Tzanetakis
GT2 = George Tzanetakis
LWW1 = Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang
LWW2 = Hung-Yi Lo, Ju-Chiang Wang, Hsin-Min Wang
HBC = Matthew D.Hoffman, David M. Blei, Perry R.Cook