2008:Audio Chord Detection Results

From MIREX Wiki
Revision as of 21:45, 9 September 2008 by Jdownie (talk | contribs) (Task 2 Overall Results)

Introduction

These are the results for the 2008 running of the Audio Chord Detection task set. For background information about this task set please refer to the Audio Chord Detection page.

Task Descriptions

Task 1 (Pretrained Systems) Goto Task 1 Results: MERT NEED DESCRIPTION

Task 2 (Train-Test Systems) Goto Task 2 Results: MERT NEED DESCRIPTION

General Legend

Team ID for ChordPreTrained (Task 1)

BP = J. P. Bello, J. Pickens
KO = M. Khadkevich, M. Omologo
KL1 = K. Lee 1
KL2 = K. Lee 2
PP = H.Papadopoulos, G. Peeters
PVM = J. Pauwels, M. Varewyck, J-P. Martens
RK = M. Ryynänen, A. Klapuri

Team ID for ChordTrainTest (Task 2)

DE = D. Ellis
JL = X. Jhang, C. Lash
KO = M. Khadkevich, M. Omologo
KL = K. Lee (withtrain)
UMS = Y. Uchiyama, K. Miyamoto, S. Sagayama
WD1 = J. Weil
WD2 = J. Weil, J-L. Durrieu

Overall Summary Results

Task 1 Results

Task 1 Overall Results

file /nema-raid/www/mirex/results/chord/task1_results/pretrained_summary.csv not found

Task 1 Summary Data for Download

File Name Set (Pretrained runs)
Summary Overlap Data (Pretrained runs)
Summary Overlap Data (Pretrained runs (Merged maj/min))

Task 1 Friedman's Test for Significant Differences

The Friedman test was run in MATLAB against the Task 1 Overlap Score data over the 176 ground truth songs.


file /nema-raid/www/mirex/results/chord/task1_results/task1_friedman.csv not found

The Tukey-Kramer HSD multi-comparison data below was generate using the following MATLAB instruction.

Command: [c,m,h,gnames] = multcompare(stats, 'ctype', 'tukey-kramer', 'estimate', 'friedman', 'alpha', 0.05); file /nema-raid/www/mirex/results/chord/task1_results/friedman_detailed.csv not found

File:Task1.friedman.png

Task 2 Results

Task 2 Overall Results

file /nema-raid/www/mirex/results/chord/task2_results/summary.csv not found .

Task 2 Summary Data for Download

File Name Set (Train-test runs)
Summary Overlap Data (Train-test runs)
Summary Overlap Data (Train-Test runs (Merged maj/min))

Task Friedman's Test for Significant Differences

The Friedman test was run in MATLAB against the Task 2 Overlap Score data over the 176 ground truth songs.


file /nema-raid/www/mirex/results/chord/task2_results/all3folds_friedman.txt not found

The Tukey-Kramer HSD multi-comparison data below was generate using the following MATLAB instruction.

Command: [c,m,h,gnames] = multcompare(stats, 'ctype', 'tukey-kramer', 'estimate', 'friedman', 'alpha', 0.05); file /nema-raid/www/mirex/results/chord/task2_results/task2_allFolds_friedman_detailed.csv not found

File:Task2.allFolds friedman.png