2005:Audio Tempo Extraction Results

From MIREX Wiki
Revision as of 11:17, 31 July 2010 by Singh14 (talk | contribs)

Introduction

Goal: The comparison and evaluation of current methods for the extraction of tempo from musical audio

Dataset: 140 wav files, 354 Megabytes

Results


Rank Participant Score (std. deviation) At Least One Tempo Correct Both Tempos Correct At Least One Phase Correct Both Phases Correct Mean Absolute Difference of Scored Saliences Runtime (s) Machine
1 Alonso, David, & Richard 0.689 (0.231) 95.00% 55.71% 25.00% 5.00% 0.239 2875 G
2 Uhle, C. (1) 0.675 (0.273) 90.71% 59.29% 32.14% 7.14% 0.222 1160 F
3 Uhle, C. (2) 0.675 (0.272) 90.71% 59.29% 32.86% 6.43% 0.222 2621 F
4 Gouyon & Dixon (1) 0.670 (0.252) 92.14% 56.43% 40.71% 7.86% 0.311 3303 G
5 Peeters, G. 0.656 (0.223) 95.71% 47.86% 27.86% 4.29% 0.258 2159 R
6 Gouyon & Dixon (2) 0.649 (0.253) 92.14% 51.43% 37.14% 5.71% 0.305 2050 G
7 Gouyon & Dixon (4) 0.645 (0.294) 87.14% 55.71% 48.57% 10.71% 0.313 1357 G
8 Eck, D. 0.644 (0.300) 86.43% 53.57% 37.14% 5.71% 0.230 1665 Y
9 Davies & Brossier 0.628 (0.284) 86.43% 48.57% 26.43% 4.29% 0.224 1005 R
10 Gouyon & Dixon (3) 0.607 (0.287) 87.14% 47.14% 36.43% 6.43% 0.294 1388 R
11 Sethares, W. 0.597 (0.252) 90.71% 37.86% 30.71% 0.71% 0.239 70975 Y
12 Brossier, P. 0.583 (0.333) 80.71% 51.43% 28.57% 2.14% 0.223 180 B 0
13 Tzanetakis, G. 0.538 (0.359) 71.43% 50.71% 28.57% 3.57% 0.295 7173 B 0

McNemar's Test Results

Statistical probability that algorithms have same error function: Note: Results of less than 5% indicate significant differences, results of 1% or less indicate highly significant differences.

Tzanetakis, G. Gouyon & Dixon (3) Gouyon & Dixon (1) Gouyon & Dixon (0) Brossier, P. Uhle, C. (1) Uhle, C. (0) Sethares, B Peeters, G Eck, D. Davies, M. Alonso, David, & Richard
Tzanetakis, G. n/a
Gouyon & Dixon (3) 17.44% n/a
Gouyon & Dixon (1) 50.00% 19.58% n/a
Gouyon & Dixon (0) 12.15% 50.00% 4.61% n/a
Brossier, P. 50.00% 23.54% 55.31% 20.05% n/a
Uhle, C. (1) 2.88% 26.64% 6.76% 31.36% 5.41% n/a
Uhle, C. (0) 2.88% 26.64% 6.31% 30.89% 5.86% 75.00% n/a
Sethares, B. 0.99% 0.02% 0.27% 0.02% 1.24% 0.01% 0.01% n/a
Peeters, G. 34.70% 7.19% 29.83% 6.32% 30.73% 2.40% 2.40% 2.97% n/a
Eck, D. 32.58% 38.04% 38.54% 32.20% 38.54% 12.15% 12.15% 0.41% 18.32% n/a
Davies, M. 38.77% 7.17% 33.59% 6.31% 33.89% 2.67% 2.67% 1.38% 50.00% 21.35% n/a
Alsonso, David, & Richard 18.02% 56.12% 23.99% 50.00% 23.99% 26.64% 26.64% 0.04% 7.62% 39.39% 6.07% n/a