University of Illinois · Graduate School of Library and Information Science · ISRL

2005 MIREX Contest Results - Audio Tempo Extraction (Contest wiki)


Goal: The comparison and evaluation of current methods for the extraction of tempo from musical audio

Dataset: 140 wav files, 354 Megabytes

Rank Participant Score (std. deviation) At Least One Tempo Correct Both Tempos Correct At Least One Phase Correct Both Phases Correct Mean Absolute Difference
of Scored Saliences
Runtime (s) Machine
1 Alonso, David, & Richard 0.689 (0.231) 95.00% 55.71% 25.00% 5.00% 0.239 2875 G
2 Uhle, C. (1) 0.675 (0.273) 90.71% 59.29% 32.14% 7.14% 0.222 1160 F
3 Uhle, C. (2) 0.675 (0.272) 90.71% 59.29% 32.86% 6.43% 0.222 2621 F
4 Gouyon & Dixon (1) 0.670 (0.252) 92.14% 56.43% 40.71% 7.86% 0.311 3303 G
5 Peeters, G. 0.656 (0.223) 95.71% 47.86% 27.86% 4.29% 0.258 2159 R
6 Gouyon & Dixon (2) 0.649 (0.253) 92.14% 51.43% 37.14% 5.71% 0.305 2050 G
7 Gouyon & Dixon (4) 0.645 (0.294) 87.14% 55.71% 48.57% 10.71% 0.313 1357 G
8 Eck, D. 0.644 (0.300) 86.43% 53.57% 37.14% 5.71% 0.230 1665 Y
9 Davies & Brossier
0.628 (0.284) 86.43% 48.57% 26.43% 4.29% 0.224 1005 R
10 Gouyon & Dixon (3) 0.607 (0.287) 87.14% 47.14% 36.43% 6.43% 0.294 1388 R
11 Sethares, W.
0.597 (0.252) 90.71% 37.86% 30.71% 0.71% 0.239 70975 Y
12 Brossier, P. 0.583 (0.333) 80.71% 51.43% 28.57% 2.14% 0.223 180 B 0
13 Tzanetakis, G. 0.538 (0.359) 71.43% 50.71% 28.57% 3.57% 0.295 7173 B 0

McNemar's Test Results

Statistical probability that algorithms have same error function:  Note: Results of less than 5% indicate significant differences, results of 1% or less indicate highly significant differences.


Tzanetakis, G.
Gouyon & Dixon (3) Gouyon & Dixon (1) Gouyon & Dixon (0) Brossier, P.
Uhle, C. (1) Uhle, C. (0) Sethares, B
Peeters, G
Eck, D.
Davies, M.
Alonso, David, & Richard
Tzanetakis, G.
n/a










Gouyon & Dixon (3) 17.44% n/a









Gouyon & Dixon (1) 50.00% 19.58% n/a








Gouyon & Dixon (0) 12.15% 50.00% 4.61% n/a







Brossier, P.
50.00% 23.54% 55.31% 20.05% n/a






Uhle, C. (1)
2.88% 26.64% 6.76% 31.36% 5.41% n/a





Uhle, C. (0)
2.88% 26.64% 6.31% 30.89% 5.86% 75.00% n/a




Sethares, B.
0.99% 0.02% 0.27% 0.02% 1.24% 0.01% 0.01% n/a



Peeters, G.
34.70% 7.19% 29.83% 6.32% 30.73% 2.40% 2.40% 2.97% n/a


Eck, D.
32.58% 38.04% 38.54% 32.20% 38.54% 12.15% 12.15% 0.41% 18.32% n/a

Davies, M.
38.77% 7.17% 33.59% 6.31% 33.89% 2.67% 2.67% 1.38% 50.00% 21.35% n/a
Alsonso, David, & Richard
18.02% 56.12% 23.99% 50.00% 23.99% 26.64% 26.64% 0.04% 7.62% 39.39% 6.07% n/a




Maintained by :J Stephen Downie
Comments to : jdownie at uiuc dot edu
Last modified: 5 October 2005