2005:Audio Melody Extraction Results

Rank	Participant	A. Voicing Detection	B. Voicing False Alarm	C. Voicing d-prime	D. Raw Pitch Accuracy	E. Raw Chroma Accuracy	F. Overall Accuracy	Runtime (s)	Machine
1	Dressler, K.	81.8%	17.3%	1.85	68.1%	71.4%	71.4%	32	R
2	Ryynänen & Klapuri	90.3%	39.5%	1.56	68.6%	74.1%	64.3%	10970	L
3	Poliner & Ellis	91.6%	42.7%	1.56	67.3%	73.4%	61.1%	5471	B 0
3	Paiva, R. 2	68.8%	23.2%	1.22	58.5%	62.0%	61.1%	45618	Y
5	Marolt, M.	72.7%	32.4%	1.06	60.1%	67.1%	59.5%	12461	F
6	Paiva, R. 1	83.4%	55.8%	0.83	62.7%	66.7%	57.8%	44312	G
7	Goto, M.	99.9% *	99.4% *	0.59 *	65.8%	71.8%	49.9% *	211	F
8	Vincent & Plumbley 1	96.1% *	93.7% *	0.23 *	59.8%	67.6%	47.9% *	?	G
9	Vincent & Plumbley 2	99.6% *	96.4% *	0.86 *	59.6%	71.1%	46.4% *	251	G
10	Brossier, P.	99.2% * †	98.8% * †	0.14 * †	3.9% †	8.1% †	3.2% * †	41	B 0

Notes: Bold numbers are the best in each column

• Goto, Vincent, and Brossier did not perform voiced/unvoiced detection, so the starred results cannot be meaningfully compared to other systems. The Voicing rates are not 100% because for a few files these systems reported small numbers of no-voicing frames because the pitch tracking terminated early, and the remainder of the time was padded with zeros.

† Scores for Brossier are artificially low due to an unresolved algorithmic issue.