2009:Audio Melody Extraction Results

From MIREX Wiki
Revision as of 13:12, 13 November 2009 by Mortenwendelboe (talk | contribs)

Introduction

These are the results for the 2009 running of the Audio Melody Extraction task set. For background information about this task set please refer to the Audio Melody Extraction page. There are multiple datasets for this task. ADC04 consists of 20 pieces with vocal and nonvocal melodies. MIREX05 consists of 25 pieces with vocal and nonvocal melodies. MIREX08 consists of 8 pieces all with vocal melodies. MIREX09 consists of 374 pieces all with vocal melodies. MIREX09 is mixed with three different Melodic Voice - to accompaniment ratios. +5dB, 0dB, and -5 dB RMS.

General Legend

Team ID

CL1 = Chuan Cao, Ming Li
CL2 = Chuan Cao, Ming Li
DR1 = Jean-Louis Durrieu, Gaël Richard, Bertrand David (GSMM)
DR2 = Jean-Louis Durrieu, Gaël Richard, Bertrand David (SIMM)
HJC1 = Chao-Ling Hsu, Jyh-Shing Roger Jang, Liang-Yu Chen (DP)
HJC2 = Chao-Ling Hsu, Jyh-Shing Roger Jang, Liang-Yu Chen (HMM)
JJY = Sihyun Joo, Seokhwan Jo, Chang D. Yoo
KD = Karin Dressler
MW = Morten Wendelboe
PC = Pablo Cancela
RR = Vishweshwara Rao,Preeti Rao
TOOS = Hideyuki Tachibana, Takuma Ono, Nobutaka Ono, Shigeki Sagayama

Table Headings

Vx Recall = Voicing Detection
Vx False Alm = Voicing False Alarm
Raw pitch = Raw Pitch Accuracy
Raw Chroma = Raw Chroma Accuracy
Overall Acc = Overall Acuuracy

Overall Summary Results

MIREX 2009 Audio Melody Extraction Overall Summary results - Unweighted Avg. of all Datasets

file /nema-raid/www/mirex/results/melody/melody.unweighted_avg.csv not found

MIREX 2009 Audio Melody Extraction Overall Summary results - Weighted (by Number of Files) Avg. of all Datasets

Note, because the MIREX09 dataset is so large in comparison, the weighted average is heavily weighted to performance on this dataset.

file /nema-raid/www/mirex/results/melody/melody.weighted_avg.csv not found

MIREX 2009 Audio Melody Extraction Summary results - MIREX 2009 Dataset - -5dB mix

file /nema-raid/www/mirex/results/melody/melody.mir09_m5db.csv not found

MIREX 2009 Audio Melody Extraction Summary results - MIREX 2009 Dataset - 0dB mix

file /nema-raid/www/mirex/results/melody/melody.mir09_0db.csv not found

MIREX 2009 Audio Melody Extraction Summary results - MIREX 2009 Dataset - +5dB mix

file /nema-raid/www/mirex/results/melody/melody.mir09_p5db.csv not found

MIREX 2009 Audio Melody Extraction Summary results - MIREX 2008 Dataset - All

file /nema-raid/www/mirex/results/melody/melody.ind08.csv not found

MIREX 2009 Audio Melody Extraction Summary results - MIREX 2005 Dataset - vocal

file /nema-raid/www/mirex/results/melody/melody.mir05_vocal.csv not found

MIREX 2009 Audio Melody Extraction Summary results - MIREX 2005 Dataset - nonvocal

file /nema-raid/www/mirex/results/melody/melody.mir05_nonvocal.csv not found

MIREX 2009 Audio Melody Extraction Summary results - MIREX 2005 Dataset - All

file /nema-raid/www/mirex/results/melody/melody.mir05_all.csv not found

MIREX 2009 Audio Melody Extraction Summary results - ADC 2004 Dataset - vocal

file /nema-raid/www/mirex/results/melody/melody.adc04_vocal.csv not found

MIREX 2009 Audio Melody Extraction Summary results - ADC 2004 Dataset - nonvocal

file /nema-raid/www/mirex/results/melody/melody.adc04_nonvocal.csv not found

MIREX 2009 Audio Melody Extraction Summary results - ADC 2004 Dataset - All

file /nema-raid/www/mirex/results/melody/melody.adc04_all.csv not found

MIREX 2009 Audio Melody Extraction Runtime Data

file /nema-raid/www/mirex/results/melody/melody.runtime.csv not found