2009:Audio Melody Extraction Results

From MIREX Wiki
Revision as of 21:38, 11 October 2009 by Muntash1 (talk | contribs) (Team ID)

Introduction

These are the results for the 2008 running of the Audio Melody Extraction task set. For background information about this task set please refer to the Audio Melody Extraction page. There are multiple datasets for this task. ADC04 consists of 20 pieces with vocal and nonvocal melodies. MIREX05 consists of 25 pieces with vocal and nonvocal melodies. MIREX08 consists of 8 pieces all with vocal melodies. MIREX09 consists of 374 pieces all with vocal melodies. MIREX09 is mixed with three different Melodic Voice - to accompaniment ratios. +5dB, 0dB, and -5 dB RMS.

General Legend

Team ID

CL1 = Chuan Cao, Ming Li

CL2 = Chuan Cao, Ming Li

DR1 = Jean-Louis Durrieu, Gaël Richard (GSMM)

DR2 = Jean-Louis Durrieu, Gaël Richard (SIMM)

HJC1 = Chao-Ling Hsu, Jyh-Shing Roger Jang, Liang-Yu Chen (DP)

HJC2 = Chao-Ling Hsu, Jyh-Shing Roger Jang, Liang-Yu Chen (HMM)

JJY = Sihyun Joo, Seokhwan Jo, Chang D. Yoo

KD = Karin Dressler

MW = Morten Wendelboe

PC = Pablo Cancela

RR = Vishweshwara Rao,Preeti Rao

TOOS = Hideyuki Tachibana, Takuma Ono, Nobutaka Ono and Shigeki Sagayama

Table Headings

Vx Recall = Voicing Detection
Vx False Alm = Voicing False Alarm
Raw pitch = Raw Pitch Accuracy
Raw Chroma = Raw Chroma Accuracy
Overall Acc = Overall Acuuracy

Overall Summary Results

MIREX 2009 Audio Melody Extraction Overall Summary results - Weighted (by Number of Files) Avg. of all Datasets

Note, because the MIREX09 dataset is so large in comparison, the weighted average is heavily weighted to performance on this dataset.

file /nema-raid/www/mirex/results/melody/melody.weighted_avg.csv not found

MIREX 2009 Audio Melody Extraction Overall Summary results - Unweighted Avg. of all Datasets

file /nema-raid/www/mirex/results/melody/melody.unweighted_avg.csv not found

MIREX 2009 Audio Melody Extraction Summary results - MIREX 2009 Dataset - -5dB mix

file /nema-raid/www/mirex/results/melody/melody.mir09_m5db.csv not found

MIREX 2009 Audio Melody Extraction Summary results - MIREX 2009 Dataset - 0dB mix

file /nema-raid/www/mirex/results/melody/melody.mir09_0db.csv not found

MIREX 2009 Audio Melody Extraction Summary results - MIREX 2009 Dataset - +5dB mix

file /nema-raid/www/mirex/results/melody/melody.mir09_p5db.csv not found

MIREX 2009 Audio Melody Extraction Summary results - MIREX 2008 Dataset - All

file /nema-raid/www/mirex/results/melody/melody.ind08.csv not found

MIREX 2009 Audio Melody Extraction Summary results - MIREX 2005 Dataset - vocal

file /nema-raid/www/mirex/results/melody/melody.mir05_vocal.csv not found

MIREX 2009 Audio Melody Extraction Summary results - MIREX 2005 Dataset - nonvocal

file /nema-raid/www/mirex/results/melody/melody.mir05_nonvocal.csv not found

MIREX 2009 Audio Melody Extraction Summary results - MIREX 2005 Dataset - All

file /nema-raid/www/mirex/results/melody/melody.mir05_all.csv not found

MIREX 2009 Audio Melody Extraction Summary results - ADC 2004 Dataset - vocal

file /nema-raid/www/mirex/results/melody/melody.adc04_vocal.csv not found

MIREX 2009 Audio Melody Extraction Summary results - ADC 2004 Dataset - nonvocal

file /nema-raid/www/mirex/results/melody/melody.adc04_nonvocal.csv not found

MIREX 2009 Audio Melody Extraction Summary results - ADC 2004 Dataset - All

file /nema-raid/www/mirex/results/melody/melody.adc04_all.csv not found

MIREX 2009 Audio Melody Extraction Runtime Data

TBA