2010:Multiple Fundamental Frequency Estimation & Tracking Results

From MIREX Wiki
Revision as of 17:06, 3 August 2010 by MertBay (talk | contribs)

Introduction

These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the 2009:Multiple Fundamental Frequency Estimation & Tracking page.


General Legend

Sub code Submission name Abstract Contributors
AR1 MultiF0_Yeh_IRCAM 1 Band MF0Est PDF Chunghsin Yeh, Axel Roebel
AR2 MultiF0_Yeh_IRCAM 20 Band MF0Est PDF Chunghsin Yeh, Axel Roebel
AR3 MultiF0_Yeh_IRCAM 1 Band Tracking MF0Est PDF Chunghsin Yeh, Axel Roebel
AR4 MultiF0_Yeh_IRCAM 20 Band Tracking MF0Est PDF Chunghsin Yeh, Axel Roebel
AR5 MultiF0_Yeh_IRCAM 1 Band Note Tracking PDF Chunghsin Yeh, Axel Roebel
AR6 MultiF0_Yeh_IRCAM 20 Band Note Tracking PDF Chunghsin Yeh, Axel Roebel
BD1 Frame-BasedMultiF0 PDF Emmanouil Benetos, Simon Dixon
CRVRC1 MF0UJAV1T1 MultiF0 Est PDF Francisco Jesus Canadas Quesada, Francisco Jose Rodriguez Serrano, Pedro Vera-Candeas, Nicolas Ruiz Reyes, Julio José Carabias-Orti
CRVRC2 MF0UJAV1T2 Note Tracking PDF Francisco Jesus Canadas Quesada, Francisco Jose Rodriguez Serrano, Pedro Vera-Candeas, Nicolas Ruiz Reyes, Julio José Carabias-Orti
CRVRC3 MF0UJAV2T1 MultiF0 Est PDF Francisco Jesus Canadas Quesada, Francisco Jose Rodriguez Serrano, Pedro Vera-Candeas, Nicolas Ruiz Reyes, Julio José Carabias-Orti
CRVRC4 MF0UJAV2T2 Note Tracking PDF Francisco Jesus Canadas Quesada, Francisco Jose Rodriguez Serrano, Pedro Vera-Candeas, Nicolas Ruiz Reyes, Julio José Carabias-Orti
DCL1 Multi-Pitch ND Beta MultiF0 Est PDF Arnaud Dessein, Arshia Cont, Guillaume Lemaitre
DCL2 Multi-Pitch ND Beta Note Tracking PDF Arnaud Dessein, Arshia Cont, Guillaume Lemaitre
DHP1 DuanHanPardo_MultiF0EstTrack MultiF0 Est PDF Zhiyao Duan, Jinyu Han, Bryan Pardo
DHP2 DuanHanPardo_MultiF0EstTrack Note Tracking PDF Zhiyao Duan, Jinyu Han, Bryan Pardo
DHP3 DuanHanPardo_MultiF0EstTrack Instrument Tracking PDF Zhiyao Duan, Jinyu Han, Bryan Pardo
JW1 flexible harmonic model for multipitch estimation MultiF0 Est PDF Jun Wu
JW2 Harmonic Temporal Model for Multiple Pitch Estimation MultiF0 Est PDF Jun Wu
JW3 flexible harmonic model for multipitch estimation Note Tracking PDF Jun Wu
JW4 Harmonic Temporal Model for Multiple Pitch Estimation Note Tracking PDF Jun Wu
LYLC1 CTL_MF0E Multi F0 Est PDF Cheng-Te Lee, Yi-Hsuan Yang, Keng-Sheng Lin, Homer Chen
LYLC2 CTL_MF0E Note Tracking PDF Cheng-Te Lee, Yi-Hsuan Yang, Keng-Sheng Lin, Homer Chen
NNTOS1 MTINS PDF Masahiro Nakano, Tomohiko Nakamura, Iwao Tanuma, Nobutaka Ono, Shigeki Sagayama


Task 1: Multiple Fundamental Frequency Estimation (MF0E)

MF0E Overall Summary Results

Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.


AR1 AR2 AR3 AR4 BD1 CRVRC1 CRVRC3 DCL1 DHP1 JW1 JW2 LYLC1 NNTOS1
Accuracy 0.654 0.655 0.692 0.692 0.468 0.49 0.457 0.457 0.553 0.354 0.361 0.373 0.06
Accuracy Chroma 0.68 0.681 0.71 0.71 0.545 0.544 0.52 0.524 0.594 0.459 0.473 0.457 0.109

download these results as csv

Detailed Results

Precision Recall Accuracy Etot Esubs Emiss Efa
AR1 0.721 0.799 0.654 0.448 0.096 0.105 0.247
AR2 0.722 0.799 0.655 0.446 0.095 0.106 0.245
AR3 0.752 0.829 0.692 0.391 0.084 0.088 0.219
AR4 0.753 0.828 0.692 0.390 0.084 0.088 0.218
BD1 0.716 0.485 0.468 0.558 0.167 0.349 0.043
CRVRC1 0.638 0.556 0.490 0.598 0.198 0.246 0.154
CRVRC3 0.515 0.637 0.457 0.837 0.227 0.136 0.474
DCL1 0.499 0.676 0.457 0.847 0.206 0.119 0.523
DHP1 0.712 0.632 0.553 0.518 0.129 0.239 0.150
JW1 0.369 0.579 0.354 1.146 0.361 0.060 0.725
JW2 0.384 0.541 0.361 1.033 0.382 0.077 0.575
LYLC1 0.584 0.399 0.373 0.681 0.228 0.373 0.080
NNTOS1 0.142 0.061 0.060 0.967 0.277 0.661 0.028

download these results as csv

Detailed Chroma Results

Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

Precision Recall Accuracy Etot Esubs Emiss Efa
AR1 0.750 0.833 0.680 0.415 0.063 0.105 0.247
AR2 0.752 0.832 0.681 0.413 0.063 0.106 0.245
AR3 0.772 0.851 0.710 0.368 0.061 0.088 0.219
AR4 0.772 0.851 0.710 0.367 0.061 0.088 0.218
BD1 0.830 0.567 0.545 0.476 0.085 0.349 0.043
CRVRC1 0.707 0.621 0.544 0.533 0.134 0.246 0.154
CRVRC3 0.587 0.732 0.520 0.742 0.132 0.136 0.474
DCL1 0.574 0.775 0.524 0.748 0.107 0.119 0.523
DHP1 0.766 0.678 0.594 0.471 0.082 0.239 0.150
JW1 0.477 0.767 0.459 0.958 0.172 0.060 0.725
JW2 0.501 0.726 0.473 0.849 0.197 0.077 0.575
LYLC1 0.715 0.490 0.457 0.590 0.137 0.373 0.080
NNTOS1 0.303 0.112 0.109 0.916 0.227 0.661 0.028

download these results as csv

Individual Results Files for Task 1

BVB = Nancy Bertin, Emmanuel Vincent, Roland Badeau
DHP1 = Zhiyao Duan, Jinyu Han,Bryan Pardo
DHP2 = Zhiyao Duan, Jinyu Han,Bryan Pardo
NEOS1 = Masahiro Nakano, Koji Egashira, Nobutaka Ono, Shigeki Sagayama
NEOS2 = Masahiro Nakano, Koji Egashira, Nobutaka Ono, Shigeki Sagayama
NPA1 = Paolo Nesi, Gianni Pantaleo, Fabrizio Argenti
NPA2 = Paolo Nesi, Gianni Pantaleo, Fabrizio Argenti
RS1 = S. A. Raczyński, S. Sagayma
RS2 = S. A. Raczyński, S. Sagayma
RS3 = S. A. Raczyński, S. Sagayma
RS4 = S. A. Raczyński, S. Sagayma
RS5 = S. A. Raczyński, S. Sagayma
RS6 = S. A. Raczyński, S. Sagayma
YR1 = Chunghsin Yeh, Axel Roebel
YR2 = Chunghsin Yeh, Axel Roebel
ZL = Xueliang Zhang, Wenju Liu

Info about the filenames

The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

bs = bassoon, cl = clarinet, fl = flute, hn = horn, ob = oboe, vl = violin, cel = cello, gtr = guitar, sax = saxophone, bass = electric bass guitar

Run Times

file /nema-raid/www/mirex/results/2009/multif0/task1_runtimes.csv not found

TBA

Retrieved from "https://www.music-ir.org/mirex/w/index.php?title=2010:Multiple_Fundamental_Frequency_Estimation_%26_Tracking_Results&oldid=7688"