2015:Singing Voice Separation Results

From MIREX Wiki

Introduction

Description

These are the results for the 2015 running of the Singing Voice Separation task set. The evaluation set is kindly provided by iKala. If you need to cite this page, please also cite T.-S. Chan, T.-C. Yeh, Z.-C. Fan, H.-W. Chen, L. Su, Y.-H. Yang, and R. Jang, "Vocal activity informed singing voice separation with the iKala dataset," in Proc. IEEE Int. Conf. Acoust., Speech and Signal Process., 2015, pp. 718-722. For more information about this task set please refer to the 2015:Singing Voice Separation page.

Legend

Submission code Submission name Abstract PDF Contributors
FJ1 MIREX 2015 Submission for Singing Voice Separation - Zhe-Cheng Fan, Jyh-Shing Roger Jang
FJ2 MIREX 2015 Submission for Singing Voice Separation - Zhe-Cheng Fan, Jyh-Shing Roger Jang
IIY3 MIREX2015: Singing Voice Separation PDF Yukara Ikemiya, Katsutoshi Itoyama, Kazuyoshi Yoshii
IIY4 MIREX2015: Singing Voice Separation PDF Yukara Ikemiya, Katsutoshi Itoyama, Kazuyoshi Yoshii
MD3 An Ensemble Method for Learning to Extract Vocals from Polyphonic Musical Audio PDF Matt McVicar, Tijl De Bie
MD4 An Ensemble Method for Learning to Extract Vocals from Polyphonic Musical Audio PDF Matt McVicar, Tijl De Bie

Evaluation Criteria

GNSDR = Global Normalized Signal-to-Distortion Ratio
NSDR = Normalized Signal-to-Distortion Ratio
SIR = Signal-to-Interference Ratio
SAR = Signal-to-Artifacts Ratio

Summary

Summary Results

Algorithm Voice GNSDR (dB) Music GNSDR (dB) Runtime (m)
FJ1 6.8236 10.135 3.4014
FJ2 6.3487 9.8678 2.9135
IIY3 4.9862 8.2138 99.1737
IIY4 5.3953 8.77 46.6621
MD3 2.9831 6.3671 121.6655
MD4 3.1022 7.4657 121.1348

NSDR

For the Singing Voice (dB)

<csv>2015/svs/nsdr-voice.csv</csv>

For the Music Accompaniment (dB)

<csv>2015/svs/nsdr-music.csv</csv>

Boxplots

2015-svs-nsdr.png

SIR

For the Singing Voice (dB)

<csv>2015/svs/sir-voice.csv</csv>

For the Music Accompaniment (dB)

<csv>2015/svs/sir-music.csv</csv>

Boxplots

2015-svs-sir.png

SAR

For the Singing Voice (dB)

<csv>2015/svs/sar-voice.csv</csv>

For the Music Accompaniment (dB)

<csv>2015/svs/sar-music.csv</csv>

Boxplots

2015-svs-sar.png

Runtime Data

<csv>2015/svs/runtime.csv</csv>