Difference between revisions of "2018:Automatic Lyrics-to-Audio Alignment Results"
From MIREX Wiki
(→Subtask2: English pop songs) |
(→Results) |
||
Line 68: | Line 68: | ||
===Hansen's dataset mixed=== | ===Hansen's dataset mixed=== | ||
+ | ====Summary Results==== | ||
+ | <csv>2018/ala/hansen/mixed/summary_hansen_mixed.csv</csv> | ||
+ | |||
+ | ====Per-track results==== | ||
+ | |||
+ | CW2 | ||
+ | <csv>2018/ala/hansen/mixed/CW2_hansen_mixed.csv</csv> | ||
+ | |||
+ | CW3 | ||
+ | <csv>2018/ala/hansen/mixed/CW3_hansen_mixed.csv</csv> | ||
+ | |||
+ | GSLW1 | ||
+ | <csv>2018/ala/hansen/mixed/GSLW1_hansen_mixed.csv</csv> | ||
+ | |||
+ | GSLW2 | ||
+ | <csv>2018/ala/hansen/mixed/GSLW2_hansen_mixed.csv</csv> | ||
+ | |||
+ | GSLW3 | ||
+ | <csv>2018/ala/hansen/mixed/GSLW3_hansen_mixed.csv</csv> | ||
===Mauch's dataset=== | ===Mauch's dataset=== | ||
===Gracenote dataset=== | ===Gracenote dataset=== |
Revision as of 09:36, 4 November 2018
Contents
General Legend
Sub code | Submission name | Abstract | Contributors |
---|---|---|---|
CW1 | HMM-based Alignment subtask1 | [PDF] | Chung-Che Wang |
CW2 | HMM-based Alignment monophone acoustic models subtask2 | Chung-Che Wang | |
CW3 | HMM-based Alignment bi-phone acoustic models subtask2 | Chung-Che Wang | |
GSLW1 | GMM-HMM (SAT) Models subtask2 | Chitralekha Gupta, Bidisha Sharma, Haizhou Li, Ye Wang | |
GSLW2 | SAT+DNN Models subtask2 | Chitralekha Gupta, Bidisha Sharma, Haizhou Li, Ye Wang | |
GSLW3 | Non-vocal suppression and SAT Models subtask 2 | Chitralekha Gupta, Bidisha Sharma, Haizhou Li, Ye Wang | |
FFJ1 | subtask 1 & 2 | [PDF] | Yang-Bin Dell Fan, Zhe-Cheng Fan, Jyh-Shing Roger Jang |
Results
Subtask1: A cappella Mandarin Chinese pop songs
Source-separated
Mixed
Subtask2: English pop songs
Hansen's dataset a cappella
Summary Results
Submission | Mean ASE | Mean PCS | Mean PCETW |
---|---|---|---|
CW2 | 0.35 | 0.65 | 0.79 |
CW3 | 0.47 | 0.62 | 0.81 |
GSLW1 | 2.66 | 0.39 | 0.48 |
GSLW2 | 2.90 | 0.35 | 0.40 |
GSLW3 | 5.80 | 0.31 | 0.31 |
Per-track results
CW2
Track | ASE | PCS | PCETW |
---|---|---|---|
Madonna-Beautiful_Stranger_full_ending | 0.31 | 0.570093890373057 | 0.777372262773723 |
i_kissed_a_girl | 0.2 | 0.703915182929027 | 0.848484848484848 |
clocks_cut | 0.19 | 0.790849995302038 | 0.835294117647059 |
rehab | 0.17 | 0.805194335473958 | 0.865131578947369 |
rolling_in_the_deep | 0.82 | 0.481665469290785 | 0.680555555555556 |
sunrise | 0.52 | 0.513409547058522 | 0.672 |
this_afternoon | 0.18 | 0.68360542512406 | 0.895555555555555 |
trick_me | 0.5 | 0.530746028428777 | 0.772413793103448 |
umbrella | 0.52 | 0.546212118854114 | 0.72 |
viva_la_vida | 0.13 | 0.842945012210246 | 0.879432624113475 |
CW3
Track | ASE | PCS | PCETW |
---|---|---|---|
Madonna-Beautiful_Stranger_full_ending | 0.32 | 0.545755317403897 | 0.744525547445255 |
i_kissed_a_girl | 0.25 | 0.674245470835476 | 0.837121212121212 |
clocks_cut | 0.15 | 0.767154471687807 | 0.894117647058824 |
rehab | 0.13 | 0.796814864279409 | 0.898026315789474 |
rolling_in_the_deep | 0.57 | 0.522259080218718 | 0.727777777777778 |
sunrise | 1.72 | 0.267711468622025 | 0.504 |
this_afternoon | 0.15 | 0.683714791923987 | 0.915555555555556 |
trick_me | 0.86 | 0.562015684740021 | 0.875862068965517 |
umbrella | 0.4 | 0.616793375576461 | 0.8425 |
viva_la_vida | 0.17 | 0.78921921137274 | 0.875886524822695 |
GSLW1
Track | ASE | PCS | PCETW |
---|---|---|---|
Madonna-Beautiful_Stranger_full_ending | 0.27 | 0.543259128122919 | 0.805860805860806 |
i_kissed_a_girl | 0.11 | 0.763207570129874 | 0.946969696969697 |
clocks_cut | 0.63 | 0.554917222456744 | 0.905882352941176 |
rehab | 2.07 | 0.071219687000756 | 0.05921052631579 |
rolling_in_the_deep | 3.15 | 0.009252640391624 | 0.027777777777778 |
sunrise | 3.68 | 0.127399217474657 | 0.08 |
this_afternoon | 13.61 | 0 | 0 |
trick_me | 2.97 | 0.080867269977835 | 0 |
umbrella | 0.08 | 0.795244553082193 | 0.97323600973236 |
viva_la_vida | 0.04 | 0.926735844657678 | 0.98936170212766 |
GSLW2
Track | ASE | PCS | PCETW |
---|---|---|---|
Madonna-Beautiful_Stranger_full_ending | 0.48 | 0.47449184033124 | 0.684981684981685 |
i_kissed_a_girl | 0.34 | 0.647207424371483 | 0.829545454545455 |
clocks_cut | 2.33 | 0.570135233602421 | 0.717647058823529 |
rehab | 0.85 | 0.144820599809062 | 0.006578947368421 |
rolling_in_the_deep | 3.19 | 0.016695413804996 | 0.013888888888889 |
sunrise | 4.44 | 0.041273457518474 | 0.008 |
this_afternoon | 13.66 | 0.006072269630639 | 0 |
trick_me | 2.98 | 0.058593676899486 | 0.006896551724138 |
umbrella | 0.48 | 0.788270711351441 | 0.788321167883212 |
viva_la_vida | 0.2 | 0.766924833336262 | 0.968085106382979 |
GSLW3
Track | ASE | PCS | PCETW |
---|---|---|---|
Madonna-Beautiful_Stranger_full_ending | 19.85 | 0.002186924613191 | 0 |
i_kissed_a_girl | 7.61 | 0.026256826598641 | 0.035294117647059 |
clocks_cut | 0.85 | 0.144820599809062 | 0.006578947368421 |
rehab | 9.5 | 0.010902142506288 | 0.013888888888889 |
rolling_in_the_deep | 4 | 0.186314997894924 | 0 |
sunrise | 13.06 | 0.028738675715158 | 0.057777777777778 |
this_afternoon | 2.97 | 0.080867269977835 | 0 |
trick_me | 0.08 | 0.795244553082193 | 0.97323600973236 |
umbrella | 0.04 | 0.926735844657678 | 0.98936170212766 |
viva_la_vida | 0.04 | 0.926735844658 | 0.99 |
Hansen's dataset mixed
Summary Results
file /nema-raid/www/mirex/results/2018/ala/hansen/mixed/summary_hansen_mixed.csv not found
Per-track results
CW2 file /nema-raid/www/mirex/results/2018/ala/hansen/mixed/CW2_hansen_mixed.csv not found
CW3 file /nema-raid/www/mirex/results/2018/ala/hansen/mixed/CW3_hansen_mixed.csv not found
GSLW1 file /nema-raid/www/mirex/results/2018/ala/hansen/mixed/GSLW1_hansen_mixed.csv not found
GSLW2 file /nema-raid/www/mirex/results/2018/ala/hansen/mixed/GSLW2_hansen_mixed.csv not found
GSLW3 file /nema-raid/www/mirex/results/2018/ala/hansen/mixed/GSLW3_hansen_mixed.csv not found