Difference between revisions of "2017:Automatic Lyrics-to-Audio Alignment Results"

From MIREX Wiki
(→‎Results)
(→‎Results)
Line 39: Line 39:
  
 
====Per-song results====
 
====Per-song results====
 +
 +
AK1
 +
<csv>2017/ala/results_htk_acap.csv</csv>
 +
 +
AK2
 +
<csv>2017/ala/results_alignD_acap.csv</csv>
 +
 +
AK3
 +
<csv>2017/ala/results_alignL_acap.csv</csv>
 +
 +
DMS1
 +
<csv>2017/ala/results_dms1_acap.csv</csv>
 +
 +
DMS2
 +
<csv>2017/ala/results_dms2_acap.csv</csv>
  
 
===Hansen's Dataset===
 
===Hansen's Dataset===
 +
 +
====Summary Results====
 +
<csv>2017/ala/results_summary_hansen.csv</csv>
 +
 +
====Per-song results====
 
AK1
 
AK1
 
<csv>2017/ala/results_htk_hansen.csv</csv>
 
<csv>2017/ala/results_htk_hansen.csv</csv>
 +
 +
AK2
 +
<csv>2017/ala/results_alignD_hansen.csv</csv>
 +
 +
DMS1
 +
<csv>2017/ala/results_dms1_hansen.csv</csv>
 +
 +
DMS2
 +
<csv>2017/ala/results_dms2_hansen.csv</csv>
 +
 +
 
===Mauchs's Dataset===
 
===Mauchs's Dataset===
 +
 +
====Summary Results====
 +
<csv>2017/ala/results_summary_mauch.csv</csv>
 +
 +
====Per-song results====
 +
AK1
 
<csv>2017/ala/results_htk_mauch.csv</csv>
 
<csv>2017/ala/results_htk_mauch.csv</csv>
 +
 +
AK2
 +
<csv>2017/ala/results_alignD_mauch.csv</csv>
 +
 +
DMS1
 +
<csv>2017/ala/results_dms1_mauch.csv</csv>
 +
 +
DMS2
 +
<csv>2017/ala/results_dms2_mauch.csv</csv>

Revision as of 05:45, 16 October 2017

General Legend

Sub code Submission name Abstract Contributors
AK1 HMM-based Alignment PDF Anna Kruspe
AK2 DTW-based Alignment PDF Anna Kruspe
AK3 Levenshtein-based Alignment PDF Anna Kruspe
DMS1 Automatic Lyrics-to-Audio Alignment with Harmonic Modeling PDF Georgi Dzhambazov, Xavier Serra
DMS2 Automatic Lyrics-to-Audio Alignment with Source Separation PDF Georgi Dzhambazov, Marius Miron


Results

Hansen's Dataset A cappella

Summary Results

file /nema-raid/www/mirex/results/2017/ala/summary_results.csv not found

Per-song results

AK1

Track Average absolute error Percentage of correct segments
clocks 41.510 0.008
i_kissed_a_girl 0.180 0.721
rehab 0.040 0.927
rolling_in_the_deep 0.860 0.438
sunrise 0.670 0.700
this_afternoon 0.990 0.599
trick_me 0.170 0.751
umbrella 1.450 0.462
viva_la_vida 0.120 0.842

download these results as csv

AK2

Track Average absolute error Percentage of correct segments
clocks 73.560 0.008
i_kissed_a_girl 0.270 0.626
rehab 0.290 0.795
rolling_in_the_deep 3.930 0.284
sunrise 0.470 0.761
this_afternoon 1.820 0.385
trick_me 0.110 0.804
umbrella 2.040 0.297
viva_la_vida 5.470 0.209

download these results as csv

AK3

Track Average absolute error Percentage of correct segments
clocks 21.890 0.152
i_kissed_a_girl 0.140 0.704
rehab 0.070 0.889
rolling_in_the_deep 1.060 0.489
sunrise 0.760 0.627
this_afternoon 0.260 0.545
trick_me 0.140 0.762
umbrella 1.300 0.489
viva_la_vida 0.210 0.742

download these results as csv

DMS1 file /nema-raid/www/mirex/results/2017/ala/results_dms1_acap.csv not found

DMS2 file /nema-raid/www/mirex/results/2017/ala/results_dms2_acap.csv not found

Hansen's Dataset

Summary Results

Submission Mean error Median error St. dev. error Mean percentage Median percentage St. dev. percentage
AK1 13.96 7.64 12.73 0.12 0.06 0.12
AK2 27.94 19.58 31.86 0.10 0.03 0.13
AK3 7.34 4.55 7.71 0.25 0.28 0.15
DMS1 26.70 14.94 29.97 0.04 0.02 0.05
DMS2 10.57 2.02 23.30 0.34 0.44 0.18

download these results as csv

Per-song results

AK1

Track Average absolute error Percentage of correct segments
clocks 42.760 0.002
i_kissed_a_girl 7.640 0.052
rehab 6.040 0.061
rolling_in_the_deep 2.990 0.245
sunrise 3.240 0.308
this_afternoon 2.650 0.277
trick_me 18.130 0.078
umbrella 16.330 0.014
viva_la_vida 25.820 0.009

download these results as csv

AK2

Track Average absolute error Percentage of correct segments
clocks 107.720 0.001
i_kissed_a_girl 6.590 0.067
rehab 5.780 0.164
rolling_in_the_deep 31.660 0.002
sunrise 4.260 0.405
this_afternoon 24.200 0.029
trick_me 1.800 0.231
umbrella 49.870 0.004
viva_la_vida 19.580 0.017

download these results as csv

DMS1 file /nema-raid/www/mirex/results/2017/ala/results_dms1_hansen.csv not found

DMS2 file /nema-raid/www/mirex/results/2017/ala/results_dms2_hansen.csv not found


Mauchs's Dataset

Summary Results

Submission Mean error Median error St. dev. error Mean percentage Median percentage St. dev. percentage
AK1 17.70 10.14 17.01 0.08 0.04 0.10
AK2 22.23 16.38 22.08 0.02 0.00 0.04
AK3 9.03 7.52 7.23 0.15 0.15 0.10
DMS1 14.91 10.14 15.30 0.04 0.03 0.04
DMS2 11.64 5.12 13.31 0.14 0.14 0.10

download these results as csv

Per-song results

AK1

Track Average absolute error Percentage of correct segments
Abba.KnowingMeKnowingYou 9.400 0.064
Bangles.EternalFlame 38.270 0.007
Blondie.CallMe 34.340 0.011
Duffy.WarwickAvenue 7.200 0.176
DuranDuran.OrdinaryWorld 12.780 0.020
FranzFerdinand.DoYouWantTo 5.520 0.046
Martika.ToySoldiers 20.050 0.001
Muse.GuidingLight 66.170 0.002
OtisRedding.TheDockOfTheBay 0.920 0.348
Queen.WeAreTheChampions 6.430 0.088
RM-P082 43.130 0.034
RM-P084 9.520 0.101
RobertPalmer.AddictedToLove 10.750 0.019
Santana.BlackMagicWoman 39.870 0.004
SimonAndGarfunkel.Cecilia 5.940 0.041
TakeThat.BackForGood 3.090 0.125
TinaTurner.WhatsLoveGotToDoWithIt 10.850 0.113
Toto.Africa 4.650 0.299
U2.WithOrWithoutYou 19.570 0.024
Zweieck.She 5.610 0.174

download these results as csv

AK2 file /nema-raid/www/mirex/results/2017/ala/results_alignD_mauch.csv not found

DMS1 file /nema-raid/www/mirex/results/2017/ala/results_dms1_mauch.csv not found

DMS2 file /nema-raid/www/mirex/results/2017/ala/results_dms2_mauch.csv not found

Retrieved from "https://www.music-ir.org/mirex/w/index.php?title=2017:Automatic_Lyrics-to-Audio_Alignment_Results&oldid=12266"