Difference between revisions of "2019:Automatic Lyrics-to-Audio Alignment Results"

From MIREX Wiki
(Created page with "= General Legend = {| border="1" cellspacing="0" style="text-align: left; width: 800px;" |- style="background: yellow" ! width="80" | Sub code ! width="200" | Sub...")
 
Line 9: Line 9:
 
     |-
 
     |-
  
−
     ! CW1
+
     ! ED1
−
     | HMM-based Alignment subtask1 ||  style="text-align: center;" | [PDF not provided] || [mailto:chungchewang@kkbox.com Chung-Che Wang]
+
     | Audio2Lyrics_emirdemirel ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2019/ED1.pdf PDF] || [http://www.eecs.qmul.ac.uk/profiles/demirelemir.html Emir Demirel]
 
     |-
 
     |-
  
−
     ! CW2
+
     ! GYL1
−
     | HMM-based Alignment monophone acoustic models subtask2 ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2018/CW2.pdf PDF] || [mailto:chungchewang@kkbox.com Chung-Che Wang]
+
     | NUS ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2019/GYL1.pdf PDF] || [https://www.comp.nus.edu.sg/~chitrale/ Chitralekha Gupta], [http://ece.nus.edu.sg/drupal/?q=node/159 Haizhou Li], [https://sites.google.com/site/schemreier/ Emre Yilmaz]
 
     |-
 
     |-
  
−
     ! CW3
+
     ! JH1
−
     | HMM-based Alignment bi-phone acoustic models subtask2 ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2018/CW3.pdf PDF] || [mailto:chungchewang@kkbox.com Chung-Che Wang]
+
     | Force Alignment with Kaldi ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2019/JH1.pdf PDF] || [http://mirlab.org/jang Jyh-Shing Roger Jang], [http://mirlab.org/users/hsiangyu.huang/ Huang Hsiang-Yu]
 
     |-
 
     |-
  
−
     ! GSLW1
+
     ! LJ2
−
     | GMM-HMM (SAT) Models subtask2 ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2018/GSLW1.pdf PDF] || [mailto:chitralekha@u.nus.edu Chitralekha Gupta],  [mailto:s.bidisha@nus.edu.sg Bidisha Sharma], [mailto:haizhou.li@nus.edu.sg Haizhou Li], [mailto:dcswangy@nus.edu.sg Ye Wang]
+
     | Force Alignment with Kaldi ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2019/LJ2.pdf PDF] || [http://mirlab.org/users/eddie.lin/ Chuan You Lin],  [http://mirlab.org/jang Jyh-Shing Roger Jang], [http://mirlab.org/users/hsiangyu.huang/ Huang Hsiang-Yu]
 
     |-
 
     |-
−
 
−
    ! GSLW2
 
−
    | SAT+DNN Models subtask2  ||  style="text-align: center;" |  [https://www.music-ir.org/mirex/abstracts/2018/GSLW2.pdf PDF] || [mailto:chitralekha@u.nus.edu Chitralekha Gupta],  [mailto:s.bidisha@nus.edu.sg Bidisha Sharma], [mailto:haizhou.li@nus.edu.sg Haizhou Li], [mailto:dcswangy@nus.edu.sg Ye Wang]
 
−
    |-
 
−
 
−
    ! GSLW3
 
−
    | Non-vocal suppression and SAT Models subtask 2  ||  style="text-align: center;" |  [https://www.music-ir.org/mirex/abstracts/2018/GSLW3.pdf PDF] || [mailto:chitralekha@u.nus.edu Chitralekha Gupta],  [mailto:s.bidisha@nus.edu.sg Bidisha Sharma], [mailto:haizhou.li@nus.edu.sg Haizhou Li], [mailto:dcswangy@nus.edu.sg Ye Wang]
 
−
    |-
 
−
 
−
    ! FFJ1
 
−
    | subtask 1 & 2        [not able to run their code]  ||  style="text-align: center;" |  [PDF not provided] || [mailto:yangbih0914@gmail.com Yang-Bin Dell Fan], [mailto:lambert.fan@mirllab.org Zhe-Cheng Fan], [mailto:jang@csie.ntu.edu.tw Jyh-Shing Roger Jang]
 
−
    |-
 
−
 
 
|}
 
|}
  
Line 43: Line 30:
 
===Source-separated===
 
===Source-separated===
 
====Summary Results====
 
====Summary Results====
−
<csv>2018/ala/kugou/clean/summary_kugou_clean.csv</csv>
+
<csv>2019/ala/kugou/clean/summary_kugou_clean.csv</csv>
  
 
====Per-track results====
 
====Per-track results====
  
 
CW1
 
CW1
−
<csv>2018/ala/kugou/clean/CW1_kugou_clean.csv</csv>
+
<csv>2019/ala/kugou/clean/CW1_kugou_clean.csv</csv>
  
 
===Mix===
 
===Mix===
 
====Summary Results====
 
====Summary Results====
−
<csv>2018/ala/kugou/mix/summary_kugou_mix.csv</csv>
+
<csv>2019/ala/kugou/mix/summary_kugou_mix.csv</csv>
  
 
====Per-track results====
 
====Per-track results====
  
 
CW1
 
CW1
−
<csv>2018/ala/kugou/mix/CW1_kugou_mix.csv</csv>
+
<csv>2019/ala/kugou/mix/CW1_kugou_mix.csv</csv>
  
 
==Subtask2: English pop songs==
 
==Subtask2: English pop songs==
 
===Hansen's dataset a cappella===
 
===Hansen's dataset a cappella===
 
====Summary Results====
 
====Summary Results====
−
<csv>2018/ala/hansen/clean/summary_hansen_clean.csv</csv>
+
<csv>2019/ala/hansen/clean/summary_hansen_clean.csv</csv>
  
 
====Per-track results====
 
====Per-track results====
  
 
CW2
 
CW2
−
<csv>2018/ala/hansen/clean/CW2_hansen_clean.csv</csv>
+
<csv>2019/ala/hansen/clean/CW2_hansen_clean.csv</csv>
  
 
CW3
 
CW3
−
<csv>2018/ala/hansen/clean/CW3_hansen_clean.csv</csv>
+
<csv>2019/ala/hansen/clean/CW3_hansen_clean.csv</csv>
  
 
GSLW1
 
GSLW1
−
<csv>2018/ala/hansen/clean/GSLW1_hansen_clean.csv</csv>
+
<csv>2019/ala/hansen/clean/GSLW1_hansen_clean.csv</csv>
  
 
GSLW2
 
GSLW2
−
<csv>2018/ala/hansen/clean/GSLW2_hansen_clean.csv</csv>
+
<csv>2019/ala/hansen/clean/GSLW2_hansen_clean.csv</csv>
  
 
GSLW3
 
GSLW3
−
<csv>2018/ala/hansen/clean/GSLW3_hansen_clean.csv</csv>
+
<csv>2019/ala/hansen/clean/GSLW3_hansen_clean.csv</csv>
  
  
 
===Hansen's dataset mix===
 
===Hansen's dataset mix===
 
====Summary Results====
 
====Summary Results====
−
<csv>2018/ala/hansen/mix/summary_hansen_mix.csv</csv>
+
<csv>2019/ala/hansen/mix/summary_hansen_mix.csv</csv>
  
 
====Per-track results====
 
====Per-track results====
  
 
CW2
 
CW2
−
<csv>2018/ala/hansen/mix/CW2_hansen_mix.csv</csv>
+
<csv>2019/ala/hansen/mix/CW2_hansen_mix.csv</csv>
  
 
CW3
 
CW3
−
<csv>2018/ala/hansen/mix/CW3_hansen_mix.csv</csv>
+
<csv>2019/ala/hansen/mix/CW3_hansen_mix.csv</csv>
  
 
GSLW1
 
GSLW1
−
<csv>2018/ala/hansen/mix/GSLW1_hansen_mix.csv</csv>
+
<csv>2019/ala/hansen/mix/GSLW1_hansen_mix.csv</csv>
  
 
GSLW2
 
GSLW2
−
<csv>2018/ala/hansen/mix/GSLW2_hansen_mix.csv</csv>
+
<csv>2019/ala/hansen/mix/GSLW2_hansen_mix.csv</csv>
  
 
GSLW3
 
GSLW3
−
<csv>2018/ala/hansen/mix/GSLW3_hansen_mix.csv</csv>
+
<csv>2019/ala/hansen/mix/GSLW3_hansen_mix.csv</csv>
  
 
===Mauch's dataset===
 
===Mauch's dataset===
  
 
====Summary Results====
 
====Summary Results====
−
<csv>2018/ala/mauch/summary_mauch.csv</csv>
+
<csv>2019/ala/mauch/summary_mauch.csv</csv>
  
 
====Per-track results====
 
====Per-track results====
  
 
CW2
 
CW2
−
<csv>2018/ala/mauch/CW2_mauch.csv</csv>
+
<csv>2019/ala/mauch/CW2_mauch.csv</csv>
  
 
CW3
 
CW3
−
<csv>2018/ala/mauch/CW3_mauch.csv</csv>
+
<csv>2019/ala/mauch/CW3_mauch.csv</csv>
  
 
GSLW1
 
GSLW1
−
<csv>2018/ala/mauch/GSLW1_mauch.csv</csv>
+
<csv>2019/ala/mauch/GSLW1_mauch.csv</csv>
  
 
GSLW2
 
GSLW2
−
<csv>2018/ala/mauch/GSLW2_mauch.csv</csv>
+
<csv>2019/ala/mauch/GSLW2_mauch.csv</csv>
  
 
GSLW3
 
GSLW3
Line 130: Line 117:
 
====Summary Results====
 
====Summary Results====
  
−
<csv>2018/ala/gracenote/summary_gracenote.csv</csv>
+
<csv>2019/ala/gracenote/summary_gracenote.csv</csv>
  
 
====Per-track results====
 
====Per-track results====

Revision as of 13:14, 4 November 2019

General Legend

Sub code Submission name Abstract Contributors
ED1 Audio2Lyrics_emirdemirel PDF Emir Demirel
GYL1 NUS PDF Chitralekha Gupta, Haizhou Li, Emre Yilmaz
JH1 Force Alignment with Kaldi PDF Jyh-Shing Roger Jang, Huang Hsiang-Yu
LJ2 Force Alignment with Kaldi PDF Chuan You Lin, Jyh-Shing Roger Jang, Huang Hsiang-Yu

Results

Subtask1: A cappella Mandarin Chinese pop songs

Source-separated

Summary Results

file /nema-raid/www/mirex/results/2019/ala/kugou/clean/summary_kugou_clean.csv not found

Per-track results

CW1 file /nema-raid/www/mirex/results/2019/ala/kugou/clean/CW1_kugou_clean.csv not found

Mix

Summary Results

file /nema-raid/www/mirex/results/2019/ala/kugou/mix/summary_kugou_mix.csv not found

Per-track results

CW1 file /nema-raid/www/mirex/results/2019/ala/kugou/mix/CW1_kugou_mix.csv not found

Subtask2: English pop songs

Hansen's dataset a cappella

Summary Results

file /nema-raid/www/mirex/results/2019/ala/hansen/clean/summary_hansen_clean.csv not found

Per-track results

CW2 file /nema-raid/www/mirex/results/2019/ala/hansen/clean/CW2_hansen_clean.csv not found

CW3 file /nema-raid/www/mirex/results/2019/ala/hansen/clean/CW3_hansen_clean.csv not found

GSLW1 file /nema-raid/www/mirex/results/2019/ala/hansen/clean/GSLW1_hansen_clean.csv not found

GSLW2 file /nema-raid/www/mirex/results/2019/ala/hansen/clean/GSLW2_hansen_clean.csv not found

GSLW3 file /nema-raid/www/mirex/results/2019/ala/hansen/clean/GSLW3_hansen_clean.csv not found


Hansen's dataset mix

Summary Results

file /nema-raid/www/mirex/results/2019/ala/hansen/mix/summary_hansen_mix.csv not found

Per-track results

CW2 file /nema-raid/www/mirex/results/2019/ala/hansen/mix/CW2_hansen_mix.csv not found

CW3 file /nema-raid/www/mirex/results/2019/ala/hansen/mix/CW3_hansen_mix.csv not found

GSLW1 file /nema-raid/www/mirex/results/2019/ala/hansen/mix/GSLW1_hansen_mix.csv not found

GSLW2 file /nema-raid/www/mirex/results/2019/ala/hansen/mix/GSLW2_hansen_mix.csv not found

GSLW3 file /nema-raid/www/mirex/results/2019/ala/hansen/mix/GSLW3_hansen_mix.csv not found

Mauch's dataset

Summary Results

file /nema-raid/www/mirex/results/2019/ala/mauch/summary_mauch.csv not found

Per-track results

CW2 file /nema-raid/www/mirex/results/2019/ala/mauch/CW2_mauch.csv not found

CW3 file /nema-raid/www/mirex/results/2019/ala/mauch/CW3_mauch.csv not found

GSLW1 file /nema-raid/www/mirex/results/2019/ala/mauch/GSLW1_mauch.csv not found

GSLW2 file /nema-raid/www/mirex/results/2019/ala/mauch/GSLW2_mauch.csv not found

GSLW3

Track ASE PCS PCETW
Abba.KnowingMeKnowingYou 16.78 0.013470170808295 0
Bangles.EternalFlame 11.14 0.02898885485713 0.027450980392157
Blondie.CallMe 38.38 0 0
Duffy.WarwickAvenue 22.44 0.002410707267485 0.003787878787879
DuranDuran.OrdinaryWorld 26.87 0.026182638371089 0.030651340996169
FranzFerdinand-DoYouWanTo 13.38 0.00161317780798 0
Martika.ToySoldiers 21.94 0.0166667440527 0.03
Muse.GuidingLight 19.4 0.023893393487038 0.008620689655172
OtisRedding.TheDockOfTheBay 41.62 0 0
RM-P082 36.45 0.002038977644714 0
RM-P084 9.48 0.08661632622508 0.2
Queen.WeAreTheChampions 26.9 0 0
RobertPalmer.AddictedToLove 31.52 0 0
Santana.BlackMagicWoman 29.5 0.123035938934082 0
SimonAndGarfunkel.Cecilia 38.23 0 0
TakeThat.BackForGood 10.99 0.028435153463603 0.047619047619048
TinaTurner.WhatsLoveGotToDoWithIt 25.93 0.02372512809696 0.015479876160991
Toto.Africa 11.81 0.002388174061774 0.018939393939394
U2.WithOrWithoutYou 14.81 0.011272516767769 0.005235602094241
Zweieck.She 22.05 0.00600489576593 0.008583690987124

download these results as csv


Gracenote dataset

Summary Results

file /nema-raid/www/mirex/results/2019/ala/gracenote/summary_gracenote.csv not found

Per-track results

CW2

Track ASE PCS PCETW
1979 2.08 0.189524289551553 0.340909090909091
abba 0.98 0.465395243109086 0.452054794520548
biggie 0.81 0.329478528034905 0.474789915966386
daft_punk 0.46 0.423693600833937 0.7
hand 0.48 0.510502645779476 0.666666666666667
jackson 0.21 0.521940486426134 0.725663716814159
metalica 0.31 0.713282043872111 0.836734693877551
swift 0.29 0.516066812994904 0.675675675675676

download these results as csv

CW3

Track ASE PCS PCETW
1979 16.17 0.002083709800278 0
abba 0.74 0.574175520019131 0.575342465753425
biggie 0.67 0.396017715374031 0.592436974789916
daft_punk 0.24 0.530720324881901 0.790909090909091
hand 0.16 0.630913612888076 0.80952380952381
jackson 0.25 0.55487554898221 0.734513274336283
metalica 0.05 0.881932715921628 0.979591836734694
swift 0.39 0.518921966930623 0.666666666666667

download these results as csv

GSLW1

Track ASE PCS PCETW
1979 0.7 0.471736541841666 0.477272727272727
abba 34.81 0 0
biggie 0.1 0.710141498785837 0.899159663865546
daft_punk 3.45 0.014179411316212 0
hand 0.43 0.6370494418781 0.73015873015873
jackson 0.41 0.458996116408416 0.592920353982301
metalica 11.91 0.112442602544362 0.122448979591837
swift 0.98 0.555695178426554 0.702702702702703

download these results as csv

GSLW2

Track ASE PCS PCETW
1979 12.9 0.046342268559824 0.045454545454546
abba 7.08 0.032851312176306 0
biggie 0.26 0.57316635402032 0.747899159663866
daft_punk 5.02 0.03246320447596 0.063636363636364
hand 1 0.47098537428266 0.555555555555556
jackson 4.03 0.055932716662936 0.097345132743363
metalica 5.93 0.081781803648049 0.061224489795918
swift 1.57 0.243281251760399 0.324324324324324

download these results as csv

GSLW3

Track ASE PCS PCETW
1979 18.13 0 0
abba 44.19 0.008399393011728 0.027397260273973
biggie 74.04 0 0
daft_punk 85.49 0 0
hand 24.49 0 0
jackson 56.51 0 0
metalica 41.98 0 0
swift 71.94 0 0

download these results as csv

Retrieved from "https://www.music-ir.org/mirex/w/index.php?title=2019:Automatic_Lyrics-to-Audio_Alignment_Results&oldid=13107"