Difference between revisions of "2020:Lyrics Transcription Results"

From MIREX Wiki
Line 22: Line 22:
  
 
     ! DDA2
 
     ! DDA2
     | Audio2Lyrics_emirdemirel  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/DDA1.pdf PDF] || [http://www.eecs.qmul.ac.uk/profiles/demirelemir.html Emir Demirel]
+
     | Audio2Lyrics_emirdemirel  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/DDA3.pdf PDF] || [http://www.eecs.qmul.ac.uk/profiles/demirelemir.html Emir Demirel]
 
     |-
 
     |-
 
      
 
      

Revision as of 10:42, 15 October 2020

General Legend

Sub code Submission name Abstract Contributors
GGL1 NUS PDF Chitralekha Gupta, Haizhou Li
GGL2 NUS PDF Chitralekha Gupta, Haizhou Li
RB1 RB1 PDF []
DDA2 Audio2Lyrics_emirdemirel PDF Emir Demirel
DDA3 Audio2Lyrics_emirdemirel PDF Emir Demirel

Results

UNDER CONSTRUCTION...

Hansen's dataset a cappella

Summary Results

Submission Avg WER Avg insertions Avg Deletions Avg Substitutions Avg TotalWords
GGL1 41.86 5.20 58.60 57.60 287.50
GGL2 47.86 4.10 90.50 43.20 287.50
RB1 52.82 12.00 48.40 84.30 287.50
DDA2 38.00 16.20 11.00 82.20 287.50
DDA3 37.02 16.40 13.40 78.10 287.50

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/GGL2/metrics/results.csv not found

RB1 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/RB1/metrics/results.csv not found

DDA2 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/DDA2/metrics/results.csv not found

DDA3 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/DDA3/metrics/results.csv not found


Hansen's dataset

Summary Results

Submission Avg WER Avg insertions Avg Deletions Avg Substitutions Avg TotalWords
GGL1 47.86 6.40 65.10 67.80 287.50
GGL2 47.86 4.10 90.50 43.20 287.50
RB1 83.43 7.60 118.30 118.10 287.50
DDA2 74.81 35.50 17.00 164.60 287.50
DDA3 77.36 6.20 100.70 114.60 287.50

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/GGL2/metrics/results.csv not found

RB1 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/RB1/metrics/results.csv not found

DDA2 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/DDA2/metrics/results.csv not found

DDA3 file /nema-raid/www/mirex/results/2020/lt/HansensDataset/DDA3/metrics/results.csv not found


Mauch's dataset

Summary Results

Submission Avg WER Avg insertions Avg Deletions Avg Substitutions Avg TotalWords
GGL1 47.25 4.65 52.90 62.10 252.60
GGL2 49.54 4.20 61.60 58.65 252.60
RB1 84.98 7.25 84.35 121.45 252.60
DDA2 75.39 30.65 16.05 138.90 252.60
DDA3 80.66 5.35 102.70 94.60 252.60

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/lt/MauchsDataset/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/lt/MauchsDataset/GGL2/metrics/results.csv not found

RB1 file /nema-raid/www/mirex/results/2020/lt/MauchsDataset/RB1/metrics/results.csv not found

DDA2 file /nema-raid/www/mirex/results/2020/lt/MauchsDataset/DDA2/metrics/results.csv not found

DDA3 file /nema-raid/www/mirex/results/2020/lt/MauchsDataset/DDA3/metrics/results.csv not found


Jamendo dataset

Summary Results

Submission Avg WER Avg insertions Avg Deletions Avg Substitutions Avg TotalWords
GGL1 60.98 11.75 67.15 93.10 283.85
GGL2 62.46 8.05 90.05 83.80 283.85
RB1 86.70 8.70 90.60 140.60 283.85
DDA2 72.14 34.45 20.65 134.30 283.85
DDA3 73.09 7.15 85.40 103.40 283.85

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/lt/jamendolyrics/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/lt/jamendolyrics/GGL2/metrics/results.csv not found

RB1 file /nema-raid/www/mirex/results/2020/lt/jamendolyrics/RB1/metrics/results.csv not found

DDA2 file /nema-raid/www/mirex/results/2020/lt/jamendolyrics/DDA2/metrics/results.csv not found

DDA3 file /nema-raid/www/mirex/results/2020/lt/jamendolyrics/DDA3/metrics/results.csv not found