Difference between revisions of "2020:Automatic Lyrics-to-Audio Alignment Results"

From MIREX Wiki
(Per-track results)
m (Reverted edits by Yun Hao (talk) to last revision by Georgi Dzhambazov)
(Tag: Rollback)
Line 48: Line 48:
  
 
GGL1
 
GGL1
<csv>2020/ala/HansensDataset/GGL1/results.csv</csv>
+
<csv>2020/ala/HansensDataset/GGL1/metrics/results.csv</csv>
  
 
GGL2
 
GGL2
<csv>2020/ala/HansensDataset/GGL2/results.csv</csv>
+
<csv>2020/ala/HansensDataset/GGL2/metrics/results.csv</csv>
  
 
ZWZL1
 
ZWZL1
<csv>2020/ala/HansensDataset/ZWZL1/results.csv</csv>
+
<csv>2020/ala/HansensDataset/ZWZL1/metrics/results.csv</csv>
  
  
 
ZWZL2
 
ZWZL2
<csv>2020/ala/HansensDataset/ZWZL2/results.csv</csv>
+
<csv>2020/ala/HansensDataset/ZWZL2/metrics/results.csv</csv>
  
 
ZWZL3
 
ZWZL3
<csv>2020/ala/HansensDataset/ZWZL3/results.csv</csv>
+
<csv>2020/ala/HansensDataset/ZWZL3/metrics/results.csv</csv>
  
 
DDA1
 
DDA1
<csv>2020/ala/HansensDataset/DDA1/results.csv</csv>
+
<csv>2020/ala/HansensDataset/DDA1/metrics/results.csv</csv>
 +
 
 +
 
 +
 
 +
 
  
 
===Hansen's dataset===
 
===Hansen's dataset===
Line 73: Line 77:
  
 
GGL1
 
GGL1
<csv>2020/ala/HansensDataset/GGL1/results.csv</csv>
+
<csv>2020/ala/HansensDataset/GGL1/metrics/results.csv</csv>
  
 
GGL2
 
GGL2
<csv>2020/ala/HansensDataset/GGL2/results.csv</csv>
+
<csv>2020/ala/HansensDataset/GGL2/metrics/results.csv</csv>
  
 
ZWZL1
 
ZWZL1
<csv>2020/ala/HansensDataset/ZWZL1/results.csv</csv>
+
<csv>2020/ala/HansensDataset/ZWZL1/metrics/results.csv</csv>
  
  
 
ZWZL2
 
ZWZL2
<csv>2020/ala/HansensDataset/ZWZL2/results.csv</csv>
+
<csv>2020/ala/HansensDataset/ZWZL2/metrics/results.csv</csv>
  
 
ZWZL3
 
ZWZL3
<csv>2020/ala/HansensDataset/ZWZL3/results.csv</csv>
+
<csv>2020/ala/HansensDataset/ZWZL3/metrics/results.csv</csv>
  
 
DDA1
 
DDA1
<csv>2020/ala/HansensDataset/DDA1/results.csv</csv>
+
<csv>2020/ala/HansensDataset/DDA1/metrics/results.csv</csv>
  
 
===Mauch's dataset===
 
===Mauch's dataset===
Line 98: Line 102:
 
====Per-track results====
 
====Per-track results====
 
GGL1
 
GGL1
<csv>2020/ala/MauchsDataset/GGL1/results.csv</csv>
+
<csv>2020/ala/MauchsDataset/GGL1/metrics/results.csv</csv>
  
 
GGL2
 
GGL2
<csv>2020/ala/MauchsDataset/GGL2/results.csv</csv>
+
<csv>2020/ala/MauchsDataset/GGL2/metrics/results.csv</csv>
  
 
ZWZL1
 
ZWZL1
<csv>2020/ala/MauchsDataset/ZWZL1/results.csv</csv>
+
<csv>2020/ala/MauchsDataset/ZWZL1/metrics/results.csv</csv>
  
  
 
ZWZL2
 
ZWZL2
<csv>2020/ala/MauchsDataset/ZWZL2/results.csv</csv>
+
<csv>2020/ala/MauchsDataset/ZWZL2/metrics/results.csv</csv>
  
 
ZWZL3
 
ZWZL3
<csv>2020/ala/MauchsDataset/ZWZL3/results.csv</csv>
+
<csv>2020/ala/MauchsDataset/ZWZL3/metrics/results.csv</csv>
  
 
DDA1
 
DDA1
<csv>2020/ala/MauchsDataset/DDA1/results.csv</csv>
+
<csv>2020/ala/MauchsDataset/DDA1/metrics/results.csv</csv>
  
 
===Jamendo dataset===
 
===Jamendo dataset===
Line 124: Line 128:
  
 
GGL1
 
GGL1
<csv>2020/ala/jamendolyrics/GGL1/results.csv</csv>
+
<csv>2020/ala/jamendolyrics/GGL1/metrics/results.csv</csv>
  
 
GGL2
 
GGL2
<csv>2020/ala/jamendolyrics/GGL2/results.csv</csv>
+
<csv>2020/ala/jamendolyrics/GGL2/metrics/results.csv</csv>
  
 
ZWZL1
 
ZWZL1
<csv>2020/ala/jamendolyrics/ZWZL1/results.csv</csv>
+
<csv>2020/ala/jamendolyrics/ZWZL1/metrics/results.csv</csv>
  
  
 
ZWZL2
 
ZWZL2
<csv>2020/ala/jamendolyrics/ZWZL2/results.csv</csv>
+
<csv>2020/ala/jamendolyrics/ZWZL2/metrics/results.csv</csv>
  
 
ZWZL3
 
ZWZL3
<csv>2020/ala/jamendolyrics/ZWZL3/results.csv</csv>
+
<csv>2020/ala/jamendolyrics/ZWZL3/metrics/results.csv</csv>
  
 
DDA1
 
DDA1
<csv>2020/ala/jamendolyrics/DDA1/results.csv</csv>
+
<csv>2020/ala/jamendolyrics/DDA1/metrics/results.csv</csv>

Revision as of 19:40, 16 October 2020

General Legend

Sub code Submission name Abstract Contributors
GGL1 NUS PDF Chitralekha Gupta, Haizhou Li
GGL2 NUS PDF Chitralekha Gupta, Haizhou Li
ZWZL1 ZWZL1 PDF [], [], []
ZWZL2 ZWZL2 PDF [], [], []
ZWZL3 ZWZL3 PDF [], [], []
DDA1 Audio2Lyrics_emirdemirel PDF Emir Demirel
CC1 Mir lab PDF [Chun-Hao]

Results

UNDER CONSTRUCTION...

Hansen's dataset a cappella

Summary Results

Submission Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
GGL1 0.09 0.03 0.86 0.98
GGL2 0.13 0.03 0.79 0.97
ZWZL1 0.17 0.03 0.79 0.96
ZWZL2 0.11 0.03 0.84 0.97
ZWZL3 0.14 0.03 0.84 0.96
DDA1 0.93 0.95 0.21 0.91

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/GGL2/metrics/results.csv not found

ZWZL1 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/ZWZL1/metrics/results.csv not found


ZWZL2 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/ZWZL2/metrics/results.csv not found

ZWZL3 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/ZWZL3/metrics/results.csv not found

DDA1 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/DDA1/metrics/results.csv not found



Hansen's dataset

Summary Results

Submission Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
GGL1 0.10 0.04 0.80 0.98
GGL2 0.10 0.04 0.78 0.97
ZWZL1 0.32 0.05 0.73 0.92
ZWZL2 0.24 0.05 0.73 0.92
ZWZL3 0.22 0.05 0.72 0.92
DDA1 0.17 0.05 0.20 0.93

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/GGL2/metrics/results.csv not found

ZWZL1 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/ZWZL1/metrics/results.csv not found


ZWZL2 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/ZWZL2/metrics/results.csv not found

ZWZL3 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/ZWZL3/metrics/results.csv not found

DDA1 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/DDA1/metrics/results.csv not found

Mauch's dataset

Summary Results

Submission Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
GGL1 0.22 0.10 NA 0.91
GGL2 0.19 0.10 NA 0.91
ZWZL1 1.33 0.76 NA 0.80
ZWZL2 0.41 0.10 NA 0.87
ZWZL3 0.42 0.10 NA 0.86
DDA1 0.61 0.11 NA 0.86

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/GGL2/metrics/results.csv not found

ZWZL1 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/ZWZL1/metrics/results.csv not found


ZWZL2 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/ZWZL2/metrics/results.csv not found

ZWZL3 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/ZWZL3/metrics/results.csv not found

DDA1 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/DDA1/metrics/results.csv not found

Jamendo dataset

Summary Results

Submission Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
GGL1 0.33 0.04 NA 0.94
GGL2 0.22 0.05 NA 0.94
ZWZL1 1.11 0.08 NA 0.81
ZWZL2 0.61 0.06 NA 0.88
ZWZL3 0.64 0.07 NA 0.86
DDA1 0.50 0.09 NA 0.84

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/GGL2/metrics/results.csv not found

ZWZL1 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/ZWZL1/metrics/results.csv not found


ZWZL2 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/ZWZL2/metrics/results.csv not found

ZWZL3 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/ZWZL3/metrics/results.csv not found

DDA1 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/DDA1/metrics/results.csv not found