Difference between revisions of "2020:Automatic Lyrics-to-Audio Alignment Results"

From MIREX Wiki
Line 10: Line 10:
  
 
     ! GGL1
 
     ! GGL1
     | NUS ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/GYL1.pdf PDF] || [https://www.comp.nus.edu.sg/~chitrale/ Chitralekha Gupta], [http://ece.nus.edu.sg/drupal/?q=node/159 Haizhou Li]
+
     | NUS ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/GL1.pdf PDF] || [https://www.comp.nus.edu.sg/~chitrale/ Chitralekha Gupta], [http://ece.nus.edu.sg/drupal/?q=node/159 Haizhou Li]
 
     |-
 
     |-
  
 
     ! GGL2
 
     ! GGL2
     | NUS ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/GYL1.pdf PDF] || [https://www.comp.nus.edu.sg/~chitrale/ Chitralekha Gupta], [http://ece.nus.edu.sg/drupal/?q=node/159 Haizhou Li]
+
     | NUS ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/GL1.pdf PDF] || [https://www.comp.nus.edu.sg/~chitrale/ Chitralekha Gupta], [http://ece.nus.edu.sg/drupal/?q=node/159 Haizhou Li]
 
     |-
 
     |-
  
 
     ! ZWZL1
 
     ! ZWZL1
     | ZWZL1 ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/SDE1.pdf PDF] || [], [], []
+
     | ZWZL1 ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/ZWZL1.pdf PDF] || [], [], []
 
     |-
 
     |-
  
 
     ! ZWZL2
 
     ! ZWZL2
     | ZWZL2 ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/SDE1.pdf PDF] || [], [], []
+
     | ZWZL2 ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/ZWZL1.pdf PDF] || [], [], []
 
     |-
 
     |-
  
 
     ! ZWZL3
 
     ! ZWZL3
     | ZWZL3 ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/SDE1.pdf PDF] || [], [], []
+
     | ZWZL3 ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2020/ZWZL1.pdf PDF] || [], [], []
 
     |-
 
     |-
  

Revision as of 11:26, 15 October 2020

General Legend

Sub code Submission name Abstract Contributors
GGL1 NUS PDF Chitralekha Gupta, Haizhou Li
GGL2 NUS PDF Chitralekha Gupta, Haizhou Li
ZWZL1 ZWZL1 PDF [], [], []
ZWZL2 ZWZL2 PDF [], [], []
ZWZL3 ZWZL3 PDF [], [], []
DDA1 Audio2Lyrics_emirdemirel PDF Emir Demirel
CC1 Mir lab PDF [Chun-Hao]

Results

UNDER CONSTRUCTION...

Hansen's dataset a cappella

Summary Results

Submission Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
GGL1 0.09 0.03 0.86 0.98
GGL2 0.13 0.03 0.79 0.97
ZWZL1 0.17 0.03 0.79 0.96
ZWZL2 0.11 0.03 0.84 0.97
ZWZL3 0.14 0.03 0.84 0.96
DDA1 0.93 0.95 0.21 0.91

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/GGL2/metrics/results.csv not found

ZWZL1 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/ZWZL1/metrics/results.csv not found


ZWZL2 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/ZWZL2/metrics/results.csv not found

ZWZL3 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/ZWZL3/metrics/results.csv not found

DDA1 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/DDA1/metrics/results.csv not found



Hansen's dataset

Summary Results

Submission Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
GGL1 0.10 0.04 0.80 0.98
GGL2 0.10 0.04 0.78 0.97
ZWZL1 0.32 0.05 0.73 0.92
ZWZL2 0.24 0.05 0.73 0.92
ZWZL3 0.22 0.05 0.72 0.92
DDA1 0.17 0.05 0.20 0.93

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/GGL2/metrics/results.csv not found

ZWZL1 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/ZWZL1/metrics/results.csv not found


ZWZL2 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/ZWZL2/metrics/results.csv not found

ZWZL3 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/ZWZL3/metrics/results.csv not found

DDA1 file /nema-raid/www/mirex/results/2020/ala/HansensDataset/DDA1/metrics/results.csv not found

Mauch's dataset

Summary Results

Submission Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
GGL1 0.22 0.10 NA 0.91
GGL2 0.19 0.10 NA 0.91
ZWZL1 1.33 0.76 NA 0.80
ZWZL2 0.41 0.10 NA 0.87
ZWZL3 0.42 0.10 NA 0.86
DDA1 0.61 0.11 NA 0.86

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/GGL2/metrics/results.csv not found

ZWZL1 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/ZWZL1/metrics/results.csv not found


ZWZL2 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/ZWZL2/metrics/results.csv not found

ZWZL3 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/ZWZL3/metrics/results.csv not found

DDA1 file /nema-raid/www/mirex/results/2020/ala/MauchsDataset/DDA1/metrics/results.csv not found

Jamendo dataset

Summary Results

Submission Average absolute error Median absolute error Percentage of correct segments Percentage of correct onsets with tolerance
GGL1 0.33 0.04 NA 0.94
GGL2 0.22 0.05 NA 0.94
ZWZL1 1.11 0.08 NA 0.81
ZWZL2 0.61 0.06 NA 0.88
ZWZL3 0.64 0.07 NA 0.86
DDA1 0.50 0.09 NA 0.84

download these results as csv

Per-track results

GGL1 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/GGL1/metrics/results.csv not found

GGL2 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/GGL2/metrics/results.csv not found

ZWZL1 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/ZWZL1/metrics/results.csv not found


ZWZL2 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/ZWZL2/metrics/results.csv not found

ZWZL3 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/ZWZL3/metrics/results.csv not found

DDA1 file /nema-raid/www/mirex/results/2020/ala/jamendolyrics/DDA1/metrics/results.csv not found