Difference between revisions of "2014:MIREX2014 Results/ade"

From MIREX Wiki
Line 203: Line 203:
 
| 62.5
 
| 62.5
 
| 31.0
 
| 31.0
 +
|}
 +
 +
{| class="wikitable sortable" border="1"
 +
|+ Results hjdb dataset
 +
|-
 +
! Algorithm
 +
! F-Measure
 +
! Precision
 +
! Recall
 +
|-
 +
| FK3
 +
| 21.5
 +
| 26.2
 +
| 19.1
 +
|-
 +
| FK4
 +
| 64.0
 +
| 64.2
 +
| 63.9
 +
|-
 +
| KSH1
 +
| 9.4
 +
| 16.7
 +
| 8.5
 +
|-
 +
| DBDR2
 +
| 64.2
 +
| 65.1
 +
| 64.2
 +
|-
 +
| DBDR3
 +
| 66.7
 +
| 67.6
 +
| 66.8
 
|}
 
|}
  
 
*) Submissions marked by an asterisk partially include the test set into their training set.
 
*) Submissions marked by an asterisk partially include the test set into their training set.

Revision as of 06:46, 9 October 2014

Submitted Algorithms

Submission code Submission name Abstract Contributors
DBDR2 DB1_no_ballroom PDF Simon Durand, Juan Bello, Bertrand David, Gael Richard
DBDR3 DB2_no_beatles PDF Simon Durand, Juan Bello, Bertrand David, Gael Richard
FK3 Ballroom_tracker PDF Florian Krebs
FK4 Ballroom_Pop_tracker PDF Florian Krebs
KSH1 Turkish_Indian_Cretan_tracker PDF Florian Krebs, Andre Holzapfel, Ajay Srinivasamurthy

Table 1. Algorithms submitted to the Automatic Downbeat Estimation task.

Results

Results ballroom dataset
Algorithm F-Measure Precision Recall
FK3* 79.2 77.6 81.6
FK4* 70.8 68.0 75.8
KSH1 19.4 22.7 19.9
DBDR2 70.5 75.4 70.3
DBDR3* 75.2 80.0 75.2


Results beatles dataset
Algorithm F-Measure Precision Recall
FK3 58.8 57.5 63.4
FK4 63.0 59.5 70.2
KSH1 19.4 21.1 20.8
DBDR2* 83.1 82.6 87.1
DBDR3 81.6 81.4 85.6


Results carnatic dataset
Algorithm F-Measure Precision Recall
FK3 16.9 16.1 20.2
FK4 19.4 15.3 30.4
KSH1 40.0 39.9 41.4
DBDR2 18.4 15.6 25.9
DBDR3 20.0 16.9 28.2


Results turkish dataset
Algorithm F-Measure Precision Recall
FK3 19.7 15.8 28.9
FK4 24.0 18.2 38.7
KSH1* 77.5 75.9 81.9
DBDR2 44.8 40.0 55.3
DBDR3 44.8 39.5 56.5


Results cretan dataset
Algorithm F-Measure Precision Recall
FK3 53.5 86.6 39.3
FK4 51.2 74.5 39.4
KSH1* 85.4 88.2 84.1
DBDR2 43.5 65.5 32.5
DBDR3 41.5 62.5 31.0
Results hjdb dataset
Algorithm F-Measure Precision Recall
FK3 21.5 26.2 19.1
FK4 64.0 64.2 63.9
KSH1 9.4 16.7 8.5
DBDR2 64.2 65.1 64.2
DBDR3 66.7 67.6 66.8
  • ) Submissions marked by an asterisk partially include the test set into their training set.