Difference between revisions of "2014:MIREX2014 Results/ade"

From MIREX Wiki
Line 39: Line 39:
 
! Recall
 
! Recall
 
|-
 
|-
| FK3
+
| FK3*
 
| 79.2
 
| 79.2
 
| 77.6
 
| 77.6
 
| 81.6
 
| 81.6
 
|-
 
|-
| FK4
+
| FK4*
 
| 70.8
 
| 70.8
 
| 68.0
 
| 68.0
Line 59: Line 59:
 
| 70.3
 
| 70.3
 
|-
 
|-
| DBDR3
+
| DBDR3*
 
| 75.2
 
| 75.2
 
| 80.0
 
| 80.0
Line 89: Line 89:
 
| 20.8
 
| 20.8
 
|-
 
|-
| DBDR2
+
| DBDR2*
 
| 83.1
 
| 83.1
 
| 82.6
 
| 82.6
Line 154: Line 154:
 
| 38.7
 
| 38.7
 
|-
 
|-
| KSH1
+
| KSH1*
 
| 77.5
 
| 77.5
 
| 75.9
 
| 75.9
Line 189: Line 189:
 
| 39.4
 
| 39.4
 
|-
 
|-
| KSH1
+
| KSH1*
 
| 85.4
 
| 85.4
 
| 88.2
 
| 88.2
Line 204: Line 204:
 
| 31.0
 
| 31.0
 
|}
 
|}
 +
 +
*) Submissions marked by an asterisk partially include the test set into their training set.

Revision as of 06:12, 9 October 2014

Submitted Algorithms

Submission code Submission name Abstract Contributors
DBDR2 DB1_no_ballroom PDF Simon Durand, Juan Bello, Bertrand David, Gael Richard
DBDR3 DB2_no_beatles PDF Simon Durand, Juan Bello, Bertrand David, Gael Richard
FK3 Ballroom_tracker PDF Florian Krebs
FK4 Ballroom_Pop_tracker PDF Florian Krebs
KSH1 Turkish_Indian_Cretan_tracker PDF Florian Krebs, Andre Holzapfel, Ajay Srinivasamurthy

Table 1. Algorithms submitted to the Automatic Downbeat Estimation task.

Results

Results ballroom dataset
Algorithm F-Measure Precision Recall
FK3* 79.2 77.6 81.6
FK4* 70.8 68.0 75.8
KSH1 19.4 22.7 19.9
DBDR2 70.5 75.4 70.3
DBDR3* 75.2 80.0 75.2


Results beatles dataset
Algorithm F-Measure Precision Recall
FK3 58.8 57.5 63.4
FK4 63.0 59.5 70.2
KSH1 19.4 21.1 20.8
DBDR2* 83.1 82.6 87.1
DBDR3 81.6 81.4 85.6


Results carnatic dataset
Algorithm F-Measure Precision Recall
FK3 16.9 16.1 20.2
FK4 19.4 15.3 30.4
KSH1 40.0 39.9 41.4
DBDR2 18.4 15.6 25.9
DBDR3 20.0 16.9 28.2


Results turkish dataset
Algorithm F-Measure Precision Recall
FK3 19.7 15.8 28.9
FK4 24.0 18.2 38.7
KSH1* 77.5 75.9 81.9
DBDR2 44.8 40.0 55.3
DBDR3 44.8 39.5 56.5


Results cretan dataset
Algorithm F-Measure Precision Recall
FK3 53.5 86.6 39.3
FK4 51.2 74.5 39.4
KSH1* 85.4 88.2 84.1
DBDR2 43.5 65.5 32.5
DBDR3 41.5 62.5 31.0
  • ) Submissions marked by an asterisk partially include the test set into their training set.