Difference between revisions of "2015:Audio Downbeat Estimation Results"
From MIREX Wiki
(→Runtime) |
(→Results) |
||
Line 42: | Line 42: | ||
|- | |- | ||
| DBDR2 | | DBDR2 | ||
− | | 0. | + | | 0.763 |
− | | 0. | + | | 0.807 |
− | | 0. | + | | 0.770 |
|- | |- | ||
− | | DBDR3 | + | | DBDR3 |
− | | 0. | + | | 0.802 |
− | | 0. | + | | 0.838 |
− | | 0. | + | | 0.814 |
|- | |- | ||
| FK2 | | FK2 | ||
− | | 0. | + | | 0.503 |
− | | 0. | + | | 0.515 |
− | | 0. | + | | 0.507 |
|- | |- | ||
− | | FK3 | + | | FK3 |
− | | 0. | + | | 0.595 |
− | | 0. | + | | 0.598 |
− | | 0. | + | | 0.606 |
|- | |- | ||
| FK4 | | FK4 | ||
+ | | 0.179 | ||
+ | | 0.204 | ||
| 0.175 | | 0.175 | ||
− | |||
− | |||
|- | |- | ||
− | | FK6 | + | | FK6 |
− | | 0. | + | | 0.756 |
− | |||
| 0.743 | | 0.743 | ||
+ | | 0.778 | ||
|} | |} | ||
− | |||
{| class="wikitable sortable" border="1" | {| class="wikitable sortable" border="1" | ||
Line 81: | Line 80: | ||
! Recall | ! Recall | ||
|- | |- | ||
− | | DBDR2 | + | | DBDR2 |
| 0.855 | | 0.855 | ||
| 0.866 | | 0.866 | ||
Line 91: | Line 90: | ||
| 0.862 | | 0.862 | ||
|- | |- | ||
− | | FK2 | + | | FK2 |
| 0.713 | | 0.713 | ||
| 0.708 | | 0.708 | ||
Line 97: | Line 96: | ||
|- | |- | ||
| FK3 | | FK3 | ||
− | | 0. | + | | 0.709 |
− | | 0. | + | | 0.706 |
− | | 0. | + | | 0.730 |
|- | |- | ||
| FK4 | | FK4 | ||
Line 107: | Line 106: | ||
|- | |- | ||
| FK6 | | FK6 | ||
− | | 0. | + | | 0.642 |
− | | 0. | + | | 0.616 |
− | | 0. | + | | 0.694 |
|- | |- | ||
|} | |} | ||
Line 138: | Line 137: | ||
|- | |- | ||
| FK3 | | FK3 | ||
− | | 0. | + | | 0.166 |
− | | 0. | + | | 0.144 |
− | | 0. | + | | 0.225 |
|- | |- | ||
| FK4 | | FK4 | ||
Line 148: | Line 147: | ||
|- | |- | ||
| FK6 | | FK6 | ||
− | | 0. | + | | 0.197 |
− | | 0. | + | | 0.160 |
− | | 0. | + | | 0.285 |
|} | |} | ||
Line 178: | Line 177: | ||
|- | |- | ||
| FK3 | | FK3 | ||
− | | 0. | + | | 0.298 |
− | | 0. | + | | 0.249 |
− | | 0. | + | | 0.423 |
|- | |- | ||
| FK4 | | FK4 | ||
Line 188: | Line 187: | ||
|- | |- | ||
| FK6 | | FK6 | ||
− | | 0. | + | | 0.284 |
− | | 0. | + | | 0.232 |
− | | 0. | + | | 0.426 |
|} | |} | ||
Line 219: | Line 218: | ||
|- | |- | ||
| FK3 | | FK3 | ||
− | | 0. | + | | 0.167 |
− | | 0. | + | | 0.249 |
− | | 0. | + | | 0.125 |
|- | |- | ||
| FK4 | | FK4 | ||
Line 229: | Line 228: | ||
|- | |- | ||
| FK6 | | FK6 | ||
− | | 0. | + | | 0.529 |
− | | 0. | + | | 0.791 |
− | | 0. | + | | 0.398 |
|} | |} | ||
Line 259: | Line 258: | ||
|- | |- | ||
| FK3 | | FK3 | ||
− | | 0. | + | | 0.824 |
− | | 0. | + | | 0.824 |
− | | 0. | + | | 0.823 |
|- | |- | ||
| FK4 | | FK4 | ||
Line 269: | Line 268: | ||
|- | |- | ||
| FK6 | | FK6 | ||
− | | 0. | + | | 0.626 |
− | | 0. | + | | 0.627 |
− | | 0. | + | | 0.625 |
|} | |} | ||
Revision as of 04:26, 10 October 2015
Submitted Algorithms
Submission code | Submission name | Abstract | Contributors |
---|---|---|---|
DBDR2 | DB1_no_ballroom | Simon Durand, Juan Bello, Bertrand David, Gael Richard | |
DBDR3 | DB2_no_beatles | Simon Durand, Juan Bello, Bertrand David, Gael Richard | |
FK2 | mixed_no_ballroom | Florian Krebs, Sebastian Böck | |
FK3 | mixed_no_beatles | Florian Krebs, Sebastian Böck | |
FK4 | carnatic_tracker | Florian Krebs, Sebastian Böck | |
FK6 | 2014_FK4_new_ss | Florian Krebs, Sebastian Böck |
Results
Algorithm | F-Measure | Precision | Recall |
---|---|---|---|
DBDR2 | 0.763 | 0.807 | 0.770 |
DBDR3 | 0.802 | 0.838 | 0.814 |
FK2 | 0.503 | 0.515 | 0.507 |
FK3 | 0.595 | 0.598 | 0.606 |
FK4 | 0.179 | 0.204 | 0.175 |
FK6 | 0.756 | 0.743 | 0.778 |
Algorithm | F-Measure | Precision | Recall |
---|---|---|---|
DBDR2 | 0.855 | 0.866 | 0.874 |
DBDR3 | 0.847 | 0.863 | 0.862 |
FK2 | 0.713 | 0.708 | 0.738 |
FK3 | 0.709 | 0.706 | 0.730 |
FK4 | 0.178 | 0.191 | 0.178 |
FK6 | 0.642 | 0.616 | 0.694 |
Algorithm | F-Measure | Precision | Recall |
---|---|---|---|
DBDR2 | 0.221 | 0.195 | 0.297 |
DBDR3 | 0.216 | 0.193 | 0.289 |
FK2 | 0.154 | 0.133 | 0.205 |
FK3 | 0.166 | 0.144 | 0.225 |
FK4 | 0.474 | 0.480 | 0.482 |
FK6 | 0.197 | 0.160 | 0.285 |
Algorithm | F-Measure | Precision | Recall |
---|---|---|---|
DBDR2 | 0.472 | 0.445 | 0.579 |
DBDR3 | 0.446 | 0.409 | 0.558 |
FK2 | 0.289 | 0.247 | 0.393 |
FK3 | 0.298 | 0.249 | 0.423 |
FK4 | 0.142 | 0.145 | 0.151 |
FK6 | 0.284 | 0.232 | 0.426 |
Algorithm | F-Measure | Precision | Recall |
---|---|---|---|
DBDR2 | 0.415 | 0.640 | 0.307 |
DBDR3 | 0.449 | 0.693 | 0.332 |
FK2 | 0.151 | 0.226 | 0.113 |
FK3 | 0.167 | 0.249 | 0.125 |
FK4 | 0.233 | 0.382 | 0.176 |
FK6 | 0.529 | 0.791 | 0.398 |
Algorithm | F-Measure | Precision | Recall |
---|---|---|---|
DBDR2 | 0.691 | 0.725 | 0.676 |
DBDR3 | 0.682 | 0.705 | 0.672 |
FK2 | 0.794 | 0.795 | 0.794 |
FK3 | 0.824 | 0.824 | 0.823 |
FK4 | 0.120 | 0.232 | 0.096 |
FK6 | 0.626 | 0.627 | 0.625 |
*) Rows marked by an asterisk should be taken with care as in those cases overlapping test and training sets were used.
Runtime
All submissions finished the computations in less than 24 hours.