Difference between revisions of "2014:Audio Fingerprinting Results"

From MIREX Wiki
(Summary Results)
 
(14 intermediate revisions by 2 users not shown)
Line 12: Line 12:
  
 
         ! GY1
 
         ! GY1
         | ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/GY1.pdf PDF] || [http://compmus.ime.usp.br Antonio de_Carvalho_Junior],[http://www.pet.di.ufpb.br Leonardo Batista]
+
         | OS Fingerprinting ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/GY1.pdf PDF] || Guang Yang
 
         |-
 
         |-
  
 
         ! WW1
 
         ! WW1
         |   ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/WW1.pdf PDF] ||
+
         | MRAF  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/WW1.pdf PDF] || [http://www.doreso.com Lei Wang],  [http://www.doreso.com Runtao Wang]
 
         |-
 
         |-
  
 
         ! WW2
 
         ! WW2
         |   ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/WW2.pdf PDF] ||
+
         | MRAF_2  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/WW2.pdf PDF] || [http://www.doreso.com Lei Wang],  [http://www.doreso.com Runtao Wang]
 
         |-
 
         |-
  
 
         ! WW3
 
         ! WW3
         |   ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/WW3.pdf PDF] ||
+
         | MRAF_3  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/WW3.pdf PDF] || [http://www.doreso.com Lei Wang],  [http://www.doreso.com Runtao Wang]
 
         |-
 
         |-
  
 
         ! WW4
 
         ! WW4
         |   ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/WW4.pdf PDF] ||
+
         | MRAF_4  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/WW4.pdf PDF] || [http://www.doreso.com Lei Wang],  [http://www.doreso.com Runtao Wang]
 
         |-
 
         |-
  
 
         ! WW5
 
         ! WW5
         |   ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/WW5.pdf PDF] ||
+
         | MRAF_5  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/WW5.pdf PDF] || [http://www.doreso.com Lei Wang],  [http://www.doreso.com Runtao Wang]
 
         |-
 
         |-
  
 
         ! WW6
 
         ! WW6
         |   ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/WW6.pdf PDF] ||
+
         | MRAF_6  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/WW6.pdf PDF] || [http://www.doreso.com Lei Wang],  [http://www.doreso.com Runtao Wang]
 
         |-
 
         |-
  
 
         ! WW7
 
         ! WW7
         |   ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/WW7.pdf PDF] ||
+
         | MRAF_7 ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/WW7.pdf PDF] || [http://www.doreso.com Lei Wang],  [http://www.doreso.com Runtao Wang]
 
         |-
 
         |-
  
 
         ! WW8
 
         ! WW8
         |   ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/WW8.pdf PDF] ||
+
         |MRAF_ 8  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/WW8.pdf PDF] || [http://www.doreso.com Lei Wang],  [http://www.doreso.com Runtao Wang]
 
         |-
 
         |-
  
 
         ! WW9
 
         ! WW9
         |   ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/WW9.pdf PDF] ||
+
         | MRAF_9  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/WW9.pdf PDF] || [http://www.doreso.com Lei Wang],  [http://www.doreso.com Runtao Wang]
 +
        |-
 +
 
 +
        ! DP1
 +
        | audfprint-master  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/DP1.pdf PDF] || [http://www.ee.columbia.edu/~dpwe/ Dan Ellis]
 +
        |-
 +
 
 +
        ! DP2
 +
        | audfprint-master  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2014/DP1.pdf PDF] || [http://www.ee.columbia.edu/~dpwe/ Dan Ellis]
 
         |-
 
         |-
  
Line 55: Line 63:
 
==Summary Results==
 
==Summary Results==
  
===Overall Results===
+
Size of database and running time are announced together with top-1 hit rate in the following table. Note that running time is announced for reference because machine spec, machine status, and number of cores used by a submission are different. IDs and specs of machines are:
 +
 
 +
* A and B: 1.9 GHz, 24 cores CPU, 64 GB RAM
 +
* C: a VM with 8 cores CPU and 32 GB RAM, hosted on 2.4 GHz, 32 cores CPU and 128 GB RAM
 +
 
 +
 
 
<csv>2014/afp/result_2014.csv</csv>
 
<csv>2014/afp/result_2014.csv</csv>

Latest revision as of 02:59, 30 October 2014

Introduction

These are the results for the 2014 running of the Audio Fingerprinting task. For background information about this task set please refer to the 2014:Audio Fingerprinting page.

General Legend

Sub code Submission name Abstract Contributors
GY1 OS Fingerprinting PDF Guang Yang
WW1 MRAF PDF Lei Wang, Runtao Wang
WW2 MRAF_2 PDF Lei Wang, Runtao Wang
WW3 MRAF_3 PDF Lei Wang, Runtao Wang
WW4 MRAF_4 PDF Lei Wang, Runtao Wang
WW5 MRAF_5 PDF Lei Wang, Runtao Wang
WW6 MRAF_6 PDF Lei Wang, Runtao Wang
WW7 MRAF_7 PDF Lei Wang, Runtao Wang
WW8 MRAF_ 8 PDF Lei Wang, Runtao Wang
WW9 MRAF_9 PDF Lei Wang, Runtao Wang
DP1 audfprint-master PDF Dan Ellis
DP2 audfprint-master PDF Dan Ellis

Summary Results

Size of database and running time are announced together with top-1 hit rate in the following table. Note that running time is announced for reference because machine spec, machine status, and number of cores used by a submission are different. IDs and specs of machines are:

  • A and B: 1.9 GHz, 24 cores CPU, 64 GB RAM
  • C: a VM with 8 cores CPU and 32 GB RAM, hosted on 2.4 GHz, 32 cores CPU and 128 GB RAM


Sub
code
Time/machine for builder
(hh:mm:ss/machine ID)
Size of database
(MB)
Time/machine for matcher
(hh:mm:ss/machine ID)
Top-1 hit rate
(%)
note
GY1 15:45:55 (C) 2110 01:42:23 (C) 52.28 4 cores for builder and matcher
WW1 20:03:00 (B) 2151 01:43:02 (B) 90.71
WW2 20:21:33 (B) 2079 01:45:39 (B) 90.86
WW3 20:41:51 (A) 2577 02:23:00 (A) 91.87
WW4 21:31:16 (A) 2151 01:49:29 (A) 90.74
WW5 20:37:13 (A) 2072 01:46:21 (A) 91.60
WW6 21:54:06 (B) 2212 02:01:31 (A) 91.78
WW7 23:28:18 (B) 2013 01:35:15 (A) 91.64
WW8 20:05:41 (A) 1513 02:38:54 (A) 91.73
WW9 20:28:29 (B) 1513 02:21:41 (A) 91.74
DP1 02:26:20 (C) 1107 12:21:49 (C) 79.78 8 cores for builder and 4 cores for matcher
DP2 03:04:37 (C)  153 01:55:13 (C) 41.41 4 cores for builder and 2 cores for matcher

download these results as csv