Difference between revisions of "2010:MIREX2010 Results"

From MIREX Wiki
m (Reverted edits by Gzhu1 (talk) to last revision by CameronJones)
 
(19 intermediate revisions by 6 users not shown)
Line 1: Line 1:
==OVERALL RESULTS POSTERS (NOT READY YET)==
+
==OVERALL RESULTS POSTERS (First Version: Will need updating as last runs are completed)==
[https://www.music-ir.org/mirex/results/2010/MIREX2010ResultsPoster1.pdf MIREX 2010 Overall Results Poster #1 (PDF)]  
+
[https://www.music-ir.org/mirex/results/2010/mirex_2010_poster.pdf MIREX 2010 Overall Results Posters (PDF)]
  
[https://www.music-ir.org/mirex/results/2010/MIREX2010ResultsPoster2.pdf MIREX 2010 Overall Results Poster #2 (PDF)]
+
==Results by Task ==
 +
This year we ran many MIREX 2010 Tasks using the new [http://nema.lis.uiuc.edu/drupal/?q=nema/architecture NEMA MIREX DIY] infrastructure. Task results with "(DIY)" appended are those generated using the NEMA MIREX DIY system. Where appropriate, do explore the various new outputs that help visualize both individual and task-wide comparative performances. A demonstration [https://www.music-ir.org/diy-demo/ video] of the NEMA MIREX DIY system can be found is also available.
  
==Results by Task ==
 
  
 
===Train-Test Task Set===
 
===Train-Test Task Set===
* [[2010:Audio_Classical_Composer_Identification_Results | Audio Classical Composer Identification Results ]]
+
* [https://nema.lis.illinois.edu/nema_out/4ffcb482-b83c-4ba6-bc42-9b538b31143c/results/evaluation/ Audio Classical Composer Identification Results ]   (DIY)
* [[2010:Audio_Mixed_Popular_Genre_Classification_Results | Audio Mixed Popular Genre Classification Results]]
+
* [https://nema.lis.illinois.edu/nema_out/6731c97a-240c-4d3d-8be9-90d715ea04e1/results/evaluation/ Audio Latin Genre Classification Results ]   (DIY)
* [[2010:Audio_Latin_Genre_Classification_Results | Audio Latin Genre Classification Results ]]
+
* [https://nema.lis.illinois.edu/nema_out/9b11a5c8-9fcf-4029-95eb-51ed561cfb5f/results/evaluation/ Audio Music Mood Classification Results ]   (DIY)
* [[2010:Audio_Music_Mood_Classification_Results | Audio Music Mood Classification Results ]]
+
* [https://nema.lis.illinois.edu/nema_out/2b5839b3-3012-4f76-8807-31823588ae25/results/evaluation/ Audio Mixed Popular Genre Classification Results ]   (DIY)
  
 
===Other Tasks===
 
===Other Tasks===
  
* Audio Beat Tracking Results
+
* Audio Beat Tracking Results  
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/abt/mck/ MCK Dataset]
+
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/abt/mck/ MCK Dataset]  (DIY)
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/abt/maz/ MAZ Dataset]
+
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/abt/maz/ MAZ Dataset]  (DIY)
* [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ace/ Audio Chord Detection]
+
* [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ace/ Audio Chord Detection]  (DIY)
 
* [[2010:Audio_Cover_Song_Identification_Results | Audio Cover Song Identification Results]]  
 
* [[2010:Audio_Cover_Song_Identification_Results | Audio Cover Song Identification Results]]  
* [https://nema.lis.illinois.edu/nema_out/mirex2010/results/akd/ Audio Key Detection Results]
+
* [https://nema.lis.illinois.edu/nema_out/mirex2010/results/akd/ Audio Key Detection Results]  (DIY)
 
* Audio Melody Extraction Results
 
* Audio Melody Extraction Results
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/adc04/  ADC04 Dataset]
+
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/adc04/  ADC04 Dataset]  (DIY)
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex05/ MIREX05 Dataset]
+
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex05/ MIREX05 Dataset]  (DIY)
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/indian08/ INDIAN08 Dataset]
+
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/indian08/ INDIAN08 Dataset]  (DIY)
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex09_0dB/ MIREX09 0dB Dataset]
+
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex09_0dB/ MIREX09 0dB Dataset]  (DIY)
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex09_m5dB/ MIREX09 -5dB Dataset]
+
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex09_m5dB/ MIREX09 -5dB Dataset]  (DIY)
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex09_p5dB/ MIREX09 +5dB Dataset]
+
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex09_p5dB/ MIREX09 +5dB Dataset]  (DIY)
 
* [[2010:Audio_Music_Similarity_and_Retrieval_Results | Audio Music Similarity and Retrieval Results]]
 
* [[2010:Audio_Music_Similarity_and_Retrieval_Results | Audio Music Similarity and Retrieval Results]]
* [https://nema.lis.illinois.edu/nema_out/mirex2010/results/aod/ Audio Onset Detection Results]  
+
* [https://nema.lis.illinois.edu/nema_out/mirex2010/results/aod/ Audio Onset Detection Results]  (DIY)
 
* Audio Tag Classification Results
 
* Audio Tag Classification Results
 
** Major Miner Tag dataset
 
** Major Miner Tag dataset
*** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask1_report/bin/ Binary relevance (classification evaluation)]
+
*** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask1_report/bin/ Binary relevance (classification evaluation)]  (DIY)
*** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask1_report/aff/ Affinity estimation evaluation]
+
*** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask1_report/aff/ Affinity estimation evaluation]  (DIY)
 
** Mood Tag dataset
 
** Mood Tag dataset
*** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask2_report/bin/ Binary relevance (classification evaluation)]
+
*** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask2_report/bin/ Binary relevance (classification evaluation)]  (DIY)
*** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask2_report/aff/ Affinity estimation evaluation]
+
*** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask2_report/aff/ Affinity estimation evaluation]  (DIY)
* [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ate/ Audio Tempo Estimation Results]  
+
* [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ate/ Audio Tempo Estimation Results]  (DIY)
 
* [[2010:Multiple_Fundamental_Frequency_Estimation_&_Tracking_Results | Multiple Fundamental Frequency Estimation & Tracking Results]]
 
* [[2010:Multiple_Fundamental_Frequency_Estimation_&_Tracking_Results | Multiple Fundamental Frequency Estimation & Tracking Results]]
 
* Music Structure Segmentation Results
 
* Music Structure Segmentation Results
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/struct/mirex09/ MIREX09 dataset]
+
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/struct/mirex09/ MIREX09 dataset]  (DIY)
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/struct/mirex10/ MIREX10 dataset]
+
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/struct/mirex10/ MIREX10 dataset]  (DIY)
 
* [[2010:Query-by-Singing/Humming_Results | Query-by-Singing/Humming Results]]  
 
* [[2010:Query-by-Singing/Humming_Results | Query-by-Singing/Humming Results]]  
 
* [[2010:Query-by-Tapping_Results | Query-by-Tapping Results]]
 
* [[2010:Query-by-Tapping_Results | Query-by-Tapping Results]]
Line 48: Line 48:
 
== Machine Specifications ==
 
== Machine Specifications ==
  
== Runtime for Submission Run by NEMA DIY ==
+
== Runtime for Submissions Run by NEMA DIY ==
  
 
* [[2010:Runtime | Runtime]]
 
* [[2010:Runtime | Runtime]]
  
 
[[Category:Results]]
 
[[Category:Results]]

Latest revision as of 22:28, 23 October 2011

OVERALL RESULTS POSTERS (First Version: Will need updating as last runs are completed)

MIREX 2010 Overall Results Posters (PDF)

Results by Task

This year we ran many MIREX 2010 Tasks using the new NEMA MIREX DIY infrastructure. Task results with "(DIY)" appended are those generated using the NEMA MIREX DIY system. Where appropriate, do explore the various new outputs that help visualize both individual and task-wide comparative performances. A demonstration video of the NEMA MIREX DIY system can be found is also available.


Train-Test Task Set

Other Tasks

Machine Specifications

Runtime for Submissions Run by NEMA DIY