Difference between revisions of "2011:MIREX2011 Results"

From MIREX Wiki
(Results by Task)
Line 1: Line 1:
 
==OVERALL RESULTS POSTERS (First Version: Will need updating as last runs are completed)==
 
==OVERALL RESULTS POSTERS (First Version: Will need updating as last runs are completed)==
[https://www.music-ir.org/mirex/results/2010/mirex_2010_poster.pdf MIREX 2010 Overall Results Posters (PDF)]
+
[https://www.music-ir.org/mirex/results/2011/mirex_2011_poster.pdf MIREX 2011 Overall Results Posters (PDF)]
  
 
==Results by Task ==
 
==Results by Task ==
Line 15: Line 15:
  
 
* Audio Beat Tracking Results  
 
* Audio Beat Tracking Results  
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/abt/mck/ MCK Dataset]  (DIY)
+
** [https://nema.lis.illinois.edu/nema_out/mirex2011/results/abt/mck/ MCK Dataset]  (DIY)
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/abt/maz/ MAZ Dataset]  (DIY)
+
** [https://nema.lis.illinois.edu/nema_out/mirex2011/results/abt/maz/ MAZ Dataset]  (DIY)
* [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ace/ Audio Chord Detection]   (DIY)
+
* [https://nema.lis.illinois.edu/nema_out/mirex2011/results/ace/ Audio Chord Detection]   (DIY)
* [[2010:Audio_Cover_Song_Identification_Results | Audio Cover Song Identification Results]]  
+
* [[2011:Audio_Cover_Song_Identification_Results | Audio Cover Song Identification Results]]  
* [https://nema.lis.illinois.edu/nema_out/mirex2010/results/akd/ Audio Key Detection Results]  (DIY)
+
* [https://nema.lis.illinois.edu/nema_out/mirex2011/results/akd/ Audio Key Detection Results]  (DIY)
 
* Audio Melody Extraction Results
 
* Audio Melody Extraction Results
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/adc04/  ADC04 Dataset]  (DIY)
+
** [https://nema.lis.illinois.edu/nema_out/mirex2011/results/ame/adc04/  ADC04 Dataset]  (DIY)
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex05/ MIREX05 Dataset]  (DIY)
+
** [https://nema.lis.illinois.edu/nema_out/mirex2011/results/ame/mirex05/ MIREX05 Dataset]  (DIY)
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/indian08/ INDIAN08 Dataset]  (DIY)
+
** [https://nema.lis.illinois.edu/nema_out/mirex2011/results/ame/indian08/ INDIAN08 Dataset]  (DIY)
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex09_0dB/ MIREX09 0dB Dataset]  (DIY)
+
** [https://nema.lis.illinois.edu/nema_out/mirex2011/results/ame/mirex09_0dB/ MIREX09 0dB Dataset]  (DIY)
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex09_m5dB/ MIREX09 -5dB Dataset]  (DIY)
+
** [https://nema.lis.illinois.edu/nema_out/mirex2011/results/ame/mirex09_m5dB/ MIREX09 -5dB Dataset]  (DIY)
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex09_p5dB/ MIREX09 +5dB Dataset]  (DIY)
+
** [https://nema.lis.illinois.edu/nema_out/mirex2011/results/ame/mirex09_p5dB/ MIREX09 +5dB Dataset]  (DIY)
* [[2010:Audio_Music_Similarity_and_Retrieval_Results | Audio Music Similarity and Retrieval Results]]
+
* [[2011:Audio_Music_Similarity_and_Retrieval_Results | Audio Music Similarity and Retrieval Results]]
* [https://nema.lis.illinois.edu/nema_out/mirex2010/results/aod/ Audio Onset Detection Results]  (DIY)
+
* [https://nema.lis.illinois.edu/nema_out/mirex2011/results/aod/ Audio Onset Detection Results]  (DIY)
 
* Audio Tag Classification Results
 
* Audio Tag Classification Results
 
** Major Miner Tag dataset
 
** Major Miner Tag dataset
*** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask1_report/bin/ Binary relevance (classification evaluation)]  (DIY)
+
*** [https://nema.lis.illinois.edu/nema_out/mirex2011/results/atg/subtask1_report/bin/ Binary relevance (classification evaluation)]  (DIY)
*** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask1_report/aff/ Affinity estimation evaluation]  (DIY)
+
*** [https://nema.lis.illinois.edu/nema_out/mirex2011/results/atg/subtask1_report/aff/ Affinity estimation evaluation]  (DIY)
 
** Mood Tag dataset
 
** Mood Tag dataset
*** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask2_report/bin/ Binary relevance (classification evaluation)]  (DIY)
+
*** [https://nema.lis.illinois.edu/nema_out/mirex2011/results/atg/subtask2_report/bin/ Binary relevance (classification evaluation)]  (DIY)
*** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask2_report/aff/ Affinity estimation evaluation]  (DIY)
+
*** [https://nema.lis.illinois.edu/nema_out/mirex2011/results/atg/subtask2_report/aff/ Affinity estimation evaluation]  (DIY)
* [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ate/ Audio Tempo Estimation Results]  (DIY)
+
* [https://nema.lis.illinois.edu/nema_out/mirex2011/results/ate/ Audio Tempo Estimation Results]  (DIY)
* [[2010:Multiple_Fundamental_Frequency_Estimation_&_Tracking_Results | Multiple Fundamental Frequency Estimation & Tracking Results]]
+
* [[2011:Multiple_Fundamental_Frequency_Estimation_&_Tracking_Results | Multiple Fundamental Frequency Estimation & Tracking Results]]
 
* Music Structure Segmentation Results
 
* Music Structure Segmentation Results
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/struct/mirex09/ MIREX09 dataset]  (DIY)
+
** [https://nema.lis.illinois.edu/nema_out/mirex2011/results/struct/mirex09/ MIREX09 dataset]  (DIY)
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/struct/mirex10/ MIREX10 dataset]  (DIY)
+
** [https://nema.lis.illinois.edu/nema_out/mirex2011/results/struct/mirex10/ MIREX10 dataset]  (DIY)
* [[2010:Query-by-Singing/Humming_Results | Query-by-Singing/Humming Results]]  
+
* [[2011:Query-by-Singing/Humming_Results | Query-by-Singing/Humming Results]]  
* [[2010:Query-by-Tapping_Results | Query-by-Tapping Results]]
+
* [[2011:Query-by-Tapping_Results | Query-by-Tapping Results]]
*[[2010:Real-time_Audio_to_Score_Alignment_(a.k.a._Score_Following)_Results | Real-time Audio to Score Alignment (a.k.a. Score Following) Results ]]
+
*[[2011:Real-time_Audio_to_Score_Alignment_(a.k.a._Score_Following)_Results | Real-time Audio to Score Alignment (a.k.a. Score Following) Results ]]
* [[2010:Symbolic_Melodic_Similarity_Results | Symbolic Melodic Similarity Results]]
+
* [[2011:Symbolic_Melodic_Similarity_Results | Symbolic Melodic Similarity Results]]
  
 
== Machine Specifications ==
 
== Machine Specifications ==
Line 50: Line 50:
 
== Runtime for Submissions Run by NEMA DIY ==
 
== Runtime for Submissions Run by NEMA DIY ==
  
* [[2010:Runtime | Runtime]]
+
* [[2011:Runtime | Runtime]]
  
 
[[Category:Results]]
 
[[Category:Results]]

Revision as of 19:52, 17 October 2011

OVERALL RESULTS POSTERS (First Version: Will need updating as last runs are completed)

MIREX 2011 Overall Results Posters (PDF)

Results by Task

This year we ran many MIREX 2011 Tasks using the new NEMA MIREX DIY infrastructure. Task results with "(DIY)" appended are those generated using the NEMA MIREX DIY system. Where appropriate, do explore the various new outputs that help visualize both individual and task-wide comparative performances. A demonstration video of the NEMA MIREX DIY system can be found is also available.


Train-Test Task Set

Other Tasks

Machine Specifications

Runtime for Submissions Run by NEMA DIY