Difference between revisions of "2010:MIREX2010 Results"

From MIREX Wiki
(Adding results for 6 NEMA DIY based tasks)
m (Reverted edits by Gzhu1 (talk) to last revision by CameronJones)
 
(36 intermediate revisions by 8 users not shown)
Line 1: Line 1:
==OVERALL RESULTS POSTERS (NOT READY YET)==
+
==OVERALL RESULTS POSTERS (First Version: Will need updating as last runs are completed)==
[https://www.music-ir.org/mirex/results/2010/MIREX2010ResultsPoster1.pdf MIREX 2010 Overall Results Poster #1 (PDF)]  
+
[https://www.music-ir.org/mirex/results/2010/mirex_2010_poster.pdf MIREX 2010 Overall Results Posters (PDF)]
  
[https://www.music-ir.org/mirex/results/2010/MIREX2010ResultsPoster2.pdf MIREX 2010 Overall Results Poster #2 (PDF)]
+
==Results by Task ==
 +
This year we ran many MIREX 2010 Tasks using the new [http://nema.lis.uiuc.edu/drupal/?q=nema/architecture NEMA MIREX DIY] infrastructure. Task results with "(DIY)" appended are those generated using the NEMA MIREX DIY system. Where appropriate, do explore the various new outputs that help visualize both individual and task-wide comparative performances. A demonstration [https://www.music-ir.org/diy-demo/ video] of the NEMA MIREX DIY system can be found is also available.
  
==Results by Task ==
 
  
 
===Train-Test Task Set===
 
===Train-Test Task Set===
* [[2010:Audio_Artist_Identification_Results | Audio Artist Identification Results ]]
+
* [https://nema.lis.illinois.edu/nema_out/4ffcb482-b83c-4ba6-bc42-9b538b31143c/results/evaluation/ Audio Classical Composer Identification Results ]   (DIY)
* [[2010:Audio_Classical_Composer_Identification_Results | Audio Classical Composer Identification Results ]]
+
* [https://nema.lis.illinois.edu/nema_out/6731c97a-240c-4d3d-8be9-90d715ea04e1/results/evaluation/ Audio Latin Genre Classification Results ]   (DIY)
* [[2010:Audio_US_Pop_Genre_Classification_Results | Audio US Pop Genre Classification Results]]
+
* [https://nema.lis.illinois.edu/nema_out/9b11a5c8-9fcf-4029-95eb-51ed561cfb5f/results/evaluation/ Audio Music Mood Classification Results ]   (DIY)
* [[2010:Audio_Latin_Genre_Classification_Results | Audio Latin Genre Classification Results ]]
+
* [https://nema.lis.illinois.edu/nema_out/2b5839b3-3012-4f76-8807-31823588ae25/results/evaluation/ Audio Mixed Popular Genre Classification Results ]   (DIY)
* [[2010:Audio_Music_Mood_Classification_Results | Audio Music Mood Classification Results ]]
+
 
 
 
 
===Other Tasks===
 
===Other Tasks===
  
* Audio Beat Tracking Results
+
* Audio Beat Tracking Results  
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/abt/mck/ MCK Dataset]
+
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/abt/mck/ MCK Dataset]  (DIY)
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/abt/maz/ MAZ Dataset]
+
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/abt/maz/ MAZ Dataset]  (DIY)
* [[2010:Audio_Chord_Detection_Results | Audio Chord Detection]]
+
* [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ace/ Audio Chord Detection]  (DIY)
* [[2010:Audio_Cover_Song_Identification_Results | Audio Cover Song Identification Results]]
+
* [[2010:Audio_Cover_Song_Identification_Results | Audio Cover Song Identification Results]]  
 +
* [https://nema.lis.illinois.edu/nema_out/mirex2010/results/akd/ Audio Key Detection Results]  (DIY)
 +
* Audio Melody Extraction Results
 +
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/adc04/  ADC04 Dataset]  (DIY)
 +
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex05/ MIREX05 Dataset]  (DIY)
 +
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/indian08/ INDIAN08 Dataset]  (DIY)
 +
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex09_0dB/ MIREX09 0dB Dataset]  (DIY)
 +
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex09_m5dB/ MIREX09 -5dB Dataset]  (DIY)
 +
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex09_p5dB/ MIREX09 +5dB Dataset]  (DIY)
 
* [[2010:Audio_Music_Similarity_and_Retrieval_Results | Audio Music Similarity and Retrieval Results]]
 
* [[2010:Audio_Music_Similarity_and_Retrieval_Results | Audio Music Similarity and Retrieval Results]]
* [[2010:Symbolic_Melodic_Similarity_Results | Symbolic Melodic Similarity Results]] 
+
* [https://nema.lis.illinois.edu/nema_out/mirex2010/results/aod/ Audio Onset Detection Results]  (DIY)
* [https://nema.lis.illinois.edu/nema_out/mirex2010/results/akd/ Audio Key Detection Results]
+
* Audio Tag Classification Results
* [https://nema.lis.illinois.edu/nema_out/mirex2010/results/aod/ Audio Onset Detection Results]  
+
** Major Miner Tag dataset
* [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ate/ Audio Tempo Estimation Results]
+
*** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask1_report/bin/ Binary relevance (classification evaluation)]  (DIY)
* Audio Melody Extraction Results
+
*** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask1_report/aff/ Affinity estimation evaluation]  (DIY)
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/adc04/ ADC04 Dataset]
+
** Mood Tag dataset
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex05/ MIREX05 Dataset]
+
*** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask2_report/bin/ Binary relevance (classification evaluation)]  (DIY)
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/indian08/ INDIAN08 Dataset]
+
*** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask2_report/aff/ Affinity estimation evaluation]  (DIY)
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex09_0dB/ MIREX09 0dB Dataset]
+
* [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ate/ Audio Tempo Estimation Results]  (DIY)
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex09_m5dB/ MIREX09 -5dB Dataset]
 
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex09_p5dB/ MIREX09 +5dB Dataset]
 
* [[2010:Audio_Music_Similarity_and_Retrieval_Results | Audio Music Similarity and Retrieval Results]]
 
 
* [[2010:Multiple_Fundamental_Frequency_Estimation_&_Tracking_Results | Multiple Fundamental Frequency Estimation & Tracking Results]]
 
* [[2010:Multiple_Fundamental_Frequency_Estimation_&_Tracking_Results | Multiple Fundamental Frequency Estimation & Tracking Results]]
* [https://nema.lis.illinois.edu/nema_out/mirex2010/results/struct/ Music Structure Segmentation Results]  
+
* Music Structure Segmentation Results
 +
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/struct/mirex09/ MIREX09 dataset]  (DIY)
 +
** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/struct/mirex10/ MIREX10 dataset]  (DIY)
 
* [[2010:Query-by-Singing/Humming_Results | Query-by-Singing/Humming Results]]  
 
* [[2010:Query-by-Singing/Humming_Results | Query-by-Singing/Humming Results]]  
 
* [[2010:Query-by-Tapping_Results | Query-by-Tapping Results]]
 
* [[2010:Query-by-Tapping_Results | Query-by-Tapping Results]]
 +
*[[2010:Real-time_Audio_to_Score_Alignment_(a.k.a._Score_Following)_Results | Real-time Audio to Score Alignment (a.k.a. Score Following) Results ]]
 +
* [[2010:Symbolic_Melodic_Similarity_Results | Symbolic Melodic Similarity Results]]
  
 
== Machine Specifications ==
 
== Machine Specifications ==
+
 
 +
== Runtime for Submissions Run by NEMA DIY ==
 +
 
 +
* [[2010:Runtime | Runtime]]
 +
 
 
[[Category:Results]]
 
[[Category:Results]]

Latest revision as of 22:28, 23 October 2011

OVERALL RESULTS POSTERS (First Version: Will need updating as last runs are completed)

MIREX 2010 Overall Results Posters (PDF)

Results by Task

This year we ran many MIREX 2010 Tasks using the new NEMA MIREX DIY infrastructure. Task results with "(DIY)" appended are those generated using the NEMA MIREX DIY system. Where appropriate, do explore the various new outputs that help visualize both individual and task-wide comparative performances. A demonstration video of the NEMA MIREX DIY system can be found is also available.


Train-Test Task Set

Other Tasks

Machine Specifications

Runtime for Submissions Run by NEMA DIY