Difference between revisions of "2010:MIREX2010 Results"
From MIREX Wiki
m (Reverted edits by Gzhu1 (talk) to last revision by CameronJones) |
|||
| (19 intermediate revisions by 6 users not shown) | |||
| Line 1: | Line 1: | ||
| − | ==OVERALL RESULTS POSTERS ( | + | ==OVERALL RESULTS POSTERS (First Version: Will need updating as last runs are completed)== |
| − | [https://www.music-ir.org/mirex/results/2010/ | + | [https://www.music-ir.org/mirex/results/2010/mirex_2010_poster.pdf MIREX 2010 Overall Results Posters (PDF)] |
| − | [https://www.music-ir.org/ | + | ==Results by Task == |
| + | This year we ran many MIREX 2010 Tasks using the new [http://nema.lis.uiuc.edu/drupal/?q=nema/architecture NEMA MIREX DIY] infrastructure. Task results with "(DIY)" appended are those generated using the NEMA MIREX DIY system. Where appropriate, do explore the various new outputs that help visualize both individual and task-wide comparative performances. A demonstration [https://www.music-ir.org/diy-demo/ video] of the NEMA MIREX DIY system can be found is also available. | ||
| − | |||
===Train-Test Task Set=== | ===Train-Test Task Set=== | ||
| − | * [ | + | * [https://nema.lis.illinois.edu/nema_out/4ffcb482-b83c-4ba6-bc42-9b538b31143c/results/evaluation/ Audio Classical Composer Identification Results ] (DIY) |
| − | * [ | + | * [https://nema.lis.illinois.edu/nema_out/6731c97a-240c-4d3d-8be9-90d715ea04e1/results/evaluation/ Audio Latin Genre Classification Results ] (DIY) |
| − | * [ | + | * [https://nema.lis.illinois.edu/nema_out/9b11a5c8-9fcf-4029-95eb-51ed561cfb5f/results/evaluation/ Audio Music Mood Classification Results ] (DIY) |
| − | * [ | + | * [https://nema.lis.illinois.edu/nema_out/2b5839b3-3012-4f76-8807-31823588ae25/results/evaluation/ Audio Mixed Popular Genre Classification Results ] (DIY) |
===Other Tasks=== | ===Other Tasks=== | ||
| − | * Audio Beat Tracking Results | + | * Audio Beat Tracking Results |
| − | ** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/abt/mck/ MCK Dataset] | + | ** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/abt/mck/ MCK Dataset] (DIY) |
| − | ** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/abt/maz/ MAZ Dataset] | + | ** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/abt/maz/ MAZ Dataset] (DIY) |
| − | * [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ace/ Audio Chord Detection] | + | * [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ace/ Audio Chord Detection] (DIY) |
* [[2010:Audio_Cover_Song_Identification_Results | Audio Cover Song Identification Results]] | * [[2010:Audio_Cover_Song_Identification_Results | Audio Cover Song Identification Results]] | ||
| − | * [https://nema.lis.illinois.edu/nema_out/mirex2010/results/akd/ Audio Key Detection Results] | + | * [https://nema.lis.illinois.edu/nema_out/mirex2010/results/akd/ Audio Key Detection Results] (DIY) |
* Audio Melody Extraction Results | * Audio Melody Extraction Results | ||
| − | ** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/adc04/ ADC04 Dataset] | + | ** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/adc04/ ADC04 Dataset] (DIY) |
| − | ** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex05/ MIREX05 Dataset] | + | ** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex05/ MIREX05 Dataset] (DIY) |
| − | ** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/indian08/ INDIAN08 Dataset] | + | ** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/indian08/ INDIAN08 Dataset] (DIY) |
| − | ** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex09_0dB/ MIREX09 0dB Dataset] | + | ** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex09_0dB/ MIREX09 0dB Dataset] (DIY) |
| − | ** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex09_m5dB/ MIREX09 -5dB Dataset] | + | ** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex09_m5dB/ MIREX09 -5dB Dataset] (DIY) |
| − | ** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex09_p5dB/ MIREX09 +5dB Dataset] | + | ** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ame/mirex09_p5dB/ MIREX09 +5dB Dataset] (DIY) |
* [[2010:Audio_Music_Similarity_and_Retrieval_Results | Audio Music Similarity and Retrieval Results]] | * [[2010:Audio_Music_Similarity_and_Retrieval_Results | Audio Music Similarity and Retrieval Results]] | ||
| − | * [https://nema.lis.illinois.edu/nema_out/mirex2010/results/aod/ Audio Onset Detection Results] | + | * [https://nema.lis.illinois.edu/nema_out/mirex2010/results/aod/ Audio Onset Detection Results] (DIY) |
* Audio Tag Classification Results | * Audio Tag Classification Results | ||
** Major Miner Tag dataset | ** Major Miner Tag dataset | ||
| − | *** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask1_report/bin/ Binary relevance (classification evaluation)] | + | *** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask1_report/bin/ Binary relevance (classification evaluation)] (DIY) |
| − | *** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask1_report/aff/ Affinity estimation evaluation] | + | *** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask1_report/aff/ Affinity estimation evaluation] (DIY) |
** Mood Tag dataset | ** Mood Tag dataset | ||
| − | *** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask2_report/bin/ Binary relevance (classification evaluation)] | + | *** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask2_report/bin/ Binary relevance (classification evaluation)] (DIY) |
| − | *** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask2_report/aff/ Affinity estimation evaluation] | + | *** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/atg/subtask2_report/aff/ Affinity estimation evaluation] (DIY) |
| − | * [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ate/ Audio Tempo Estimation Results] | + | * [https://nema.lis.illinois.edu/nema_out/mirex2010/results/ate/ Audio Tempo Estimation Results] (DIY) |
* [[2010:Multiple_Fundamental_Frequency_Estimation_&_Tracking_Results | Multiple Fundamental Frequency Estimation & Tracking Results]] | * [[2010:Multiple_Fundamental_Frequency_Estimation_&_Tracking_Results | Multiple Fundamental Frequency Estimation & Tracking Results]] | ||
* Music Structure Segmentation Results | * Music Structure Segmentation Results | ||
| − | ** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/struct/mirex09/ MIREX09 dataset] | + | ** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/struct/mirex09/ MIREX09 dataset] (DIY) |
| − | ** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/struct/mirex10/ MIREX10 dataset] | + | ** [https://nema.lis.illinois.edu/nema_out/mirex2010/results/struct/mirex10/ MIREX10 dataset] (DIY) |
* [[2010:Query-by-Singing/Humming_Results | Query-by-Singing/Humming Results]] | * [[2010:Query-by-Singing/Humming_Results | Query-by-Singing/Humming Results]] | ||
* [[2010:Query-by-Tapping_Results | Query-by-Tapping Results]] | * [[2010:Query-by-Tapping_Results | Query-by-Tapping Results]] | ||
| Line 48: | Line 48: | ||
== Machine Specifications == | == Machine Specifications == | ||
| − | == Runtime for | + | == Runtime for Submissions Run by NEMA DIY == |
* [[2010:Runtime | Runtime]] | * [[2010:Runtime | Runtime]] | ||
[[Category:Results]] | [[Category:Results]] | ||
Latest revision as of 22:28, 23 October 2011
Contents
OVERALL RESULTS POSTERS (First Version: Will need updating as last runs are completed)
MIREX 2010 Overall Results Posters (PDF)
Results by Task
This year we ran many MIREX 2010 Tasks using the new NEMA MIREX DIY infrastructure. Task results with "(DIY)" appended are those generated using the NEMA MIREX DIY system. Where appropriate, do explore the various new outputs that help visualize both individual and task-wide comparative performances. A demonstration video of the NEMA MIREX DIY system can be found is also available.
Train-Test Task Set
- Audio Classical Composer Identification Results (DIY)
- Audio Latin Genre Classification Results (DIY)
- Audio Music Mood Classification Results (DIY)
- Audio Mixed Popular Genre Classification Results (DIY)
Other Tasks
- Audio Beat Tracking Results
- MCK Dataset (DIY)
- MAZ Dataset (DIY)
- Audio Chord Detection (DIY)
- Audio Cover Song Identification Results
- Audio Key Detection Results (DIY)
- Audio Melody Extraction Results
- ADC04 Dataset (DIY)
- MIREX05 Dataset (DIY)
- INDIAN08 Dataset (DIY)
- MIREX09 0dB Dataset (DIY)
- MIREX09 -5dB Dataset (DIY)
- MIREX09 +5dB Dataset (DIY)
- Audio Music Similarity and Retrieval Results
- Audio Onset Detection Results (DIY)
- Audio Tag Classification Results
- Major Miner Tag dataset
- Mood Tag dataset
- Audio Tempo Estimation Results (DIY)
- Multiple Fundamental Frequency Estimation & Tracking Results
- Music Structure Segmentation Results
- MIREX09 dataset (DIY)
- MIREX10 dataset (DIY)
- Query-by-Singing/Humming Results
- Query-by-Tapping Results
- Real-time Audio to Score Alignment (a.k.a. Score Following) Results
- Symbolic Melodic Similarity Results
