University of Illinois · Graduate School of Library and Information Science · ISRL

The International Music Information Retrieval Systems Evaluation Laboratory (IMIRSEL) Project


The objective of the International Music Information Retrieval Systems Evaluation Laboratory project (IMIRSEL) is the establishment of the necessary resources for the scientifically valid development and evaluation of emerging Music Information Retrieval (MIR) and Music Digital Library (MDL) techniques and technologies. Part of the project is the creation of secure, yet accessible, large-scale collections of music materials in a variety of audio, symbolic and metadata forms. These collections, when coupled with a  set of standardized experimental tasks and standardized evaluation metrics, will allow members of the international MIR/MDL research community to participate in TREC-like evaluation "contests" so they can scientifically compare and contrast their various approaches to making the world's vast store of musical heritage materials ever more available.

IMIRSEL is located at the Graduate School of Library and Information Science (GSLIS) at the University of Illinois at Urbana-Champaign (UIUC). Project Principal Investigator is J. Stephen Downie of GSLIS and Co-Principal Investigator is Prof. Michael Welge of the Automated Learning Group (ALG) of the National Center for Supercomputing Applications (NCSA).

Principal Project Components

The IMIRSEL project comprises to major subprojects:

The Virtual Research Labs (VRL) using Music-to-Knowledge (M2K) project

The VRL subproject is being undertaken to provide a uniform mechanism for the international MIR/MDL community to access the standardized resources of IMIRSEL in a robust, yet secure, manner. The VRLs are constructed using IMIRSEL's M2K rapicd prototyping and evalution environment. M2K is an open-sourced extension of the D2K (Data-to-Knowlege)/Text-to-Knowlege (T2K) Java-based datamining framework, developed by the ALG at NCSA. For more information on M2K please read our M2K (Music-to-Knowledge): A tool set for MIR/MDL development and evaluation pages.

The Human Use of Music Information Retrieval Systems (HUMIRS)

The HUMIRS subproject is designed to provide answers to the Who, What, Where, When , Why and How questions as they pertain to the use of MIR and MDL systems. By focusing on real-world examples of music information seeking the HUMIRS subproject will allow IMIRSEL to develop a set of experimental MIR/MDL evaluation task grounded in reality. This real-world grounding will thus make the set of evaluation tasks much more meaningful as developers prepare their MIR/MDL systems for real-world deployment.

Project Sponsors

Related Articles

International Music Information Retrieval Systems Evaluation Laboratory (IMIRSEL) Project related:

Human Use of Music Information Retrieval Systems (HUMIRS) Project related:



Maintained by :J Stephen Downie
Comments to : jdownie at uiuc dot edu
Last modified: 7 April 2007