ISMIR 2002 announcement
The 1/2-day panel will be held on the morning of Thursday, 17 October 2002. Attendance is free to ISMIR attendees, but there is a limited number of seats available.
Panel title: Music Information Retrieval Evaluation Frameworks.
Moderator: J. Stepehn Downie
Brief Description:
"At ISMIR 2000, symposium organizers presented attendees with the challenge to begin thinking about what a formal framework for meaningful MIR evaluation might look like. At ISMIR 2001, an informal session to discuss the creation of standardized MIR test collections, tasks and evaluation metrics was convened that resulted in two important outcomes. First, it led to the adoption of a formal resolution expressing the pressing need to establish a MIR evaluation framework that could be used by all in the multidisciplinary and multinational MIR research community. This resolution now bears the signatures of 80+ researchers and interested parties and faithfully represents the breadth of MIR's contributing disciplines and nationalities (see the resolution).
Second, it led directly to the upcoming Workshop on the Creation of Standardized Test Collections, Tasks, and Metrics for Music Information Retrieval (MIR) and Music Digital Library (MDL) Evaluation at the Second Joint Conference on Digital Libraries (JCDL 2002) to be held in July 2002 (http://www.ohsu.edu/jcdl/).
This ISMIR 2002 panel on MIR Evaluation Frameworks will build upon and extend the findings of the JCDL workshop. I hope to have this panel session lead to the development of prototype collections, tasks, and metrics that could be unveiled at ISMIR 2003. [See full description: Word, PDF]