Difference between revisions of "2011:Audio Similarity 2011 Graders"

From MIREX Wiki
(Created page with "=AMS 2011 Graders= Welcome to the SMS grader sign-up page. Please give us your name and email contact information. If you obscure your email, please make it relatively obvious t...")
 
(AMS 2011 Graders)
Line 1: Line 1:
 
=AMS 2011 Graders=
 
=AMS 2011 Graders=
  
Welcome to the SMS grader sign-up page. Please give us your name and email contact information. If you obscure your email, please make it relatively obvious to us how to parse the address.
+
Welcome to the AMS grader sign-up page. Please give us your name and email contact information. If you obscure your email, please make it relatively obvious to us how to parse the address.
  
 
<b>Template:</b> Name. Location. <Email>  
 
<b>Template:</b> Name. Location. <Email>  
Line 9: Line 9:
 
==Special Comments==
 
==Special Comments==
 
We are under time constraints this year because ISMIR 2011  
 
We are under time constraints this year because ISMIR 2011  
is being held starting 22nd of october and we need to have all the final  
+
is being held starting the 22nd of October and we need to have all the final
results calculated and posted by our 14th of  October target date (fingers crossed).
+
results calculated and posted by the 14th of  October target date (fingers crossed).
  
 
We hope to open the the Evalutron 6000 (E6K) v.2 grading system by Friday 30th
 
We hope to open the the Evalutron 6000 (E6K) v.2 grading system by Friday 30th
September. To meet our goal, we must have all the AMS and SMS  
+
September. To meet our goal, we must have all the AMS and SMS  
similarity grades entered into the E6K by Wednesday Oct. 12th. So, if you are kind enough to sign up to be a grader,  
+
similarity grades entered into the E6K by Wednesday Oct. 12th. So, if you are kind enough to sign up to be a grader, please understand that we really need you complete your assigned grading  
please understand that we really need you complete your assigned grading  
 
 
by Wednesday Oct. 12th.
 
by Wednesday Oct. 12th.
  
Line 25: Line 24:
  
  
This year the query lists seem to be moderate in length so tackling two queries lists should not be too onerous. For safety's sake, we would like to see say, an extra five or so names on the sign up sheet below. The "extra names" on the sign up sheet will be considered "back up" graders. We will assign grading tasks in the order of the names as they appear below.
+
This year the query lists seem to be moderate in length so tackling two queries lists should not be too onerous. For safety's sake, we would like to see say, an extra 5 or so names on the sign up sheet below. The "extra names" on the sign up sheet will be considered "back up" graders. We will assign grading tasks in the order of the names as they appear below.

Revision as of 17:21, 23 September 2011

AMS 2011 Graders

Welcome to the AMS grader sign-up page. Please give us your name and email contact information. If you obscure your email, please make it relatively obvious to us how to parse the address.

Template: Name. Location. <Email>

Sample: J. Stephen Downie. Illinois, USA. <jdownie@illinois.edu>

Special Comments

We are under time constraints this year because ISMIR 2011 is being held starting the 22nd of October and we need to have all the final results calculated and posted by the 14th of October target date (fingers crossed).

We hope to open the the Evalutron 6000 (E6K) v.2 grading system by Friday 30th September. To meet our goal, we must have all the AMS and SMS similarity grades entered into the E6K by Wednesday Oct. 12th. So, if you are kind enough to sign up to be a grader, please understand that we really need you complete your assigned grading by Wednesday Oct. 12th.

If you are a SMS or AMS participant, we ask that you do what you can to encourage adults over 18 years of age to be graders.


We are looking for 50 graders for AMS this year. If we make our quota of 50 graders, each grader will be responsible for two query lists. If we fall short, and get around 34 graders, we will be asking each grader to grade 3 queries. In this worst case scenario, we still expect the grading process to take between 2.5 to 3 hours (or less) for each grader.


This year the query lists seem to be moderate in length so tackling two queries lists should not be too onerous. For safety's sake, we would like to see say, an extra 5 or so names on the sign up sheet below. The "extra names" on the sign up sheet will be considered "back up" graders. We will assign grading tasks in the order of the names as they appear below.