Difference between revisions of "2009:Main Page"

From MIREX Wiki
(MIREX 2009 Audio Similarity Grader Volunteer Page)
Line 1: Line 1:
  
 
==MIREX 2009 Audio Similarity Grader Volunteer Page==
 
==MIREX 2009 Audio Similarity Grader Volunteer Page==
We are in <b>desperate</b> need of "graders" to make similarity assessment for this year's Audio Similarity and Retrieval (AMS) task. If you can make the commitment to give us 2-3 hours (or more) to be a grader, please, please, please, sign up at [[Audio_Similarity_2009_Graders]]. Grading will done via the Evalutron 6000 (E6K) web-based system. This means that you can be a grader from anywhere in the world where you have access to the net, a soundcard, and Firefox. We expect to open the E6K to graders around 28 September (+- a day) and close the system 12 October 2009. We need to know our grader count ASAP to determine the number of algos and queries we can evaluate properly.
+
We are in <b>desperate</b> need of "graders" to make similarity assessment for this year's Audio Similarity and Retrieval (AMS) task. If you can make the commitment to give us 2-3 hours (or more) to be a grader, please, please, please, sign up at [[Audio Similarity 2009 Graders]]. Grading will done via the Evalutron 6000 (E6K) web-based system. This means that you can be a grader from anywhere in the world where you have access to the net, a soundcard, and Firefox. We expect to open the E6K to graders around 28 September (+- a day) and close the system 12 October 2009. We need to know our grader count ASAP to determine the number of algos and queries we can evaluate properly.
  
 
==ISMIR 2009 Conference Roommate Page==
 
==ISMIR 2009 Conference Roommate Page==

Revision as of 09:20, 16 September 2009

MIREX 2009 Audio Similarity Grader Volunteer Page

We are in desperate need of "graders" to make similarity assessment for this year's Audio Similarity and Retrieval (AMS) task. If you can make the commitment to give us 2-3 hours (or more) to be a grader, please, please, please, sign up at Audio Similarity 2009 Graders. Grading will done via the Evalutron 6000 (E6K) web-based system. This means that you can be a grader from anywhere in the world where you have access to the net, a soundcard, and Firefox. We expect to open the E6K to graders around 28 September (+- a day) and close the system 12 October 2009. We need to know our grader count ASAP to determine the number of algos and queries we can evaluate properly.

ISMIR 2009 Conference Roommate Page

If you are looking for someone to share a room at ISMIR 2009, post a note on the ISMIR_2009_Room_Share page.

Welcome to MIREX 2009

This is the main page for the fifth running of the Music Information Retrieval Evaluation eXchange (MIREX 2009). The International Music Information Retrieval Systems Evaluation Laboratory (IMIRSEL) at the Graduate School of Library and Information Science (GSLIS), University of Illinois at Urbana-Champaign (UIUC) is the principal organizer of MIREX 2009.

The MIREX 2009 community will hold its annual plenary meeting as part of The 10th International Conference on Music Information Retrieval, ISMIR 2009, which will be held in Kobe, Japan, from October 26-30, 2009.

J. Stephen Downie
Director, IMIRSEL

Note to New Participants

Please take the time to read the following review article that explains the history and structure of MIREX.

Downie, J. Stephen (2008). The Music Information Retrieval Evaluation Exchange (2005-2007):
A window into music information retrieval research.Acoustical Science and Technology 29 (4): 247-255.
Available at: http://dx.doi.org/10.1250/ast.29.247


Note to All Participants

Because MIREX is premised upon the sharing of ideas and results, ALL MIREX participants are expected to:

  1. submit a DRAFT 2-3 page extended abstract PDF in the ISMIR format about the submitted programme(s) to help us and the community better understand how the algorithm works when submitting their programme(s).
  2. submit a FINALIZED 2-3 page extended abstract PDF in the ISMIR format prior to ISMIR 2009 for posting on the respective results pages (sometimes the same abstract can be used for multiple submissions; in many cases the DRAFT and FINALIZED abstracts are the same)
  3. present a poster at the MIREX 2009 poster session at ISMIR 2009 (exact date to be announced)

Updated Target Deadlines

  • Submission system opens officially 17 August.
  • Algorithm submission deadline 8 September.

Note: In practice, there will be rolling final deadlines for different tasks. Pay attention to the wiki pages of tasks you are interested in. The Audio Music Similarity submission need to be submitted as close to the deadline as possible as we have to then run the human evaluations.

Getting Involved in MIREX 2009

MIREX is a community-based endeavour. Be a part of the community and help make MIREX 2009 the best yet.

Mailing List Participation

If you are interested in formal MIR evaluation, you should also subscribe to the "MIREX" (aka "EvalFest") mail list and participate in the community discussions about defining and running MIREX 2009 tasks. Subscription information at: https://mail.lis.uiuc.edu/mailman/listinfo/evalfest

Wiki Participation

Please note that you must create a NEW login for this wiki even if you have a login that you previously used for editing the MIREX 2005 or 2006 or 2007 or 2008 wikis.

Please create an account via: Create Account.

Possible MIREX 2009 Evaluation Tasks

2008 Tasks as Templates

The following tasks were those run in 2008. We have created 2009 templates from these 2008 tasks. By following the links below, you can access the 2009 templates as a starting point. Feel free to build upon, extend and edit these templates in order to define the tasks for 2009. Note we will run a task if there are three or more committed participants. It will probably be the case that not all of the 2008 tasks will be run in 2009.

Very Important: Feel free to propose new tasks and add to the list below. Also feel free to resurrect tasks from previous years.


New or Resurrected 2009 Proposals

MIREX 2009 Submission Instructions

The MIREX 2009 Submission Instructions page is now up. The URL to the MIREX 2009 Submission System has been placed at the bottom of the MIREX 2009 Submission Instructions page (to encourage reading of this important document).

Andreas Ehmann has created another must-read submission-related document: Best Coding Practices for MIREX.

Please request any dependencies, libraries or execution environemts/Virtual machines using this form.

Take a look at our most recent description of MIREX 2009 Equipment and basic software.

If you have difficulties or general questions about the submission procedures please contact:

MIREX 2005 - 2008 Wikis

This is the new wiki for MIREX 2009. The wikis for MIREX 2005 - 2008 are available at:


MIREX 2008 https://www.music-ir.org/mirex/2008/

MIREX 2007 https://www.music-ir.org/mirex/2007/

MIREX 2006 https://www.music-ir.org/mirex/2006/

MIREX 2005 https://www.music-ir.org/mirex/2005/

You can interlink between this wiki and the previous wikis using 2005: prefix on links to connect to pages in MIREX 2005 and 2006: for MIREX 2006 and 2007: for MIREX 2007 and 2008: for MIREX 2008.

ISMIR 2004 Audio Description Contest

The Audio Description Contest held at ISMIR 2004 is a precursor to MIREX. Details of the ISMIR 2004 Audio Description Contest can be found at:

ISMIR 2004 Audio Description Contest http://ismir2004.ismir.net/ISMIR_Contest.html


Special Tagatune Audio Tag Classification Evaluation

Take a look at the SpecialTagatuneEvaluation that we are running in early 2009!