Difference between revisions of "2010:MIREX HOME"
(→Getting started) |
|||
| Line 3: | Line 3: | ||
Consult the [http://meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software. | Consult the [http://meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software. | ||
| − | == | + | ==Welcome to MIREX 2010== |
| − | + | This is the main page for the fifth running of the Music Information Retrieval Evaluation eXchange (MIREX 2010). The International Music Information Retrieval Systems Evaluation Laboratory ([https://music-ir.org/evaluation IMIRSEL]) at the Graduate School of Library and Information Science ([http://www.lis.uiuc.edu GSLIS]), University of Illinois at Urbana-Champaign ([http://www.uiuc.edu UIUC]) is the principal organizer of MIREX 2010. | |
| − | * [http://www. | + | |
| − | + | The MIREX 2010 community will hold its annual plenary meeting as part of [http://ismir2010.ismir.net/ The 11th International Conference on Music Information Retrieval], ISMIR 2010, which will be held in Utrecht, Netherlands, from August 9th to 13th, 2010. | |
| + | |||
| + | J. Stephen Downie<br> | ||
| + | Director, IMIRSEL<br> | ||
| + | |||
| + | |||
| + | ===Note to New Participants=== | ||
| + | Please take the time to read the following review article that explains the history and structure of MIREX. | ||
| + | |||
| + | Downie, J. Stephen (2008). The Music Information Retrieval Evaluation Exchange (2005-2007):<br> | ||
| + | A window into music information retrieval research.''Acoustical Science and Technology 29'' (4): 247-255. <br> | ||
| + | Available at: [http://dx.doi.org/10.1250/ast.29.247 http://dx.doi.org/10.1250/ast.29.247] | ||
| + | |||
| + | |||
| + | ===Note to All Participants=== | ||
| + | |||
| + | Because MIREX is premised upon the sharing of ideas and results, '''ALL''' MIREX participants are expected to: | ||
| + | |||
| + | # submit a DRAFT 2-3 page extended abstract PDF in the ISMIR format about the submitted programme(s) to help us and the community better understand how the algorithm works when submitting their programme(s). | ||
| + | # submit a FINALIZED 2-3 page extended abstract PDF in the ISMIR format prior to ISMIR 2010 for posting on the respective results pages (sometimes the same abstract can be used for multiple submissions; in many cases the DRAFT and FINALIZED abstracts are the same) | ||
| + | # present a poster at the MIREX 2010 poster session at ISMIR 2010 (exact date to be announced) | ||
| + | |||
| + | |||
| + | |||
| + | |||
| + | == Dates == | ||
| + | |||
| + | * Submission system opening TBA | ||
| + | * Algorithm submission deadline TBA | ||
| + | |||
| + | Note: In practice, there will be rolling final deadlines for different tasks. | ||
| + | Pay attention to the wiki pages of tasks you are interested in. The Audio Music Similarity submission need to be submitted as close to the deadline as possible as we have to then run the human evaluations. | ||
| + | |||
| + | |||
| + | ==Getting Involved in MIREX 2010== | ||
| + | MIREX is a community-based endeavour. Be a part of the community and help make MIREX 2010 the best yet. | ||
| + | |||
| + | ===Mailing List Participation=== | ||
| + | If you are interested in formal MIR evaluation, you should also subscribe to the "MIREX" (aka "EvalFest") mail list and participate in the community discussions about defining and running MIREX 2010 tasks. Subscription information at: | ||
| + | https://mail.lis.uiuc.edu/mailman/listinfo/evalfest | ||
| + | |||
| + | ===Wiki Participation=== | ||
| + | '''''Please note that you must create a NEW login for this wiki even if you have a login that you previously used for editing the MIREX 2005 or 2006 or 2007 or 2008 or 2009 wikis.''''' | ||
| + | |||
| + | Please create an account via: [https://www.music-ir.org/mirex/2010/index.php?title=Special:Userlogin&type=signup&returnto=Special:Userlogin Create Account]. | ||
| + | |||
| + | |||
| + | == Possible MIREX 2010 Evaluation Tasks == | ||
| + | |||
| + | === 2009 Tasks as Templates === | ||
| + | |||
| + | The following tasks were those run in 2009. We have created 2010 templates from these 2009 tasks. By following the links below, you can access the 2009 templates as a starting point. Feel free to build upon, extend and edit these templates in order to define the tasks for 2010. Note we will run a task if there are three or more committed participants. It will probably be the case that not all of the 2009 tasks will be run in 2010. | ||
| + | |||
| + | Very Important: Feel free to propose new tasks and add to the list below. Also feel free to resurrect tasks from previous years. | ||
| + | |||
| + | |||
| + | * [[Audio Onset detection]] | ||
| + | * [[Audio Artist Identification]] | ||
| + | * [[Audio Genre Classification]] | ||
| + | * [[Audio Tag Classification]] | ||
| + | * [[Audio Music Mood Classification]] | ||
| + | * [[Audio Cover Song Identification]] | ||
| + | * [[Real-time Audio to Score Alignment (a.k.a Score Following)]] | ||
| + | * [[Query by Singing/Humming]] | ||
| + | * [[Multiple Fundamental Frequency Estimation & Tracking]] | ||
| + | * [[Audio Chord Detection]] | ||
| + | * [[Audio Melody Extraction]] | ||
| + | * [[Query by Tapping]] | ||
| + | * [[Audio Beat Tracking]] | ||
| + | * [[Audio Music Similarity and Retrieval]] | ||
| + | * [[Structural_Segmentation | Structural Segmentation]] | ||
| + | |||
| + | |||
| + | === New or Resurrected 2009 Proposals === | ||
| + | * [[Harmonic Analysis]] | ||
| + | |||
| + | |||
| + | ==MIREX 2010 Submission Instructions== | ||
| + | The [[MIREX 2010 Submission Instructions]] page is now up. The URL to the MIREX 2010 Submission System has been placed at the bottom of the MIREX 2010 Submission Instructions page (to encourage reading of this important document). | ||
| + | |||
| + | Andreas Ehmann has created another '''must-read''' submission-related document: [[Best Coding Practices for MIREX]]. | ||
| + | |||
| + | Please request any dependencies, libraries or execution environemts/Virtual machines using [http://spreadsheets.google.com/viewform?key=pHBT0V1JnYemAXl7MMmNgHA this form]. | ||
| + | |||
| + | Take a look at our most recent description of [[MIREX_2009_Equipment | MIREX 2010 Equipment]] and basic software. | ||
| + | |||
| + | If you have difficulties or general questions about the submission procedures please contact: | ||
| + | * [mailto:mrx-com09@lists.lis.uiuc.edu mrx-com09@lists.lis.uiuc.edu] | ||
| + | |||
| + | |||
| + | ==MIREX 2005 - 2009 Wikis== | ||
| + | This is the new wiki for MIREX 2009. The wikis for MIREX 2005 - 2008 are available at: | ||
| + | |||
| + | '''[[2009:Main_Page|MIREX 2009]]''' | ||
| + | https://www.music-ir.org/mirex/2009/ | ||
| + | |||
| + | '''[[2008:Main_Page|MIREX 2008]]''' | ||
| + | https://www.music-ir.org/mirex/2008/ | ||
| + | |||
| + | '''[[2007:Main_Page|MIREX 2007]]''' | ||
| + | https://www.music-ir.org/mirex/2007/ | ||
| + | |||
| + | '''[[2006:Main_Page|MIREX 2006]]''' | ||
| + | https://www.music-ir.org/mirex/2006/ | ||
| + | |||
| + | '''[[2005:Main_Page|MIREX 2005]]''' | ||
| + | https://www.music-ir.org/mirex/2005/ | ||
| + | |||
| + | You can interlink between this wiki and the previous wikis using '''2005:''' prefix on links to connect to pages in MIREX 2005 and '''2006:''' for MIREX 2006 and '''2007:''' for MIREX 2007 and '''2008:''' for MIREX 2008 and '''2009:''' for MIREX 2009. | ||
| + | |||
| + | |||
| + | ===ISMIR 2004 Audio Description Contest=== | ||
| + | The Audio Description Contest held at ISMIR 2004 is a precursor to MIREX. Details of the ISMIR 2004 Audio Description Contest can be found at: | ||
| + | |||
| + | '''[http://ismir2004.ismir.net/ISMIR_Contest.html| ISMIR 2004 Audio Description Contest]''' | ||
| + | http://ismir2004.ismir.net/ISMIR_Contest.html | ||
Revision as of 22:05, 18 March 2010
MediaWiki has been successfully installed.
Consult the User's Guide for information on using the wiki software.
Contents
Welcome to MIREX 2010
This is the main page for the fifth running of the Music Information Retrieval Evaluation eXchange (MIREX 2010). The International Music Information Retrieval Systems Evaluation Laboratory (IMIRSEL) at the Graduate School of Library and Information Science (GSLIS), University of Illinois at Urbana-Champaign (UIUC) is the principal organizer of MIREX 2010.
The MIREX 2010 community will hold its annual plenary meeting as part of The 11th International Conference on Music Information Retrieval, ISMIR 2010, which will be held in Utrecht, Netherlands, from August 9th to 13th, 2010.
J. Stephen Downie
Director, IMIRSEL
Note to New Participants
Please take the time to read the following review article that explains the history and structure of MIREX.
Downie, J. Stephen (2008). The Music Information Retrieval Evaluation Exchange (2005-2007):
A window into music information retrieval research.Acoustical Science and Technology 29 (4): 247-255.
Available at: http://dx.doi.org/10.1250/ast.29.247
Note to All Participants
Because MIREX is premised upon the sharing of ideas and results, ALL MIREX participants are expected to:
- submit a DRAFT 2-3 page extended abstract PDF in the ISMIR format about the submitted programme(s) to help us and the community better understand how the algorithm works when submitting their programme(s).
- submit a FINALIZED 2-3 page extended abstract PDF in the ISMIR format prior to ISMIR 2010 for posting on the respective results pages (sometimes the same abstract can be used for multiple submissions; in many cases the DRAFT and FINALIZED abstracts are the same)
- present a poster at the MIREX 2010 poster session at ISMIR 2010 (exact date to be announced)
Dates
- Submission system opening TBA
- Algorithm submission deadline TBA
Note: In practice, there will be rolling final deadlines for different tasks. Pay attention to the wiki pages of tasks you are interested in. The Audio Music Similarity submission need to be submitted as close to the deadline as possible as we have to then run the human evaluations.
Getting Involved in MIREX 2010
MIREX is a community-based endeavour. Be a part of the community and help make MIREX 2010 the best yet.
Mailing List Participation
If you are interested in formal MIR evaluation, you should also subscribe to the "MIREX" (aka "EvalFest") mail list and participate in the community discussions about defining and running MIREX 2010 tasks. Subscription information at: https://mail.lis.uiuc.edu/mailman/listinfo/evalfest
Wiki Participation
Please note that you must create a NEW login for this wiki even if you have a login that you previously used for editing the MIREX 2005 or 2006 or 2007 or 2008 or 2009 wikis.
Please create an account via: Create Account.
Possible MIREX 2010 Evaluation Tasks
2009 Tasks as Templates
The following tasks were those run in 2009. We have created 2010 templates from these 2009 tasks. By following the links below, you can access the 2009 templates as a starting point. Feel free to build upon, extend and edit these templates in order to define the tasks for 2010. Note we will run a task if there are three or more committed participants. It will probably be the case that not all of the 2009 tasks will be run in 2010.
Very Important: Feel free to propose new tasks and add to the list below. Also feel free to resurrect tasks from previous years.
- Audio Onset detection
- Audio Artist Identification
- Audio Genre Classification
- Audio Tag Classification
- Audio Music Mood Classification
- Audio Cover Song Identification
- Real-time Audio to Score Alignment (a.k.a Score Following)
- Query by Singing/Humming
- Multiple Fundamental Frequency Estimation & Tracking
- Audio Chord Detection
- Audio Melody Extraction
- Query by Tapping
- Audio Beat Tracking
- Audio Music Similarity and Retrieval
- Structural Segmentation
New or Resurrected 2009 Proposals
MIREX 2010 Submission Instructions
The MIREX 2010 Submission Instructions page is now up. The URL to the MIREX 2010 Submission System has been placed at the bottom of the MIREX 2010 Submission Instructions page (to encourage reading of this important document).
Andreas Ehmann has created another must-read submission-related document: Best Coding Practices for MIREX.
Please request any dependencies, libraries or execution environemts/Virtual machines using this form.
Take a look at our most recent description of MIREX 2010 Equipment and basic software.
If you have difficulties or general questions about the submission procedures please contact:
MIREX 2005 - 2009 Wikis
This is the new wiki for MIREX 2009. The wikis for MIREX 2005 - 2008 are available at:
MIREX 2009 https://www.music-ir.org/mirex/2009/
MIREX 2008 https://www.music-ir.org/mirex/2008/
MIREX 2007 https://www.music-ir.org/mirex/2007/
MIREX 2006 https://www.music-ir.org/mirex/2006/
MIREX 2005 https://www.music-ir.org/mirex/2005/
You can interlink between this wiki and the previous wikis using 2005: prefix on links to connect to pages in MIREX 2005 and 2006: for MIREX 2006 and 2007: for MIREX 2007 and 2008: for MIREX 2008 and 2009: for MIREX 2009.
ISMIR 2004 Audio Description Contest
The Audio Description Contest held at ISMIR 2004 is a precursor to MIREX. Details of the ISMIR 2004 Audio Description Contest can be found at:
ISMIR 2004 Audio Description Contest http://ismir2004.ismir.net/ISMIR_Contest.html
