Difference between revisions of "MIREX HOME"

From MIREX Wiki
(Call for Challenges)
 
(171 intermediate revisions by 18 users not shown)
Line 1: Line 1:
__TOC__
+
==Welcome to MIREX 2025==
  
== Introduction ==
+
After a break of 3 years, we want to bring back the MIREX (Music Information Retrieval Evaluation eXchange) competition starting from 2024. We want to bring in new tasks, benchmarks, and datasets in response to the rapid development of computer music research.
The Music Information Retrieval Evaluation eXchange (MIREX) is an annual evaluation campaign for Music Information Retrieval (MIR) algorithms, coupled to the [http://www.ismir.net International Society (and Conference) for Music Information Retrieval (ISMIR)]. MIREX is hosted by the [https://www.music-ir.org/evaluation/ International Music Information Retrieval Systems Evaluation Laboratory (IMIRSEL)] at the [http://www.lis.illinois.edu/ Graduate School of Library Information Sciences (GSLIS)] which is part of the [http://www.illinois.edu/ University of Illinois at Urbana-Champaign (UIUC)].
 
  
 +
The MIREX community will hold its annual meeting as part of [https://ismir.net/ The International Society for Music Information Retrieval Conference]. This year, the conference will be held in [https://ismir2025.ismir.net/ Daejeon, South Korea] from September 21-25, 2025.
  
Current and Future MIREXs are in part facilitated by the work of the [https://nema.lis.illinois.edu/ Networked Environment for Music Analysis (NEMA) project]. The NEMA projects aims to automate and expose the workings of MIREX and MIR experimentation/evaluation to the MIR community, helping to deal with issues of collection/data/code sharing within the community by handling issues relating to copyright and IP restrictions by allowing MIR researchers to work (remotely) with resources without having to obtain licenses to the content/code.
+
In a long run, we want to make MIREX a platform for researchers to share their latest research results, to compare their systems with others, and to promote the development of the field.
  
 +
==MIREX 2025 Task Descriptions==
  
MIR tasks evaluated at past MIREXs include:
+
To be announced.
*  Audio Train/Test Tasks
 
** Audio Artist Identification
 
** Audio Genre Classification
 
** Audio Music Mood Classification
 
** Audio Classical Composer Identification
 
* Symbolic Genre Classification
 
* Audio Onset Detection
 
* Audio Key Detection
 
* Symbolic Key Detection
 
* Audio Tag Classification
 
* Audio Cover Song Identification
 
* Real-time Audio to Score Alignment (a.k.a Score Following)
 
* Query by Singing/Humming
 
* Multiple Fundamental Frequency Estimation & Tracking
 
* Audio Chord Estimation
 
* Audio Melody Extraction
 
* Query by Tapping
 
* Audio Beat Tracking
 
* Audio Music Similarity and Retrieval
 
* Symbolic Melodic Similarity
 
* Structural Segmentation
 
* Audio Drum Detection
 
* Audio Tempo Extraction
 
  
== Current MIREX Wiki (2010) ==
+
==Call for Challenges==
You can view the current 2010 content here: [[2010:MIREX HOME]]
 
  
== Recent Changes ==
+
Starting with MIREX 2024, we invite the ISMIR community to propose new research challenges that address cutting-edge problems in Music Information Retrieval (MIR). These challenges should aim to push the boundaries of current research and foster innovation in the field.
We recently have merged all current and previous iterations of the MIREX wiki into a single wiki installation to make it easier to manage. All the pages, images, abstracts, and images have been migrated, but some links and images may still be broken. We're currently manually inspecting all pages, but would appreciate your help in correcting any errors you see.
 
  
Content on the wiki is now organized into mediawiki namespaces, one for each year. You can view the current 2010 content here: [[2010:MIREX HOME]]
+
We also welcome challenge sponsors from both industry and research institutions, particularly those willing to contribute datasets and computational resources to support the competition.
  
Similarly for previous content.
+
For the format and requirements for the challenge proposal, please go to [[2025:Call for Challenges]].
* [[2009:Main_Page]]
 
* [[2008:Main_Page]]
 
* [[2007:Main_Page]]
 
* [[2006:Main_Page]]
 
* [[2005:Main_Page]]
 
  
All links to older wiki content will be redirected to this new wiki, and should take you to the correct page on the new installation, but please update any bookmarks or links you may have which point into current or old wiki content.
+
 
 +
===What's new:===
 +
 
 +
Beginning in MIREX 2025, all proposed challenges must have an assigned task captain responsible for evaluating participant submissions. Additionally, task captains may use proprietary datasets for evaluation.
 +
 
 +
Task Captain Responsibilities:
 +
 
 +
* Register on the [https://www.music-ir.org/mirex MIREX Wiki] and maintain a task description page.
 +
* Collect submissions via the MIREX submission server (or provide customized submission instructions).
 +
* Execute and evaluate the submissions.
 +
* Report results to MIREX and create a results page on the MIREX Wiki.
 +
* (Optional) Present a MIREX task captain poster at the Late-Breaking and Demo (LBD) session at ISMIR 2025.
 +
 
 +
==How to Participate==
 +
 
 +
* Read the [[Participant Agreement]] and task description carefully.
 +
* Program your system. For some tasks, a docker image is required for submission. See the [[Submission Guidelines]].
 +
* Write a 2-4 page extended abstract PDF describing your system.
 +
* Submit your system and extended abstract through the submission portal (to be announced). Check individual task forums for updates.
 +
* Top-performing teams will have the opportunity to present their MIREX posters at the LBD session at ISMIR 2025.
 +
 
 +
==Important Dates==
 +
 
 +
To be announced.
 +
 
 +
==Contact Us==
 +
 
 +
For general questions, feedback, and suggestions, please send messages to our mailing list future-mirex@googlegroups.com. For task-specific inquiries, please email individual task captain, or post a question in the [http://futuremirex.com/portal/ submission portal] forum.
 +
 
 +
We are looking forward to seeing you at MIREX 2025!
 +
 
 +
Future MIREX Team, 2025
 +
 
 +
MIREX 2025 Organizers:
 +
* Junyan Jiang, New York University
 +
* Akira Maezawa, Yamaha
 +
* Ziyu Wang, New York University
 +
* Yixiao Zhang, Queen Mary University of London
 +
* Ruibin Yuan, Hong Kong University of Science and Technology
 +
* J. Stephen Downie, University of Illinois
 +
* Gus Xia, MBZUAI.

Latest revision as of 10:16, 10 March 2025

Welcome to MIREX 2025

After a break of 3 years, we want to bring back the MIREX (Music Information Retrieval Evaluation eXchange) competition starting from 2024. We want to bring in new tasks, benchmarks, and datasets in response to the rapid development of computer music research.

The MIREX community will hold its annual meeting as part of The International Society for Music Information Retrieval Conference. This year, the conference will be held in Daejeon, South Korea from September 21-25, 2025.

In a long run, we want to make MIREX a platform for researchers to share their latest research results, to compare their systems with others, and to promote the development of the field.

MIREX 2025 Task Descriptions

To be announced.

Call for Challenges

Starting with MIREX 2024, we invite the ISMIR community to propose new research challenges that address cutting-edge problems in Music Information Retrieval (MIR). These challenges should aim to push the boundaries of current research and foster innovation in the field.

We also welcome challenge sponsors from both industry and research institutions, particularly those willing to contribute datasets and computational resources to support the competition.

For the format and requirements for the challenge proposal, please go to 2025:Call for Challenges.


What's new:

Beginning in MIREX 2025, all proposed challenges must have an assigned task captain responsible for evaluating participant submissions. Additionally, task captains may use proprietary datasets for evaluation.

Task Captain Responsibilities:

  • Register on the MIREX Wiki and maintain a task description page.
  • Collect submissions via the MIREX submission server (or provide customized submission instructions).
  • Execute and evaluate the submissions.
  • Report results to MIREX and create a results page on the MIREX Wiki.
  • (Optional) Present a MIREX task captain poster at the Late-Breaking and Demo (LBD) session at ISMIR 2025.

How to Participate

  • Read the Participant Agreement and task description carefully.
  • Program your system. For some tasks, a docker image is required for submission. See the Submission Guidelines.
  • Write a 2-4 page extended abstract PDF describing your system.
  • Submit your system and extended abstract through the submission portal (to be announced). Check individual task forums for updates.
  • Top-performing teams will have the opportunity to present their MIREX posters at the LBD session at ISMIR 2025.

Important Dates

To be announced.

Contact Us

For general questions, feedback, and suggestions, please send messages to our mailing list future-mirex@googlegroups.com. For task-specific inquiries, please email individual task captain, or post a question in the submission portal forum.

We are looking forward to seeing you at MIREX 2025!

Future MIREX Team, 2025

MIREX 2025 Organizers:

  • Junyan Jiang, New York University
  • Akira Maezawa, Yamaha
  • Ziyu Wang, New York University
  • Yixiao Zhang, Queen Mary University of London
  • Ruibin Yuan, Hong Kong University of Science and Technology
  • J. Stephen Downie, University of Illinois
  • Gus Xia, MBZUAI.