Difference between revisions of "MIREX HOME"

From MIREX Wiki
Line 1: Line 1:
==Welcome to MIREX 2024==
+
==Welcome to MIREX 2025==
  
 
After a break of 3 years, we want to bring back the MIREX (Music Information Retrieval Evaluation eXchange) competition starting from 2024. We want to bring in new tasks, benchmarks, and datasets in response to the rapid development of computer music research.
 
After a break of 3 years, we want to bring back the MIREX (Music Information Retrieval Evaluation eXchange) competition starting from 2024. We want to bring in new tasks, benchmarks, and datasets in response to the rapid development of computer music research.
  
The MIREX community will hold its annual meeting as part of [https://ismir.net/ The International Society for Music Information Retrieval Conference]. This year, the conference will be held in [https://ismir2024.ismir.net/ San Francisco, CA, USA and online] from November 10–14, 2024.
+
The MIREX community will hold its annual meeting as part of [https://ismir.net/ The International Society for Music Information Retrieval Conference]. This year, the conference will be held in [https://ismir2025.ismir.net/ Daejeon, South Korea] from September 21-25, 2025.
  
 
In a long run, we want to make MIREX a platform for researchers to share their latest research results, to compare their systems with others, and to promote the development of the field.
 
In a long run, we want to make MIREX a platform for researchers to share their latest research results, to compare their systems with others, and to promote the development of the field.
  
==MIREX 2024 Results==
+
==MIREX 2025 Task Descriptions==
  
See [[2024:MIREX2024_Results]].
+
To be announced.
  
==MIREX 2024 Task Descriptions==
+
==Call for Challenges==
 
 
We will start with a small set of tasks and will expand the list based on the community's feedback. We also welcome volunteers for task captains (TC). The following tasks are currently planned for MIREX 2024:
 
 
 
Traditional MIR tasks
 
  
* [[2024:Audio Chord Estimation]] <TC: [mailto:jj2731@nyu.edu Junyan Jiang]>
+
Starting with MIREX 2024, we invite the ISMIR community to propose new research challenges that address cutting-edge problems in Music Information Retrieval (MIR). These challenges should aim to push the boundaries of current research and foster innovation in the field.
* [[2024:Lyrics-to-Audio Alignment]] <TC: [mailto:jj2731@nyu.edu Junyan Jiang]>
 
* [[2024:Cover Song Identification]] <TC: [mailto:x.du@rochester.edu Xingjian Du] & [mailto:ruibiny@alumni.cmu.edu Ruibin Yuan]>
 
  
Modern MIR tasks
+
We also welcome challenge sponsors from both industry and research institutions, particularly those willing to contribute datasets and computational resources to support the competition.
  
* [[2024:Symbolic Music Generation]] <TC: [mailto:ziyu.wang@nyu.edu Ziyu Wang]>
+
===What's new:===
* [[2024:Music Audio Generation]] <TC: [mailto:ruibiny@alumni.cmu.edu Ruibin Yuan]>
 
* [[2024:Music Description & Captioning]] <TC: [mailto:yixiao.zhang@qmul.ac.uk Yixiao Zhang]>
 
* [[2024:Polyphonic Transcription]] <TC: [mailto:yujia.yan@rochester.edu Yujia Yan] & [mailto:ziyu.wang@nyu.edu Ziyu Wang]>
 
* [[2024:Singing Voice Deepfake Detection]] <TC: [mailto:you.zhang@rochester.edu Neil Zhang] & [mailto:yixiao.zhang@qmul.ac.uk Yixiao Zhang]>
 
  
==Call for Challenges==
+
Beginning in MIREX 2025, all proposed challenges must have an assigned task captain responsible for evaluating participant submissions. Additionally, task captains may use proprietary datasets for evaluation.
  
Starting from MIREX 2024, we invite proposals for challenges addressing new research problems from the ISMIR community. These challenges should aim to push the boundaries of current research and foster innovation within the field of music information retrieval.
+
Task Captain Responsibilities:
  
For the format and requirements for the challenge proposal, please go to [[2024:Call for Challenges]]. This year's call for challenge winner is the singing voice deepfake detection proposal, which has been added to the task list.
+
1. Register on the [https://www.music-ir.org/mirex MIREX Wiki] and maintain a task description page.
 +
2. Collect submissions via the MIREX submission server (or provide customized submission instructions).
 +
3. Execute and evaluate the submissions.
 +
4. Report results to MIREX and create a results page on the MIREX Wiki.
 +
5. (Optional) Present a MIREX task captain poster at the Late-Breaking and Demo (LBD) session at ISMIR 2025.
  
 
==How to Participate==
 
==How to Participate==
Line 40: Line 34:
 
* Program your system. For some tasks, a docker image is required for submission. See the [[Submission Guidelines]].
 
* Program your system. For some tasks, a docker image is required for submission. See the [[Submission Guidelines]].
 
* Write a 2-4 page extended abstract PDF describing your system.
 
* Write a 2-4 page extended abstract PDF describing your system.
* Submit your system and the extended abstract to the [http://futuremirex.com/portal/ new submission portal]. Be sure to also check the announcements in the forum of each task.
+
* Submit your system and extended abstract through the submission portal (to be announced). Check individual task forums for updates.
* Top-rated teams will be presenting their MIREX posters alongside the LBD session at ISMIR2024. (details will follow)
+
* Top-performing teams will have the opportunity to present their MIREX posters at the LBD session at ISMIR 2025.
  
 
==Important Dates==
 
==Important Dates==
  
* <del>Challenge proposals due: August 7, 2024</del>
+
To be announced.
* <del>Notification of acceptance for challenge proposals: August 14, 2024</del>
 
* <del>Submission open: September 15, 2024</del>
 
* <del>Submission close: around October 25, 2024 (different tasks may vary, see task descriptions for details)</del>
 
* <del>Result published: around November 5, 2024 (different tasks may vary, see task descriptions for details)</del>
 
  
 
==Contact Us==
 
==Contact Us==
Line 55: Line 45:
 
For general questions, feedback, and suggestions, please send messages to our mailing list future-mirex@googlegroups.com. For task-specific inquiries, please email individual task captain, or post a question in the [http://futuremirex.com/portal/ submission portal] forum.
 
For general questions, feedback, and suggestions, please send messages to our mailing list future-mirex@googlegroups.com. For task-specific inquiries, please email individual task captain, or post a question in the [http://futuremirex.com/portal/ submission portal] forum.
  
We are looking forward to seeing you at MIREX 2024!
+
We are looking forward to seeing you at MIREX 2025!
  
Future MIREX Team, 2024
+
Future MIREX Team, 2025
  
MIREX 2024 Organizers:
+
MIREX 2025 Organizers:
 
* Junyan Jiang, New York University.
 
* Junyan Jiang, New York University.
 
* Akira Maezawa, Yamaha  
 
* Akira Maezawa, Yamaha  

Revision as of 10:10, 10 March 2025

Welcome to MIREX 2025

After a break of 3 years, we want to bring back the MIREX (Music Information Retrieval Evaluation eXchange) competition starting from 2024. We want to bring in new tasks, benchmarks, and datasets in response to the rapid development of computer music research.

The MIREX community will hold its annual meeting as part of The International Society for Music Information Retrieval Conference. This year, the conference will be held in Daejeon, South Korea from September 21-25, 2025.

In a long run, we want to make MIREX a platform for researchers to share their latest research results, to compare their systems with others, and to promote the development of the field.

MIREX 2025 Task Descriptions

To be announced.

Call for Challenges

Starting with MIREX 2024, we invite the ISMIR community to propose new research challenges that address cutting-edge problems in Music Information Retrieval (MIR). These challenges should aim to push the boundaries of current research and foster innovation in the field.

We also welcome challenge sponsors from both industry and research institutions, particularly those willing to contribute datasets and computational resources to support the competition.

What's new:

Beginning in MIREX 2025, all proposed challenges must have an assigned task captain responsible for evaluating participant submissions. Additionally, task captains may use proprietary datasets for evaluation.

Task Captain Responsibilities:

1. Register on the MIREX Wiki and maintain a task description page. 2. Collect submissions via the MIREX submission server (or provide customized submission instructions). 3. Execute and evaluate the submissions. 4. Report results to MIREX and create a results page on the MIREX Wiki. 5. (Optional) Present a MIREX task captain poster at the Late-Breaking and Demo (LBD) session at ISMIR 2025.

How to Participate

  • Read the Participant Agreement and task description carefully.
  • Program your system. For some tasks, a docker image is required for submission. See the Submission Guidelines.
  • Write a 2-4 page extended abstract PDF describing your system.
  • Submit your system and extended abstract through the submission portal (to be announced). Check individual task forums for updates.
  • Top-performing teams will have the opportunity to present their MIREX posters at the LBD session at ISMIR 2025.

Important Dates

To be announced.

Contact Us

For general questions, feedback, and suggestions, please send messages to our mailing list future-mirex@googlegroups.com. For task-specific inquiries, please email individual task captain, or post a question in the submission portal forum.

We are looking forward to seeing you at MIREX 2025!

Future MIREX Team, 2025

MIREX 2025 Organizers:

  • Junyan Jiang, New York University.
  • Akira Maezawa, Yamaha
  • Ziyu Wang, New York University
  • Yixiao Zhang, Queen Mary University of London
  • Ruibin Yuan, Hong Kong University of Science and Technology
  • J. Stephen Downie, University of Illinois
  • Gus Xia, MBZUAI.