Difference between revisions of "MIREX HOME"

From MIREX Wiki
(Contact Us)
 
(32 intermediate revisions by 3 users not shown)
Line 1: Line 1:
==Welcome to MIREX 2024==
+
==Welcome to MIREX 2025==
  
 
After a break of 3 years, we want to bring back the MIREX (Music Information Retrieval Evaluation eXchange) competition starting from 2024. We want to bring in new tasks, benchmarks, and datasets in response to the rapid development of computer music research.
 
After a break of 3 years, we want to bring back the MIREX (Music Information Retrieval Evaluation eXchange) competition starting from 2024. We want to bring in new tasks, benchmarks, and datasets in response to the rapid development of computer music research.
  
The MIREX community will hold its annual meeting as part of [https://ismir.net/ The International Society for Music Information Retrieval Conference]. This year, the conference will be held in [https://ismir2024.ismir.net/ San Francisco, CA, USA and online] from November 10–14, 2024.
+
The MIREX community will hold its annual meeting as part of [https://ismir.net/ The International Society for Music Information Retrieval Conference]. This year, the conference will be held in [https://ismir2025.ismir.net/ Daejeon, South Korea] from September 21-25, 2025.
  
 
In a long run, we want to make MIREX a platform for researchers to share their latest research results, to compare their systems with others, and to promote the development of the field.
 
In a long run, we want to make MIREX a platform for researchers to share their latest research results, to compare their systems with others, and to promote the development of the field.
  
==MIREX 2024 Evaluation Tasks==
+
==Task Descriptions==
  
We will start with a small set of tasks and will expand the list based on the community's feedback. We also welcome volunteers for task leaders. The following tasks are currently planned for MIREX 2024:
+
Traditional MIR tasks
 +
* [[2025:Audio Chord Estimation]] <TC: [mailto:jj2731@nyu.edu Junyan Jiang]>
 +
* [[2025:Lyrics Transcription]] <TC: [mailto:ruibiny@alumni.cmu.edu Ruibin Yuan] & [mailto:jj2731@nyu.edu Junyan Jiang]>
 +
* [[2025:Cover Song Identification]] <TC: [mailto:x.du@rochester.edu Xingjian Du] & [mailto:ruibiny@alumni.cmu.edu Ruibin Yuan]>
 +
* [[2025:Music Structure Analysis]] <TC: [mailto:yixiao.zhang@qmul.ac.uk Yixiao Zhang] & [mailto:ruibiny@alumni.cmu.edu Ruibin Yuan]>
 +
* [[2025:Audio Beat Tracking]] <TC: [mailto:mwysjtu@gmail.com Wenye Ma] & [mailto:yinghao.ma@qmul.ac.uk Yinghao Ma]>
 +
* [[2025:Audio Key Detection]] <TC: [mailto:mwysjtu@gmail.com Wenye Ma] & [mailto:yinghao.ma@qmul.ac.uk Yinghao Ma]>
  
Traditional MIR tasks
+
Modern MIR Tasks
 +
* [[2025:Symbolic Music Generation]] <TC: [mailto:ziyu.wang@nyu.edu Ziyu Wang]>
 +
* [[2025:Music Audio Generation]] <TC: [mailto:ruibiny@alumni.cmu.edu Ruibin Yuan]>
 +
* [[2025:Music Description & Captioning]] <TC: [mailto:yixiao.zhang@qmul.ac.uk Yixiao Zhang] & [mailto:ruibiny@alumni.cmu.edu Ruibin Yuan]>
 +
* [[2025:Polyphonic Transcription]] <TC: [mailto:yunglu@purdue.edu Yung-Hsiang Lu], [mailto:yun98@purdue.edu Kristen Yeon-Ji Yun], [mailto:ziyu.wang@nyu.edu Ziyu Wang], [mailto:yujia.yan@rochester.edu Yujia Yan]>
 +
* [[2025:Song Deepfake Detection]] <TC: [mailto:you.zhang@rochester.edu Neil Zhang]>
 +
* [[2025:Music Reasoning QA]] <TC: [mailto:yinghao.ma@qmul.ac.uk Yinghao Ma]>
 +
* [[2025:RenCon]] (Expressive Piano Performance Rendering Competition) <TC: [mailto:huan.zhang@qmul.ac.uk Huan Zhang]>
  
* [[2024:Audio Chord Estimation]] <TC: Junyan Jiang>
+
==Call for Challenges==
* [[2024:Lyrics-to-Audio Alignment]] <TC: Junyan Jiang>
 
* [[2024:Cover Song Identification]] <TC: Ruibin Yuan>
 
  
Modern MIR tasks
+
Starting with MIREX 2024, we invite the ISMIR community to propose new research challenges that address cutting-edge problems in Music Information Retrieval (MIR). These challenges should aim to push the boundaries of current research and foster innovation in the field.
  
* [[2024:Symbolic Music Generation]] <TC: Ziyu Wang>
+
We also welcome challenge sponsors from both industry and research institutions, particularly those willing to contribute datasets and computational resources to support the competition.
* [[2024:Music Audio Generation]] <TC: Ruibin Yuan>
 
* [[2024:Music Description & Captioning]] <TC: Yixiao Zhang>
 
* [[2024:Polyphonic Transcription]] <TC: Yujia Yan & Ziyu Wang>
 
* [[2024:Singing Voice Deepfake Detection]] <TC: Neil Zhang & Yixiao Zhang>
 
  
We also invite proposals for new challenges in MIR. For details, see [[2024:Call for Challenges]].
+
For the format and requirements for the challenge proposal, please go to [[2025:Call for Challenges]].
  
==Call for Challenges==
+
===What's new:===
  
Starting from MIREX 2024, we invite proposals for challenges addressing new research problems from the ISMIR community. These challenges should aim to push the boundaries of current research and foster innovation within the field of music information retrieval.
+
Starting with MIREX 2025, we invite the ISMIR community to participate in shaping the future of Music Information Retrieval (MIR) by either '''proposing new research challenges''' or '''volunteering as task captains''' for existing ones.  
  
For the format and requirements for the challenge proposal, please go to [[2024:Call for Challenges]].
+
* '''New challenge proposals''' should aim to address cutting-edge problems and push the boundaries of current MIR research.
 +
* '''Task captains for established tasks''' are encouraged to help revitalize previous tasks—potentially by updating evaluation methodologies, datasets, or other aspects to reflect recent advances in the field.
  
==Call for Task Captains==
+
Task Captain Responsibilities:
  
The call for task captains has not been opened this year since MIREX is running with limited scalability. It will be opened next year.
+
* Register on the [https://www.music-ir.org/mirex MIREX Wiki] and maintain a task description page.
 +
* Collect submissions via the MIREX submission server (or provide customized submission instructions).
 +
* Execute and evaluate the submissions.
 +
* Report results to MIREX and create a results page on the MIREX Wiki.
 +
* (Optional) Present a MIREX task captain poster at the Late-Breaking and Demo (LBD) session at ISMIR 2025.
  
 
==How to Participate==
 
==How to Participate==
  
* Read the task descriptions and the submission guidelines (coming soon).
+
See also the general [[Submission Guidelines]].
* Wrap your system in a Docker container. Required dependencies should be specified in the Dockerfile. Make sure to keep the I/O format consistent with the task description.
+
 
* Write a 2-3 page extended abstract PDF describing your system.
+
* Read the [[Participant Agreement]] and task description carefully.
* Submit your system and the extended abstract to the new submission portal (coming soon).
+
* Program your system.
* Notice that some tasks will use external submission systems like Kaggle or email submission this year. Please refer to the task description for details.
+
* Write a 2-4 page extended abstract PDF describing your system.
 +
* Submit your system and extended abstract to the [http://futuremirex.com/submission MIREX submission site].
 +
* Top-performing teams will have the opportunity to present their MIREX posters at the LBD session at ISMIR 2025.
  
 
==Important Dates==
 
==Important Dates==
  
* <del>Challenge proposals due: August 7, 2024</del>
+
* <del>Challenge proposals due: May 9, 2025</del>
* <del>Notification of acceptance for challenge proposals: August 14, 2024</del>
+
* <del>Notification of acceptance: May 16, 2025</del>
* Submission open: September 15, 2024
+
* Submission open: May 31, 2025
* Submission close: around October 15, 2024 (different tasks may vary, see task descriptions for details)
+
* Submission close: Sept 1, 2025 (Some tasks may have a different deadline; see task descriptions)
* Result published: around October 21, 2024 (different tasks may vary, see task descriptions for details)
+
* Result published: Sept 10, 2025 (Some tasks may have a different deadline; see task descriptions)
  
 
==Contact Us==
 
==Contact Us==
  
Since we are adapting MIREX to a new format, we welcome any feedback, suggestions, and task leader volunteers. Please send your email to [mailto:future-mirex@googlegroups.com future-mirex@googlegroups.com].
+
====Email====
 +
 
 +
For general questions, feedback, and suggestions, please send messages to our mailing list [mailto:future-mirex@googlegroups.com future-mirex@googlegroups.com].
 +
 
 +
For task-specific questions, we have listed the email for each task captain [[MIREX_HOME#Task_Descriptions|here]].
 +
 
 +
====Discord Server====
 +
 
 +
For real-time discussion with the MIREX organizers or task captains, you may join our [https://discord.gg/vC2YWX29sC discord server].
 +
 
 +
Notice: some task captains are not in the discord server.
 +
 
 +
====LinkedIn Organization Page====
 +
 
 +
You may visit our LinkedIn organization page [https://www.linkedin.com/company/future-mirex/ here].
  
We are looking forward to seeing you at MIREX 2024!
+
We are looking forward to seeing you at MIREX 2025!
  
Future MIREX Team, 2024
+
Future MIREX Team, 2025
  
MIREX 2024 Organizers:
+
MIREX 2025 Organizers:
* Junyan Jiang, New York University.
+
* Gus Xia, MBZUAI
 +
* Junyan Jiang, New York University
 
* Akira Maezawa, Yamaha  
 
* Akira Maezawa, Yamaha  
 
* Ziyu Wang, New York University
 
* Ziyu Wang, New York University
* Yixiao Zhang, Queen Mary University
+
* Yixiao Zhang, ByteDance Inc.
 
* Ruibin Yuan, Hong Kong University of Science and Technology
 
* Ruibin Yuan, Hong Kong University of Science and Technology
 
* J. Stephen Downie, University of Illinois
 
* J. Stephen Downie, University of Illinois
* Gus Xia, MBZUAI.
 

Latest revision as of 05:17, 4 June 2025

Welcome to MIREX 2025

After a break of 3 years, we want to bring back the MIREX (Music Information Retrieval Evaluation eXchange) competition starting from 2024. We want to bring in new tasks, benchmarks, and datasets in response to the rapid development of computer music research.

The MIREX community will hold its annual meeting as part of The International Society for Music Information Retrieval Conference. This year, the conference will be held in Daejeon, South Korea from September 21-25, 2025.

In a long run, we want to make MIREX a platform for researchers to share their latest research results, to compare their systems with others, and to promote the development of the field.

Task Descriptions

Traditional MIR tasks

Modern MIR Tasks

Call for Challenges

Starting with MIREX 2024, we invite the ISMIR community to propose new research challenges that address cutting-edge problems in Music Information Retrieval (MIR). These challenges should aim to push the boundaries of current research and foster innovation in the field.

We also welcome challenge sponsors from both industry and research institutions, particularly those willing to contribute datasets and computational resources to support the competition.

For the format and requirements for the challenge proposal, please go to 2025:Call for Challenges.

What's new:

Starting with MIREX 2025, we invite the ISMIR community to participate in shaping the future of Music Information Retrieval (MIR) by either proposing new research challenges or volunteering as task captains for existing ones.

  • New challenge proposals should aim to address cutting-edge problems and push the boundaries of current MIR research.
  • Task captains for established tasks are encouraged to help revitalize previous tasks—potentially by updating evaluation methodologies, datasets, or other aspects to reflect recent advances in the field.

Task Captain Responsibilities:

  • Register on the MIREX Wiki and maintain a task description page.
  • Collect submissions via the MIREX submission server (or provide customized submission instructions).
  • Execute and evaluate the submissions.
  • Report results to MIREX and create a results page on the MIREX Wiki.
  • (Optional) Present a MIREX task captain poster at the Late-Breaking and Demo (LBD) session at ISMIR 2025.

How to Participate

See also the general Submission Guidelines.

  • Read the Participant Agreement and task description carefully.
  • Program your system.
  • Write a 2-4 page extended abstract PDF describing your system.
  • Submit your system and extended abstract to the MIREX submission site.
  • Top-performing teams will have the opportunity to present their MIREX posters at the LBD session at ISMIR 2025.

Important Dates

  • Challenge proposals due: May 9, 2025
  • Notification of acceptance: May 16, 2025
  • Submission open: May 31, 2025
  • Submission close: Sept 1, 2025 (Some tasks may have a different deadline; see task descriptions)
  • Result published: Sept 10, 2025 (Some tasks may have a different deadline; see task descriptions)

Contact Us

Email

For general questions, feedback, and suggestions, please send messages to our mailing list future-mirex@googlegroups.com.

For task-specific questions, we have listed the email for each task captain here.

Discord Server

For real-time discussion with the MIREX organizers or task captains, you may join our discord server.

Notice: some task captains are not in the discord server.

LinkedIn Organization Page

You may visit our LinkedIn organization page here.

We are looking forward to seeing you at MIREX 2025!

Future MIREX Team, 2025

MIREX 2025 Organizers:

  • Gus Xia, MBZUAI
  • Junyan Jiang, New York University
  • Akira Maezawa, Yamaha
  • Ziyu Wang, New York University
  • Yixiao Zhang, ByteDance Inc.
  • Ruibin Yuan, Hong Kong University of Science and Technology
  • J. Stephen Downie, University of Illinois