Difference between revisions of "MIREX HOME"

From MIREX Wiki
(How to Participate)
(Welcome to MIREX 2026)
 
(17 intermediate revisions by 2 users not shown)
Line 1: Line 1:
==Welcome to MIREX 2025==
+
==Welcome to MIREX 2026==
  
After a break of 3 years, we want to bring back the MIREX (Music Information Retrieval Evaluation eXchange) competition starting from 2024. We want to bring in new tasks, benchmarks, and datasets in response to the rapid development of computer music research.
+
MIREX (Music Information Retrieval Evaluation eXchange) is an annual community evaluation campaign held in conjunction with the [https://ismir.net/ International Society for Music Information Retrieval Conference (ISMIR)]. This year, the conference will be held in [https://ismir2026.ismir.net/ Abu Dhabi, UAE] from November 8–12, 2026, and may include an online component.
  
The MIREX community will hold its annual meeting as part of [https://ismir.net/ The International Society for Music Information Retrieval Conference]. This year, the conference will be held in [https://ismir2025.ismir.net/ Daejeon, South Korea] from September 21-25, 2025.
+
In a long run, we want to make MIREX a platform for researchers to share their latest research results, to compare their systems with others, and to promote the development of the field.
  
In a long run, we want to make MIREX a platform for researchers to share their latest research results, to compare their systems with others, and to promote the development of the field.
+
==Call for Challenges==
  
==Task Descriptions==
+
We invite the ISMIR community to propose new research challenges that address cutting-edge problems in Music Information Retrieval (MIR). These challenges should aim to push the boundaries of current research and foster innovation in the field. We also welcome challenge sponsors from both industry and research institutions, particularly those willing to contribute datasets and computational resources to support the competition.
  
Traditional MIR tasks
+
For the format and requirements for the challenge proposal, please go to [[2026:Call for Challenges]].
* [[2025:Audio Chord Estimation]] <TC: [mailto:jj2731@nyu.edu Junyan Jiang]>
 
* [[2025:Lyrics Transcription]] <TC: [mailto:ruibiny@alumni.cmu.edu Ruibin Yuan] & [mailto:jj2731@nyu.edu Junyan Jiang]>
 
* [[2025:Cover Song Identification]] <TC: [mailto:x.du@rochester.edu Xingjian Du] & [mailto:ruibiny@alumni.cmu.edu Ruibin Yuan]>
 
* [[2025:Music Structure Analysis]] <TC: [mailto:yixiao.zhang@qmul.ac.uk Yixiao Zhang] & [mailto:ruibiny@alumni.cmu.edu Ruibin Yuan]>
 
* [[2025:Audio Beat Tracking]] <TC: [mailto:mwysjtu@gmail.com Wenye Ma] & [mailto:yinghao.ma@qmul.ac.uk Yinghao Ma]>
 
* [[2025:Audio Key Detection]] <TC: [mailto:mwysjtu@gmail.com Wenye Ma] & [mailto:yinghao.ma@qmul.ac.uk Yinghao Ma]>
 
  
Modern MIR Tasks
+
Task Captain Responsibilities:
* [[2025:Symbolic Music Generation]] <TC: [mailto:ziyu.wang@nyu.edu Ziyu Wang]>
 
* [[2025:Music Audio Generation]] <TC: [mailto:ruibiny@alumni.cmu.edu Ruibin Yuan]>
 
* [[2025:Music Description & Captioning]] <TC: [mailto:yixiao.zhang@qmul.ac.uk Yixiao Zhang] & [mailto:ruibiny@alumni.cmu.edu Ruibin Yuan]>
 
* [[2025:Polyphonic Transcription]] <TC: [mailto:yunglu@purdue.edu Yung-Hsiang Lu], [mailto:yun98@purdue.edu Kristen Yeon-Ji Yun], [mailto:ziyu.wang@nyu.edu Ziyu Wang], [mailto:yujia.yan@rochester.edu Yujia Yan]>
 
* [[2025:Song Deepfake Detection]] <TC: [mailto:you.zhang@rochester.edu Neil Zhang]>
 
* [[2025:Music Reasoning QA]] <TC: [mailto:yinghao.ma@qmul.ac.uk Yinghao Ma]>
 
* [[2025:RenCon]] (Expressive Piano Performance Rendering Competition) <TC: [mailto:huan.zhang@qmul.ac.uk Huan Zhang]>
 
  
==Call for Challenges==
+
* Register on the [https://www.music-ir.org/mirex MIREX Wiki] and maintain a task description page.
 +
* Collect submissions via the MIREX submission server (or provide customized submission instructions).
 +
* Execute and evaluate the submissions.
 +
* Report results to MIREX and create a results page on the MIREX Wiki.
 +
* (Optional) Present a MIREX task captain poster at the Late-Breaking and Demo (LBD) session at ISMIR 2026.
  
Starting with MIREX 2024, we invite the ISMIR community to propose new research challenges that address cutting-edge problems in Music Information Retrieval (MIR). These challenges should aim to push the boundaries of current research and foster innovation in the field.
+
===What's new:===
  
We also welcome challenge sponsors from both industry and research institutions, particularly those willing to contribute datasets and computational resources to support the competition.
+
In MIREX 2026, we introduce two special calls for challenges:
  
For the format and requirements for the challenge proposal, please go to [[2025:Call for Challenges]].
+
1. Novel evaluation pipelines
  
===What's new:===
+
There is a growing need for new evaluation methodologies. We welcome challenge proposals that introduce novel evaluation pipelines, including but not limited to the evaluation of generative models, interactive systems, and other emerging paradigms.
  
Starting with MIREX 2025, we invite the ISMIR community to participate in shaping the future of Music Information Retrieval (MIR) by either '''proposing new research challenges''' or '''volunteering as task captains''' for existing ones.  
+
2. Evaluation under limited resources
  
* '''New challenge proposals''' should aim to address cutting-edge problems and push the boundaries of current MIR research.  
+
In addition to state-of-the-art systems, MIREX aims to better support researchers and research areas with limited resources. We welcome challenge proposals that focus on underrepresented research areas, music genres, or research communities.
* '''Task captains for established tasks''' are encouraged to help revitalize previous tasks—potentially by updating evaluation methodologies, datasets, or other aspects to reflect recent advances in the field.
 
  
Task Captain Responsibilities:
+
Furthermore, all task captains are encouraged to report key resource indicators for each submission, including:
  
* Register on the [https://www.music-ir.org/mirex MIREX Wiki] and maintain a task description page.
+
* training data size
* Collect submissions via the MIREX submission server (or provide customized submission instructions).
+
* model size
* Execute and evaluate the submissions.
+
* other computational resources used in model development
* Report results to MIREX and create a results page on the MIREX Wiki.
 
* (Optional) Present a MIREX task captain poster at the Late-Breaking and Demo (LBD) session at ISMIR 2025.
 
  
 
==How to Participate==
 
==How to Participate==
Line 57: Line 45:
 
* Write a 2-4 page extended abstract PDF describing your system.
 
* Write a 2-4 page extended abstract PDF describing your system.
 
* Submit your system and extended abstract to the [http://futuremirex.com/submission MIREX submission site].
 
* Submit your system and extended abstract to the [http://futuremirex.com/submission MIREX submission site].
* Top-performing teams will have the opportunity to present their MIREX posters at the LBD session at ISMIR 2025.
+
* Top-performing teams will have the opportunity to present their MIREX posters at the LBD session at ISMIR 2026.
  
 
==Important Dates==
 
==Important Dates==
  
* Challenge proposals due: May 9, 2025
+
* Challenge proposals due: May 15, 2026
* Notification of acceptance: May 16, 2025
+
* Notification of acceptance: May 29, 2026
* Submission open: May 30, 2025
+
* Submission open: Jul 1, 2026
* Submission close: Sept 1, 2025 (Some tasks may have a different deadline; see task descriptions)
+
* Submission close: Oct 1, 2026 (Some tasks may have a different deadline; see task descriptions)
* Result published: Sept 10, 2025 (Some tasks may have a different deadline; see task descriptions)
+
* Result published: Oct 15, 2026 (Some tasks may have a different deadline; see task descriptions)
  
 
==Contact Us==
 
==Contact Us==
  
For general questions, feedback, and suggestions, please send messages to our mailing list future-mirex@googlegroups.com. For task-specific inquiries, please email individual task captain, or post a question in the [http://futuremirex.com/portal/ submission portal] forum.
+
====Email====
 +
 
 +
For general questions, feedback, and suggestions, please send messages to our mailing list [mailto:future-mirex@googlegroups.com future-mirex@googlegroups.com].
 +
 
 +
For task-specific questions, we have listed the email for each task captain [[MIREX_HOME#Task_Descriptions|here]].
 +
 
 +
====Discord Server====
 +
 
 +
For real-time discussion with the MIREX organizers or task captains, you may join our [https://discord.gg/vC2YWX29sC discord server].
 +
 
 +
Notice: some task captains are not in the discord server.
 +
 
 +
====Repositories====
 +
 
 +
Open-source evaluation pipelines: https://github.com/ismir-mirex/mirex-evaluation
 +
 
 +
Github organization: https://github.com/ismir-mirex/
  
We are looking forward to seeing you at MIREX 2025!
+
====LinkedIn Organization Page====
  
Future MIREX Team, 2025
+
You may visit our LinkedIn organization page [https://www.linkedin.com/company/future-mirex/ here].
  
MIREX 2025 Organizers:
+
We are looking forward to seeing you at MIREX 2026!
 +
 
 +
Future MIREX Team, 2026
 +
 
 +
MIREX 2026 Organizers:
 +
* Junyan Jiang, New York University
 
* Gus Xia, MBZUAI
 
* Gus Xia, MBZUAI
* Junyan Jiang, New York University
 
 
* Akira Maezawa, Yamaha  
 
* Akira Maezawa, Yamaha  
 
* Ziyu Wang, New York University
 
* Ziyu Wang, New York University

Latest revision as of 01:00, 16 March 2026

Welcome to MIREX 2026

MIREX (Music Information Retrieval Evaluation eXchange) is an annual community evaluation campaign held in conjunction with the International Society for Music Information Retrieval Conference (ISMIR). This year, the conference will be held in Abu Dhabi, UAE from November 8–12, 2026, and may include an online component.

In a long run, we want to make MIREX a platform for researchers to share their latest research results, to compare their systems with others, and to promote the development of the field.

Call for Challenges

We invite the ISMIR community to propose new research challenges that address cutting-edge problems in Music Information Retrieval (MIR). These challenges should aim to push the boundaries of current research and foster innovation in the field. We also welcome challenge sponsors from both industry and research institutions, particularly those willing to contribute datasets and computational resources to support the competition.

For the format and requirements for the challenge proposal, please go to 2026:Call for Challenges.

Task Captain Responsibilities:

  • Register on the MIREX Wiki and maintain a task description page.
  • Collect submissions via the MIREX submission server (or provide customized submission instructions).
  • Execute and evaluate the submissions.
  • Report results to MIREX and create a results page on the MIREX Wiki.
  • (Optional) Present a MIREX task captain poster at the Late-Breaking and Demo (LBD) session at ISMIR 2026.

What's new:

In MIREX 2026, we introduce two special calls for challenges:

1. Novel evaluation pipelines

There is a growing need for new evaluation methodologies. We welcome challenge proposals that introduce novel evaluation pipelines, including but not limited to the evaluation of generative models, interactive systems, and other emerging paradigms.

2. Evaluation under limited resources

In addition to state-of-the-art systems, MIREX aims to better support researchers and research areas with limited resources. We welcome challenge proposals that focus on underrepresented research areas, music genres, or research communities.

Furthermore, all task captains are encouraged to report key resource indicators for each submission, including:

  • training data size
  • model size
  • other computational resources used in model development

How to Participate

See also the general Submission Guidelines.

  • Read the Participant Agreement and task description carefully.
  • Program your system.
  • Write a 2-4 page extended abstract PDF describing your system.
  • Submit your system and extended abstract to the MIREX submission site.
  • Top-performing teams will have the opportunity to present their MIREX posters at the LBD session at ISMIR 2026.

Important Dates

  • Challenge proposals due: May 15, 2026
  • Notification of acceptance: May 29, 2026
  • Submission open: Jul 1, 2026
  • Submission close: Oct 1, 2026 (Some tasks may have a different deadline; see task descriptions)
  • Result published: Oct 15, 2026 (Some tasks may have a different deadline; see task descriptions)

Contact Us

Email

For general questions, feedback, and suggestions, please send messages to our mailing list future-mirex@googlegroups.com.

For task-specific questions, we have listed the email for each task captain here.

Discord Server

For real-time discussion with the MIREX organizers or task captains, you may join our discord server.

Notice: some task captains are not in the discord server.

Repositories

Open-source evaluation pipelines: https://github.com/ismir-mirex/mirex-evaluation

Github organization: https://github.com/ismir-mirex/

LinkedIn Organization Page

You may visit our LinkedIn organization page here.

We are looking forward to seeing you at MIREX 2026!

Future MIREX Team, 2026

MIREX 2026 Organizers:

  • Junyan Jiang, New York University
  • Gus Xia, MBZUAI
  • Akira Maezawa, Yamaha
  • Ziyu Wang, New York University
  • Yixiao Zhang, ByteDance Inc.
  • Ruibin Yuan, Hong Kong University of Science and Technology
  • J. Stephen Downie, University of Illinois