Difference between revisions of "2025:Call for Challenges"

From MIREX Wiki
(Created page with "==Call for Challenge Proposals== Starting with MIREX 2024, we invite the ISMIR community to propose new research challenges that address cutting-edge problems in Music Inform...")
 
 
(4 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
==Call for Challenge Proposals==
 
==Call for Challenge Proposals==
 +
 +
'''This page is still WIP. We will send an annoucement when it is finalized.'''
  
 
Starting with MIREX 2024, we invite the ISMIR community to propose new research challenges that address cutting-edge problems in Music Information Retrieval (MIR). These challenges should aim to push the boundaries of current research and foster innovation in the field.
 
Starting with MIREX 2024, we invite the ISMIR community to propose new research challenges that address cutting-edge problems in Music Information Retrieval (MIR). These challenges should aim to push the boundaries of current research and foster innovation in the field.
  
===What's new:===
+
===What's new===
  
Beginning in MIREX 2025, all proposed challenges must have an assigned task captain responsible for evaluating participant submissions. Additionally, task captains may use proprietary datasets for evaluation.
+
* We will accept more proposals compared to MIREX 2024.
 +
* All proposed challenges must have an assigned task captain (name+email included).
  
 
Task Captain Responsibilities:
 
Task Captain Responsibilities:
Line 14: Line 17:
 
* Report results to MIREX and create a results page on the MIREX Wiki.
 
* Report results to MIREX and create a results page on the MIREX Wiki.
 
* (Optional) Present a MIREX task captain poster at the Late-Breaking and Demo (LBD) session at ISMIR 2025.
 
* (Optional) Present a MIREX task captain poster at the Late-Breaking and Demo (LBD) session at ISMIR 2025.
 +
 +
Hints for Challenge Proposals:
 +
 +
* To invite research groups without access to large datasets or extensive computational resources, you are encouraged to create multiple subtasks that impose different restrictions on model size and dataset usage. Example:
 +
  Subtask 1: Model size < 200M. Training set: MusDB18 only.
 +
  Subtask 2: Model size: any. Training set: any.
 +
* Task captains may use proprietary datasets for evaluation.
  
 
==Submission Format==
 
==Submission Format==
Line 38: Line 48:
 
We look forward to receiving your innovative and impactful challenge proposals. If you have any questions, please do not hesitate to contact the MIREX organizing committee [mailto:future-mirex@googlegroups.com future-mirex@googlegroups.com].
 
We look forward to receiving your innovative and impactful challenge proposals. If you have any questions, please do not hesitate to contact the MIREX organizing committee [mailto:future-mirex@googlegroups.com future-mirex@googlegroups.com].
  
MIREX 2024 Organizers:
+
MIREX 2025 Organizers:
 
* Junyan Jiang, New York University
 
* Junyan Jiang, New York University
 
* Akira Maezawa, Yamaha  
 
* Akira Maezawa, Yamaha  
 
* Ziyu Wang, New York University
 
* Ziyu Wang, New York University
* Yixiao Zhang, Queen Mary University of London
+
* Yixiao Zhang, ByteDance
 
* Ruibin Yuan, Hong Kong University of Science and Technology
 
* Ruibin Yuan, Hong Kong University of Science and Technology
 
* J. Stephen Downie, University of Illinois
 
* J. Stephen Downie, University of Illinois
 
* Gus Xia, MBZUAI
 
* Gus Xia, MBZUAI

Latest revision as of 12:35, 10 March 2025

Call for Challenge Proposals

This page is still WIP. We will send an annoucement when it is finalized.

Starting with MIREX 2024, we invite the ISMIR community to propose new research challenges that address cutting-edge problems in Music Information Retrieval (MIR). These challenges should aim to push the boundaries of current research and foster innovation in the field.

What's new

  • We will accept more proposals compared to MIREX 2024.
  • All proposed challenges must have an assigned task captain (name+email included).

Task Captain Responsibilities:

  • Register on the MIREX Wiki and maintain a task description page.
  • Collect submissions via the MIREX submission server (or provide customized submission instructions).
  • Execute and evaluate the submissions.
  • Report results to MIREX and create a results page on the MIREX Wiki.
  • (Optional) Present a MIREX task captain poster at the Late-Breaking and Demo (LBD) session at ISMIR 2025.

Hints for Challenge Proposals:

  • To invite research groups without access to large datasets or extensive computational resources, you are encouraged to create multiple subtasks that impose different restrictions on model size and dataset usage. Example:
 Subtask 1: Model size < 200M. Training set: MusDB18 only.
 Subtask 2: Model size: any. Training set: any.
  • Task captains may use proprietary datasets for evaluation.

Submission Format

A call for challenge proposal must contain the following content:

  1. Title
  2. Abstract
  3. Task description
  4. Significance of the task
  5. Evaluation criteria
  6. Datasets and resources provided
  7. Requirements for submission

Please submit a 2-4 page PDF to the MIREX organizing committee future-mirex@googlegroups.com. before the due date.

Deadlines

  • Challenge proposals due: TBA
  • Notification of acceptance: TBA

Contact Us

We look forward to receiving your innovative and impactful challenge proposals. If you have any questions, please do not hesitate to contact the MIREX organizing committee future-mirex@googlegroups.com.

MIREX 2025 Organizers:

  • Junyan Jiang, New York University
  • Akira Maezawa, Yamaha
  • Ziyu Wang, New York University
  • Yixiao Zhang, ByteDance
  • Ruibin Yuan, Hong Kong University of Science and Technology
  • J. Stephen Downie, University of Illinois
  • Gus Xia, MBZUAI