MIREX Wiki - Recent changes [en]

2026:Rhythm Game Chart Generation Results

Ziyunliu — Sun, 11 Oct 2026 17:08:34 GMT

‎Expert Evaluation Results

Show changes

2026:Rhythm Game Chart Generation Results

Carolina Carusi — Sun, 11 Oct 2026 09:09:56 GMT

2026:Rhythm Game Chart Generation Results

Ziyunliu — Sun, 11 Oct 2026 09:08:29 GMT

‎Community Evaluation Results

2026:Rhythm Game Chart Generation Results

Carolina Carusi — Sun, 11 Oct 2026 08:37:55 GMT

Algorithmic evaluation draft

Show changes

2026:Rhythm Game Chart Generation Results

Ziyunliu — Thu, 08 Oct 2026 20:06:53 GMT

‎Test Set

2026:Rhythm Game Chart Generation Results

Ziyunliu — Wed, 07 Oct 2026 17:53:08 GMT

Created page with "= Submissions = = Test Sets = = Results = == Algorithmic Evaluation Results == == Expert Evaluation Results == == Community Evaluation Results =="

New page

= Submissions =

= Test Sets =

= Results =

== Algorithmic Evaluation Results ==

== Expert Evaluation Results ==

== Community Evaluation Results ==

2026:Music Evaluation via CMI-RewardBench

Yinghao Ma — Wed, 07 Oct 2026 09:39:07 GMT

‎A Simple Example

2026:Music Structure Analysis

Junyan — Tue, 06 Oct 2026 15:52:56 GMT

‎Music Structure Analysis (MIREX 2026)

MIREX HOME

Junyan — Tue, 06 Oct 2026 14:21:30 GMT

‎How to Participate

2026:Music Evaluation via CMI-RewardBench

Yinghao Ma — Mon, 05 Oct 2026 22:33:54 GMT

‎Timeline and Submission Instructions

← Older revision	Revision as of 09:09, 11 October 2026
(One intermediate revision by the same user not shown)
(No difference)

@@ Line 86: / Line 86: @@
 === Default Settings ===
 = Results =
@@ Line 91: / Line 115: @@
 == Algorithmic Evaluation Results ==
-beatmaps were checked across 4 models, 6 songs, and 5 difficulties.
+beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.
 Difficulty ordering warnings:
 * DOSU - closer to you - Inner Oni < Oni
@@ Line 312: / Line 337: @@
 | Unused audio at the end
 |}
 == Expert Evaluation Results ==
 == Community Evaluation Results ==

@@ Line 34: / Line 34: @@
 <pre>
+{
-   "sample_id": "toy_example_001",
+   "battle_uuid": "toy_example_001",
    "preferred_candidate": "A"
+}
 </pre>
 == Submission and Environment Requirements ==

@@ Line 42: / Line 42: @@
 === Submission Format ===
-Submissions will be handled via '''CodeBench'''. Participants are required to submit their results in a specific format, as detailed below. You will upload a single file containing the segmentation results for all test audio files.
+Submissions will be handled via [https://futuremirex.com/submission/dashboard MIREX submission portal]. Participants are required to submit their results in a specific format, as detailed below. You will upload a single file containing the segmentation results for all test audio files.
 ==== Output Data Format ====
@@ Line 108: / Line 108: @@
 These public corpora offer over 200 songs that can be adapted for development purposes.

@@ Line 68: / Line 68: @@
 * Submit your system and extended abstract to the [http://futuremirex.com/submission MIREX submission site].
 * Top-performing teams will have the opportunity to present their MIREX posters at the LBD session at ISMIR 2026.
 ==Important Dates==

@@ Line 1: / Line 1: @@
 = Submissions =
-= Test Sets =
+{| class="wikitable"
 = Results =

@@ Line 88: / Line 88: @@
 crowdsourced platform over the months leading up to the evaluation. Because this data is kept completely private and released continuously, it ensures zero data leakage and prevents benchmark saturation.
-* URL: https://drive.google.com/file/d/14X46JD1W_mN-UOtVSupvrVPsaR5jep1a/view?usp=sharing
+* URL (available on 6th and 7th Oct): https://drive.google.com/file/d/14X46JD1W_mN-UOtVSupvrVPsaR5jep1a/view?usp=sharing
 = Baselines =
@@ Line 114: / Line 114: @@
 The evaluation follows a rapid-turnaround test phase window in October:
-* '''[updated] October 6th:''' The evaluation team will release the official music audio files and the corresponding evaluation JSONL file.
+* '''[updated] October 6th:''' The evaluation team will release the official music audio files and the corresponding evaluation JSONL file. '''See private test set subsection above.'''
 * '''[updated] October 7th (AOE):''' Deadline to generate and upload your predictions. You must submit the completed JSONL file containing the preference predictions for each of the given audio pairs.