MIREX Wiki - User contributions [en]

2026:Rhythm Game Chart Generation Results

2026-10-14T16:46:32Z

Ziyunliu: /* Community Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/DOSU.pdf PDF]
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/FumenLab.pdf PDF]
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/HiTaiko.pdf PDF]
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/MALer.pdf PDF]
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| YUBIKIRI-GENMAN
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10.

We adopt the judge-score normalization approach used by the [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and report both '''within-song normalization''' and '''across-song normalization''' scores. For each category, a judge’s normalized score is calculated as '''(raw rating − judge’s mean rating) / judge’s population standard deviation'''. Within-song normalization uses the four submissions evaluated by that judge for the same song; across-song normalization uses all 12 submissions assigned to that judge across three songs. A submission’s category score is the '''sum of its three judges’ normalized scores'''. '''Combined Quality''' is calculated by first summing each judge’s raw ratings for Musical Representation, Creativity, and Gameplay, then normalizing these totals using the same procedure and summing the three judges’ normalized scores. '''Human-Likeness is evaluated separately and excluded from Combined Quality'''.

=== Silver Bullet ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| '''1.5872''' || 1.9303
| −2.6304 || −0.6119
| '''2.0099''' || '''1.2101'''
| −0.9236 || 0.8593
| −0.4552 || −0.4745
|-
| FumenLab
| 0.3005 || 1.8878
| 0.9401 || 1.1426
| −3.5863 || −2.9908
| −1.5011 || −0.0563
| −1.9478 || −1.6081
|-
| HiTaiko
| 1.2778 || '''2.6483'''
| '''1.8629''' || '''2.8452'''
| '''2.0099''' || '''1.2101'''
| '''3.6945''' || '''2.5621'''
| '''4.1634''' || '''3.0147'''
|-
| MALer
| −3.1656 || −0.6386
| −0.1726 || 0.6706
| −0.4335 || −1.0840
| −1.2698 || −0.3204
| −1.7604 || −1.4425
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −4.7037 || −5.3766
| −3.6090 || −4.6191
| 0.4677 || −0.1418
| −4.0148 || −4.1326
| −1.5881 || −2.3767
|-
| FumenLab
| 0.2720 || −1.1810
| −0.2284 || −1.7695
| −2.4438 || −2.4506
| −0.7583 || −2.0492
| −0.1690 || −0.8568
|-
| HiTaiko
| 2.0747 || 0.3217
| 0.9776 || −0.6639
| '''2.2563''' || '''1.3928'''
| 2.0694 || 0.1551
| '''2.3546''' || '''1.7015'''
|-
| MALer
| '''2.3570''' || '''0.9179'''
| '''2.8598''' || '''1.3301'''
| −0.2803 || −0.2017
| '''2.7037''' || '''0.7954'''
| −0.5975 || −1.2836
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −1.6143 || −1.9648
| '''0.6706''' || −0.1198
| −1.2916 || −1.3750
| −1.0346 || −0.8634
| −1.5202 || −1.6127
|-
| FumenLab
| 1.3093 || '''1.3220'''
| 0.3325 || '''1.5965'''
| '''2.5865''' || '''2.5448'''
| '''1.6890''' || '''2.3056'''
| 0.6172 || 0.7949
|-
| HiTaiko
| '''1.3093''' || −0.1391
| −0.2970 || −1.0083
| 1.8815 || 1.2769
| 1.3451 || −0.2158
| '''4.0095''' || '''2.8074'''
|-
| MALer
| −1.0043 || −1.5591
| −0.7060 || −1.4543
| −3.1764 || −3.0761
| −1.9995 || −2.1248
| −3.1065 || −2.6061
|}

''FumenLab and HiTaiko’s within-song Musical Representation scores round to the same value. HiTaiko has the slightly higher unrounded score.''

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}

=== Something Fun ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −4.1362 || −4.6148
| −3.0094 || −2.8557
| −2.8967 || −3.2500
| −3.5170 || −3.8992
| −3.9851 || −3.5107
|-
| FumenLab
| 1.7808 || 0.8973
| 2.0497 || 1.3931
| '''2.0645''' || '''1.7150'''
| '''2.3657''' || 1.5878
| '''2.1521''' || 1.6169
|-
| HiTaiko
| −1.0707 || −1.7031
| −1.3013 || −0.9950
| −0.3393 || −1.1085
| −1.1090 || −1.4505
| 0.6620 || 0.4912
|-
| MALer
| '''3.4261''' || '''2.4004'''
| '''2.2610''' || '''2.7960'''
| 1.1716 || 0.9334
| 2.2602 || '''2.0269'''
| 1.1710 || '''2.1783'''
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −0.5579 || 0.7297
| 0.7683 || 1.3234
| −0.7678 || 0.5162
| −0.2182 || 0.8831
| −0.5907 || 0.3679
|-
| FumenLab
| '''3.3983''' || '''4.5471'''
| '''4.2866''' || '''5.5175'''
| '''4.4877''' || '''5.3224'''
| '''4.4930''' || '''5.9265'''
| '''3.5659''' || '''4.1415'''
|-
| HiTaiko
| 1.6737 || 2.6624
| −2.5275 || −2.2587
| −0.1399 || 1.1821
| −0.4174 || 0.6315
| 1.0151 || 1.8349
|-
| MALer
| −4.5141 || −3.0877
| −2.5275 || −2.2587
| −3.5800 || −1.6254
| −3.8573 || −2.6216
| −3.9903 || −3.1775
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

== Community Evaluation Results ==

X osu!taiko players evaluated submissions on one test song: '''Himitsu feat. KAFU'''. Players assessed submissions from all 4 models, plus one beatmap created by a human mapper, on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. They were not informed that any of the beatmaps were human-made. Every participant selected their preferred difficulty level and evaluated only the beatmaps of that difficulty.

=== Kantan - 2 participants ===
{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Overall Quality Score
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
|
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|
|}

=== Futsuu - 2 participants ===

=== Muzukashii - 2 participants ===

=== Inner Oni - 5 participants ===

2026:Rhythm Game Chart Generation Results

2026-10-14T16:45:15Z

Ziyunliu: /* Inner Oni - n=2 participants */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/DOSU.pdf PDF]
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/FumenLab.pdf PDF]
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/HiTaiko.pdf PDF]
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/MALer.pdf PDF]
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| YUBIKIRI-GENMAN
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10.

We adopt the judge-score normalization approach used by the [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and report both '''within-song normalization''' and '''across-song normalization''' scores. For each category, a judge’s normalized score is calculated as '''(raw rating − judge’s mean rating) / judge’s population standard deviation'''. Within-song normalization uses the four submissions evaluated by that judge for the same song; across-song normalization uses all 12 submissions assigned to that judge across three songs. A submission’s category score is the '''sum of its three judges’ normalized scores'''. '''Combined Quality''' is calculated by first summing each judge’s raw ratings for Musical Representation, Creativity, and Gameplay, then normalizing these totals using the same procedure and summing the three judges’ normalized scores. '''Human-Likeness is evaluated separately and excluded from Combined Quality'''.

=== Silver Bullet ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| '''1.5872''' || 1.9303
| −2.6304 || −0.6119
| '''2.0099''' || '''1.2101'''
| −0.9236 || 0.8593
| −0.4552 || −0.4745
|-
| FumenLab
| 0.3005 || 1.8878
| 0.9401 || 1.1426
| −3.5863 || −2.9908
| −1.5011 || −0.0563
| −1.9478 || −1.6081
|-
| HiTaiko
| 1.2778 || '''2.6483'''
| '''1.8629''' || '''2.8452'''
| '''2.0099''' || '''1.2101'''
| '''3.6945''' || '''2.5621'''
| '''4.1634''' || '''3.0147'''
|-
| MALer
| −3.1656 || −0.6386
| −0.1726 || 0.6706
| −0.4335 || −1.0840
| −1.2698 || −0.3204
| −1.7604 || −1.4425
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −4.7037 || −5.3766
| −3.6090 || −4.6191
| 0.4677 || −0.1418
| −4.0148 || −4.1326
| −1.5881 || −2.3767
|-
| FumenLab
| 0.2720 || −1.1810
| −0.2284 || −1.7695
| −2.4438 || −2.4506
| −0.7583 || −2.0492
| −0.1690 || −0.8568
|-
| HiTaiko
| 2.0747 || 0.3217
| 0.9776 || −0.6639
| '''2.2563''' || '''1.3928'''
| 2.0694 || 0.1551
| '''2.3546''' || '''1.7015'''
|-
| MALer
| '''2.3570''' || '''0.9179'''
| '''2.8598''' || '''1.3301'''
| −0.2803 || −0.2017
| '''2.7037''' || '''0.7954'''
| −0.5975 || −1.2836
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −1.6143 || −1.9648
| '''0.6706''' || −0.1198
| −1.2916 || −1.3750
| −1.0346 || −0.8634
| −1.5202 || −1.6127
|-
| FumenLab
| 1.3093 || '''1.3220'''
| 0.3325 || '''1.5965'''
| '''2.5865''' || '''2.5448'''
| '''1.6890''' || '''2.3056'''
| 0.6172 || 0.7949
|-
| HiTaiko
| '''1.3093''' || −0.1391
| −0.2970 || −1.0083
| 1.8815 || 1.2769
| 1.3451 || −0.2158
| '''4.0095''' || '''2.8074'''
|-
| MALer
| −1.0043 || −1.5591
| −0.7060 || −1.4543
| −3.1764 || −3.0761
| −1.9995 || −2.1248
| −3.1065 || −2.6061
|}

''FumenLab and HiTaiko’s within-song Musical Representation scores round to the same value. HiTaiko has the slightly higher unrounded score.''

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}

=== Something Fun ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −4.1362 || −4.6148
| −3.0094 || −2.8557
| −2.8967 || −3.2500
| −3.5170 || −3.8992
| −3.9851 || −3.5107
|-
| FumenLab
| 1.7808 || 0.8973
| 2.0497 || 1.3931
| '''2.0645''' || '''1.7150'''
| '''2.3657''' || 1.5878
| '''2.1521''' || 1.6169
|-
| HiTaiko
| −1.0707 || −1.7031
| −1.3013 || −0.9950
| −0.3393 || −1.1085
| −1.1090 || −1.4505
| 0.6620 || 0.4912
|-
| MALer
| '''3.4261''' || '''2.4004'''
| '''2.2610''' || '''2.7960'''
| 1.1716 || 0.9334
| 2.2602 || '''2.0269'''
| 1.1710 || '''2.1783'''
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −0.5579 || 0.7297
| 0.7683 || 1.3234
| −0.7678 || 0.5162
| −0.2182 || 0.8831
| −0.5907 || 0.3679
|-
| FumenLab
| '''3.3983''' || '''4.5471'''
| '''4.2866''' || '''5.5175'''
| '''4.4877''' || '''5.3224'''
| '''4.4930''' || '''5.9265'''
| '''3.5659''' || '''4.1415'''
|-
| HiTaiko
| 1.6737 || 2.6624
| −2.5275 || −2.2587
| −0.1399 || 1.1821
| −0.4174 || 0.6315
| 1.0151 || 1.8349
|-
| MALer
| −4.5141 || −3.0877
| −2.5275 || −2.2587
| −3.5800 || −1.6254
| −3.8573 || −2.6216
| −3.9903 || −3.1775
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

== Community Evaluation Results ==

X osu!taiko players evaluated submissions on one test song: '''Himitsu feat. KAFU'''. Players assessed submissions from all 4 models, plus one beatmap created by a human mapper, on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. They were not informed that any of the beatmaps were human-made. Every participant selected their preferred difficulty level and evaluated only the beatmaps of that difficulty.

=== Kantan - n=2 participants ===
{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Overall Quality Score
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
|
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|
|}

=== Futsuu - n=2 participants ===

=== Muzukashii - n=2 participants ===

=== Inner Oni - n=5 participants ===

2026:Rhythm Game Chart Generation Results

2026-10-14T16:44:50Z

Ziyunliu: /* Community Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/DOSU.pdf PDF]
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/FumenLab.pdf PDF]
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/HiTaiko.pdf PDF]
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/MALer.pdf PDF]
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| YUBIKIRI-GENMAN
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10.

We adopt the judge-score normalization approach used by the [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and report both '''within-song normalization''' and '''across-song normalization''' scores. For each category, a judge’s normalized score is calculated as '''(raw rating − judge’s mean rating) / judge’s population standard deviation'''. Within-song normalization uses the four submissions evaluated by that judge for the same song; across-song normalization uses all 12 submissions assigned to that judge across three songs. A submission’s category score is the '''sum of its three judges’ normalized scores'''. '''Combined Quality''' is calculated by first summing each judge’s raw ratings for Musical Representation, Creativity, and Gameplay, then normalizing these totals using the same procedure and summing the three judges’ normalized scores. '''Human-Likeness is evaluated separately and excluded from Combined Quality'''.

=== Silver Bullet ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| '''1.5872''' || 1.9303
| −2.6304 || −0.6119
| '''2.0099''' || '''1.2101'''
| −0.9236 || 0.8593
| −0.4552 || −0.4745
|-
| FumenLab
| 0.3005 || 1.8878
| 0.9401 || 1.1426
| −3.5863 || −2.9908
| −1.5011 || −0.0563
| −1.9478 || −1.6081
|-
| HiTaiko
| 1.2778 || '''2.6483'''
| '''1.8629''' || '''2.8452'''
| '''2.0099''' || '''1.2101'''
| '''3.6945''' || '''2.5621'''
| '''4.1634''' || '''3.0147'''
|-
| MALer
| −3.1656 || −0.6386
| −0.1726 || 0.6706
| −0.4335 || −1.0840
| −1.2698 || −0.3204
| −1.7604 || −1.4425
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −4.7037 || −5.3766
| −3.6090 || −4.6191
| 0.4677 || −0.1418
| −4.0148 || −4.1326
| −1.5881 || −2.3767
|-
| FumenLab
| 0.2720 || −1.1810
| −0.2284 || −1.7695
| −2.4438 || −2.4506
| −0.7583 || −2.0492
| −0.1690 || −0.8568
|-
| HiTaiko
| 2.0747 || 0.3217
| 0.9776 || −0.6639
| '''2.2563''' || '''1.3928'''
| 2.0694 || 0.1551
| '''2.3546''' || '''1.7015'''
|-
| MALer
| '''2.3570''' || '''0.9179'''
| '''2.8598''' || '''1.3301'''
| −0.2803 || −0.2017
| '''2.7037''' || '''0.7954'''
| −0.5975 || −1.2836
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −1.6143 || −1.9648
| '''0.6706''' || −0.1198
| −1.2916 || −1.3750
| −1.0346 || −0.8634
| −1.5202 || −1.6127
|-
| FumenLab
| 1.3093 || '''1.3220'''
| 0.3325 || '''1.5965'''
| '''2.5865''' || '''2.5448'''
| '''1.6890''' || '''2.3056'''
| 0.6172 || 0.7949
|-
| HiTaiko
| '''1.3093''' || −0.1391
| −0.2970 || −1.0083
| 1.8815 || 1.2769
| 1.3451 || −0.2158
| '''4.0095''' || '''2.8074'''
|-
| MALer
| −1.0043 || −1.5591
| −0.7060 || −1.4543
| −3.1764 || −3.0761
| −1.9995 || −2.1248
| −3.1065 || −2.6061
|}

''FumenLab and HiTaiko’s within-song Musical Representation scores round to the same value. HiTaiko has the slightly higher unrounded score.''

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}

=== Something Fun ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −4.1362 || −4.6148
| −3.0094 || −2.8557
| −2.8967 || −3.2500
| −3.5170 || −3.8992
| −3.9851 || −3.5107
|-
| FumenLab
| 1.7808 || 0.8973
| 2.0497 || 1.3931
| '''2.0645''' || '''1.7150'''
| '''2.3657''' || 1.5878
| '''2.1521''' || 1.6169
|-
| HiTaiko
| −1.0707 || −1.7031
| −1.3013 || −0.9950
| −0.3393 || −1.1085
| −1.1090 || −1.4505
| 0.6620 || 0.4912
|-
| MALer
| '''3.4261''' || '''2.4004'''
| '''2.2610''' || '''2.7960'''
| 1.1716 || 0.9334
| 2.2602 || '''2.0269'''
| 1.1710 || '''2.1783'''
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −0.5579 || 0.7297
| 0.7683 || 1.3234
| −0.7678 || 0.5162
| −0.2182 || 0.8831
| −0.5907 || 0.3679
|-
| FumenLab
| '''3.3983''' || '''4.5471'''
| '''4.2866''' || '''5.5175'''
| '''4.4877''' || '''5.3224'''
| '''4.4930''' || '''5.9265'''
| '''3.5659''' || '''4.1415'''
|-
| HiTaiko
| 1.6737 || 2.6624
| −2.5275 || −2.2587
| −0.1399 || 1.1821
| −0.4174 || 0.6315
| 1.0151 || 1.8349
|-
| MALer
| −4.5141 || −3.0877
| −2.5275 || −2.2587
| −3.5800 || −1.6254
| −3.8573 || −2.6216
| −3.9903 || −3.1775
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

== Community Evaluation Results ==

X osu!taiko players evaluated submissions on one test song: '''Himitsu feat. KAFU'''. Players assessed submissions from all 4 models, plus one beatmap created by a human mapper, on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. They were not informed that any of the beatmaps were human-made. Every participant selected their preferred difficulty level and evaluated only the beatmaps of that difficulty.

=== Kantan - n=2 participants ===
{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Overall Quality Score
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
|
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|
|}

=== Futsuu - n=2 participants ===

=== Muzukashii - n=2 participants ===

=== Inner Oni - n=2 participants ===

2026:Rhythm Game Chart Generation Results

2026-10-14T16:43:39Z

Ziyunliu: /* Himitsu feat. KAFU */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/DOSU.pdf PDF]
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/FumenLab.pdf PDF]
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/HiTaiko.pdf PDF]
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/MALer.pdf PDF]
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| YUBIKIRI-GENMAN
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10.

We adopt the judge-score normalization approach used by the [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and report both '''within-song normalization''' and '''across-song normalization''' scores. For each category, a judge’s normalized score is calculated as '''(raw rating − judge’s mean rating) / judge’s population standard deviation'''. Within-song normalization uses the four submissions evaluated by that judge for the same song; across-song normalization uses all 12 submissions assigned to that judge across three songs. A submission’s category score is the '''sum of its three judges’ normalized scores'''. '''Combined Quality''' is calculated by first summing each judge’s raw ratings for Musical Representation, Creativity, and Gameplay, then normalizing these totals using the same procedure and summing the three judges’ normalized scores. '''Human-Likeness is evaluated separately and excluded from Combined Quality'''.

=== Silver Bullet ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| '''1.5872''' || 1.9303
| −2.6304 || −0.6119
| '''2.0099''' || '''1.2101'''
| −0.9236 || 0.8593
| −0.4552 || −0.4745
|-
| FumenLab
| 0.3005 || 1.8878
| 0.9401 || 1.1426
| −3.5863 || −2.9908
| −1.5011 || −0.0563
| −1.9478 || −1.6081
|-
| HiTaiko
| 1.2778 || '''2.6483'''
| '''1.8629''' || '''2.8452'''
| '''2.0099''' || '''1.2101'''
| '''3.6945''' || '''2.5621'''
| '''4.1634''' || '''3.0147'''
|-
| MALer
| −3.1656 || −0.6386
| −0.1726 || 0.6706
| −0.4335 || −1.0840
| −1.2698 || −0.3204
| −1.7604 || −1.4425
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −4.7037 || −5.3766
| −3.6090 || −4.6191
| 0.4677 || −0.1418
| −4.0148 || −4.1326
| −1.5881 || −2.3767
|-
| FumenLab
| 0.2720 || −1.1810
| −0.2284 || −1.7695
| −2.4438 || −2.4506
| −0.7583 || −2.0492
| −0.1690 || −0.8568
|-
| HiTaiko
| 2.0747 || 0.3217
| 0.9776 || −0.6639
| '''2.2563''' || '''1.3928'''
| 2.0694 || 0.1551
| '''2.3546''' || '''1.7015'''
|-
| MALer
| '''2.3570''' || '''0.9179'''
| '''2.8598''' || '''1.3301'''
| −0.2803 || −0.2017
| '''2.7037''' || '''0.7954'''
| −0.5975 || −1.2836
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −1.6143 || −1.9648
| '''0.6706''' || −0.1198
| −1.2916 || −1.3750
| −1.0346 || −0.8634
| −1.5202 || −1.6127
|-
| FumenLab
| 1.3093 || '''1.3220'''
| 0.3325 || '''1.5965'''
| '''2.5865''' || '''2.5448'''
| '''1.6890''' || '''2.3056'''
| 0.6172 || 0.7949
|-
| HiTaiko
| '''1.3093''' || −0.1391
| −0.2970 || −1.0083
| 1.8815 || 1.2769
| 1.3451 || −0.2158
| '''4.0095''' || '''2.8074'''
|-
| MALer
| −1.0043 || −1.5591
| −0.7060 || −1.4543
| −3.1764 || −3.0761
| −1.9995 || −2.1248
| −3.1065 || −2.6061
|}

''FumenLab and HiTaiko’s within-song Musical Representation scores round to the same value. HiTaiko has the slightly higher unrounded score.''

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}

=== Something Fun ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −4.1362 || −4.6148
| −3.0094 || −2.8557
| −2.8967 || −3.2500
| −3.5170 || −3.8992
| −3.9851 || −3.5107
|-
| FumenLab
| 1.7808 || 0.8973
| 2.0497 || 1.3931
| '''2.0645''' || '''1.7150'''
| '''2.3657''' || 1.5878
| '''2.1521''' || 1.6169
|-
| HiTaiko
| −1.0707 || −1.7031
| −1.3013 || −0.9950
| −0.3393 || −1.1085
| −1.1090 || −1.4505
| 0.6620 || 0.4912
|-
| MALer
| '''3.4261''' || '''2.4004'''
| '''2.2610''' || '''2.7960'''
| 1.1716 || 0.9334
| 2.2602 || '''2.0269'''
| 1.1710 || '''2.1783'''
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −0.5579 || 0.7297
| 0.7683 || 1.3234
| −0.7678 || 0.5162
| −0.2182 || 0.8831
| −0.5907 || 0.3679
|-
| FumenLab
| '''3.3983''' || '''4.5471'''
| '''4.2866''' || '''5.5175'''
| '''4.4877''' || '''5.3224'''
| '''4.4930''' || '''5.9265'''
| '''3.5659''' || '''4.1415'''
|-
| HiTaiko
| 1.6737 || 2.6624
| −2.5275 || −2.2587
| −0.1399 || 1.1821
| −0.4174 || 0.6315
| 1.0151 || 1.8349
|-
| MALer
| −4.5141 || −3.0877
| −2.5275 || −2.2587
| −3.5800 || −1.6254
| −3.8573 || −2.6216
| −3.9903 || −3.1775
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

== Community Evaluation Results ==

X osu!taiko players evaluated submissions on one test song: '''Himitsu feat. KAFU'''. Players assessed submissions from all 4 models, plus one beatmap created by a human mapper, on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. They were not informed that any of the beatmaps were human-made. Every participant selected their preferred difficulty level and evaluated only the beatmaps of that difficulty.

=== Kantan - n=2 participants ===
{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Overall Quality Score
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
|
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-14T16:42:26Z

Ziyunliu: /* Community Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/DOSU.pdf PDF]
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/FumenLab.pdf PDF]
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/HiTaiko.pdf PDF]
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/MALer.pdf PDF]
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| YUBIKIRI-GENMAN
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10.

We adopt the judge-score normalization approach used by the [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and report both '''within-song normalization''' and '''across-song normalization''' scores. For each category, a judge’s normalized score is calculated as '''(raw rating − judge’s mean rating) / judge’s population standard deviation'''. Within-song normalization uses the four submissions evaluated by that judge for the same song; across-song normalization uses all 12 submissions assigned to that judge across three songs. A submission’s category score is the '''sum of its three judges’ normalized scores'''. '''Combined Quality''' is calculated by first summing each judge’s raw ratings for Musical Representation, Creativity, and Gameplay, then normalizing these totals using the same procedure and summing the three judges’ normalized scores. '''Human-Likeness is evaluated separately and excluded from Combined Quality'''.

=== Silver Bullet ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| '''1.5872''' || 1.9303
| −2.6304 || −0.6119
| '''2.0099''' || '''1.2101'''
| −0.9236 || 0.8593
| −0.4552 || −0.4745
|-
| FumenLab
| 0.3005 || 1.8878
| 0.9401 || 1.1426
| −3.5863 || −2.9908
| −1.5011 || −0.0563
| −1.9478 || −1.6081
|-
| HiTaiko
| 1.2778 || '''2.6483'''
| '''1.8629''' || '''2.8452'''
| '''2.0099''' || '''1.2101'''
| '''3.6945''' || '''2.5621'''
| '''4.1634''' || '''3.0147'''
|-
| MALer
| −3.1656 || −0.6386
| −0.1726 || 0.6706
| −0.4335 || −1.0840
| −1.2698 || −0.3204
| −1.7604 || −1.4425
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −4.7037 || −5.3766
| −3.6090 || −4.6191
| 0.4677 || −0.1418
| −4.0148 || −4.1326
| −1.5881 || −2.3767
|-
| FumenLab
| 0.2720 || −1.1810
| −0.2284 || −1.7695
| −2.4438 || −2.4506
| −0.7583 || −2.0492
| −0.1690 || −0.8568
|-
| HiTaiko
| 2.0747 || 0.3217
| 0.9776 || −0.6639
| '''2.2563''' || '''1.3928'''
| 2.0694 || 0.1551
| '''2.3546''' || '''1.7015'''
|-
| MALer
| '''2.3570''' || '''0.9179'''
| '''2.8598''' || '''1.3301'''
| −0.2803 || −0.2017
| '''2.7037''' || '''0.7954'''
| −0.5975 || −1.2836
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −1.6143 || −1.9648
| '''0.6706''' || −0.1198
| −1.2916 || −1.3750
| −1.0346 || −0.8634
| −1.5202 || −1.6127
|-
| FumenLab
| 1.3093 || '''1.3220'''
| 0.3325 || '''1.5965'''
| '''2.5865''' || '''2.5448'''
| '''1.6890''' || '''2.3056'''
| 0.6172 || 0.7949
|-
| HiTaiko
| '''1.3093''' || −0.1391
| −0.2970 || −1.0083
| 1.8815 || 1.2769
| 1.3451 || −0.2158
| '''4.0095''' || '''2.8074'''
|-
| MALer
| −1.0043 || −1.5591
| −0.7060 || −1.4543
| −3.1764 || −3.0761
| −1.9995 || −2.1248
| −3.1065 || −2.6061
|}

''FumenLab and HiTaiko’s within-song Musical Representation scores round to the same value. HiTaiko has the slightly higher unrounded score.''

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}

=== Something Fun ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −4.1362 || −4.6148
| −3.0094 || −2.8557
| −2.8967 || −3.2500
| −3.5170 || −3.8992
| −3.9851 || −3.5107
|-
| FumenLab
| 1.7808 || 0.8973
| 2.0497 || 1.3931
| '''2.0645''' || '''1.7150'''
| '''2.3657''' || 1.5878
| '''2.1521''' || 1.6169
|-
| HiTaiko
| −1.0707 || −1.7031
| −1.3013 || −0.9950
| −0.3393 || −1.1085
| −1.1090 || −1.4505
| 0.6620 || 0.4912
|-
| MALer
| '''3.4261''' || '''2.4004'''
| '''2.2610''' || '''2.7960'''
| 1.1716 || 0.9334
| 2.2602 || '''2.0269'''
| 1.1710 || '''2.1783'''
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −0.5579 || 0.7297
| 0.7683 || 1.3234
| −0.7678 || 0.5162
| −0.2182 || 0.8831
| −0.5907 || 0.3679
|-
| FumenLab
| '''3.3983''' || '''4.5471'''
| '''4.2866''' || '''5.5175'''
| '''4.4877''' || '''5.3224'''
| '''4.4930''' || '''5.9265'''
| '''3.5659''' || '''4.1415'''
|-
| HiTaiko
| 1.6737 || 2.6624
| −2.5275 || −2.2587
| −0.1399 || 1.1821
| −0.4174 || 0.6315
| 1.0151 || 1.8349
|-
| MALer
| −4.5141 || −3.0877
| −2.5275 || −2.2587
| −3.5800 || −1.6254
| −3.8573 || −2.6216
| −3.9903 || −3.1775
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

== Community Evaluation Results ==

X osu!taiko players evaluated submissions on one test song: '''Himitsu feat. KAFU'''. Players assessed submissions from all 4 models, plus one beatmap created by a human mapper, on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. They were not informed that any of the beatmaps were human-made. Every participant selected their preferred difficulty level and evaluated only the beatmaps of that difficulty.

=== Himitsu feat. KAFU ===
{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Overall Quality Score
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
|
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-14T16:15:48Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/DOSU.pdf PDF]
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/FumenLab.pdf PDF]
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/HiTaiko.pdf PDF]
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/MALer.pdf PDF]
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| YUBIKIRI-GENMAN
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10.

We adopt the judge-score normalization approach used by the [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and report both '''within-song normalization''' and '''across-song normalization''' scores. For each category, a judge’s normalized score is calculated as '''(raw rating − judge’s mean rating) / judge’s population standard deviation'''. Within-song normalization uses the four submissions evaluated by that judge for the same song; across-song normalization uses all 12 submissions assigned to that judge across three songs. A submission’s category score is the '''sum of its three judges’ normalized scores'''. '''Combined Quality''' is calculated by first summing each judge’s raw ratings for Musical Representation, Creativity, and Gameplay, then normalizing these totals using the same procedure and summing the three judges’ normalized scores. '''Human-Likeness is evaluated separately and excluded from Combined Quality'''.

=== Silver Bullet ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| '''1.5872''' || 1.9303
| −2.6304 || −0.6119
| '''2.0099''' || '''1.2101'''
| −0.9236 || 0.8593
| −0.4552 || −0.4745
|-
| FumenLab
| 0.3005 || 1.8878
| 0.9401 || 1.1426
| −3.5863 || −2.9908
| −1.5011 || −0.0563
| −1.9478 || −1.6081
|-
| HiTaiko
| 1.2778 || '''2.6483'''
| '''1.8629''' || '''2.8452'''
| '''2.0099''' || '''1.2101'''
| '''3.6945''' || '''2.5621'''
| '''4.1634''' || '''3.0147'''
|-
| MALer
| −3.1656 || −0.6386
| −0.1726 || 0.6706
| −0.4335 || −1.0840
| −1.2698 || −0.3204
| −1.7604 || −1.4425
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −4.7037 || −5.3766
| −3.6090 || −4.6191
| 0.4677 || −0.1418
| −4.0148 || −4.1326
| −1.5881 || −2.3767
|-
| FumenLab
| 0.2720 || −1.1810
| −0.2284 || −1.7695
| −2.4438 || −2.4506
| −0.7583 || −2.0492
| −0.1690 || −0.8568
|-
| HiTaiko
| 2.0747 || 0.3217
| 0.9776 || −0.6639
| '''2.2563''' || '''1.3928'''
| 2.0694 || 0.1551
| '''2.3546''' || '''1.7015'''
|-
| MALer
| '''2.3570''' || '''0.9179'''
| '''2.8598''' || '''1.3301'''
| −0.2803 || −0.2017
| '''2.7037''' || '''0.7954'''
| −0.5975 || −1.2836
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −1.6143 || −1.9648
| '''0.6706''' || −0.1198
| −1.2916 || −1.3750
| −1.0346 || −0.8634
| −1.5202 || −1.6127
|-
| FumenLab
| 1.3093 || '''1.3220'''
| 0.3325 || '''1.5965'''
| '''2.5865''' || '''2.5448'''
| '''1.6890''' || '''2.3056'''
| 0.6172 || 0.7949
|-
| HiTaiko
| '''1.3093''' || −0.1391
| −0.2970 || −1.0083
| 1.8815 || 1.2769
| 1.3451 || −0.2158
| '''4.0095''' || '''2.8074'''
|-
| MALer
| −1.0043 || −1.5591
| −0.7060 || −1.4543
| −3.1764 || −3.0761
| −1.9995 || −2.1248
| −3.1065 || −2.6061
|}

''FumenLab and HiTaiko’s within-song Musical Representation scores round to the same value. HiTaiko has the slightly higher unrounded score.''

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}

=== Something Fun ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −4.1362 || −4.6148
| −3.0094 || −2.8557
| −2.8967 || −3.2500
| −3.5170 || −3.8992
| −3.9851 || −3.5107
|-
| FumenLab
| 1.7808 || 0.8973
| 2.0497 || 1.3931
| '''2.0645''' || '''1.7150'''
| '''2.3657''' || 1.5878
| '''2.1521''' || 1.6169
|-
| HiTaiko
| −1.0707 || −1.7031
| −1.3013 || −0.9950
| −0.3393 || −1.1085
| −1.1090 || −1.4505
| 0.6620 || 0.4912
|-
| MALer
| '''3.4261''' || '''2.4004'''
| '''2.2610''' || '''2.7960'''
| 1.1716 || 0.9334
| 2.2602 || '''2.0269'''
| 1.1710 || '''2.1783'''
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| −0.5579 || 0.7297
| 0.7683 || 1.3234
| −0.7678 || 0.5162
| −0.2182 || 0.8831
| −0.5907 || 0.3679
|-
| FumenLab
| '''3.3983''' || '''4.5471'''
| '''4.2866''' || '''5.5175'''
| '''4.4877''' || '''5.3224'''
| '''4.4930''' || '''5.9265'''
| '''3.5659''' || '''4.1415'''
|-
| HiTaiko
| 1.6737 || 2.6624
| −2.5275 || −2.2587
| −0.1399 || 1.1821
| −0.4174 || 0.6315
| 1.0151 || 1.8349
|-
| MALer
| −4.5141 || −3.0877
| −2.5275 || −2.2587
| −3.5800 || −1.6254
| −3.8573 || −2.6216
| −3.9903 || −3.1775
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

== Community Evaluation Results ==

X osu!taiko players evaluated submissions on one test song: Himitsu feat. KAFU. Players assessed submissions from all 4 models, plus one beatmap created by a human mapper, on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. They were not informed that any of the beatmaps were human-made. Every participant selected their preferred difficulty level and evaluated only the beatmaps of that difficulty.

=== Himitsu feat. KAFU ===
{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Overall Quality Score
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
|
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-14T16:13:35Z

Ziyunliu: /* Silver Bullet */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/DOSU.pdf PDF]
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/FumenLab.pdf PDF]
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/HiTaiko.pdf PDF]
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/MALer.pdf PDF]
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| YUBIKIRI-GENMAN
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10.

We adopt the judge-score normalization approach used by the [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and report both '''within-song normalization''' and '''across-song normalization''' scores. For each category, a judge’s normalized score is calculated as '''(raw rating − judge’s mean rating) / judge’s population standard deviation'''. Within-song normalization uses the four submissions evaluated by that judge for the same song; across-song normalization uses all 12 submissions assigned to that judge across three songs. A submission’s category score is the '''sum of its three judges’ normalized scores'''. '''Combined Quality''' is calculated by first summing each judge’s raw ratings for Musical Representation, Creativity, and Gameplay, then normalizing these totals using the same procedure and summing the three judges’ normalized scores. '''Human-Likeness is evaluated separately and excluded from Combined Quality'''.

=== Silver Bullet ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| '''1.5872''' || 1.9303
| −2.6304 || −0.6119
| '''2.0099''' || '''1.2101'''
| −0.9236 || 0.8593
| −0.4552 || −0.4745
|-
| FumenLab
| 0.3005 || 1.8878
| 0.9401 || 1.1426
| −3.5863 || −2.9908
| −1.5011 || −0.0563
| −1.9478 || −1.6081
|-
| HiTaiko
| 1.2778 || '''2.6483'''
| '''1.8629''' || '''2.8452'''
| '''2.0099''' || '''1.2101'''
| '''3.6945''' || '''2.5621'''
| '''4.1634''' || '''3.0147'''
|-
| MALer
| −3.1656 || −0.6386
| −0.1726 || 0.6706
| −0.4335 || −1.0840
| −1.2698 || −0.3204
| −1.7604 || −1.4425
|}

{| class="wikitable"
! Model
! Qualitative Feedback
|-
| DOSU
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== Silver Bullet ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| '''1.5872'''
| −2.6304
| '''2.0099'''
| −0.4552
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| 0.3005
| 0.9401
| −3.5863
| −1.9478
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| 1.2778
| '''1.8629'''
| '''2.0099'''
| '''4.1634'''
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| −3.1656
| −0.1726
| −0.4335
| −1.7604
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.7037
| −3.6090
| 0.4677
| −1.5881
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| 0.2720
| −0.2284
| −2.4438
| −0.1690
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| 2.0747
| 0.9776
| '''2.2563'''
| '''2.3546'''
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| '''2.3570'''
| '''2.8598'''
| −0.2803
| −0.5975
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −1.6143
| '''0.6706'''
| −1.2916
| −1.5202
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| 1.3093
| 0.3325
| '''2.5865'''
| 0.6172
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| '''1.3093'''
| −0.2970
| 1.8815
| '''4.0095'''
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| −1.0043
| −0.7060
| −3.1764
| −3.1065
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}
''Musical Representation scores for FumenLab and HiTaiko round to the same value; HiTaiko has the higher unrounded score.''

=== Something Fun ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.1362
| −3.0094
| −2.8967
| −3.9851
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| 1.7808
| 2.0497
| '''2.0645'''
| '''2.1521'''
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| −1.0707
| −1.3013
| −0.3393
| 0.6620
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| '''3.4261'''
| '''2.2610'''
| 1.1716
| 1.1710
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −0.5579
| 0.7683
| −0.7678
| −0.5907
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| '''3.3983'''
| '''4.2866'''
| '''4.4877'''
| '''3.5659'''
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| 1.6737
| −2.5275
| −0.1399
| 1.0151
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| −4.5141
| −2.5275
| −3.5800
| −3.9903
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

Qualitative feedback suggested distinct tendencies across the evaluated models. HiTaiko often favored coherent but conservative arrangements, while MALer explored more unusual rhythms with less consistent musical fit. FumenLab demonstrated effective improvisation and higher-difficulty patterning, but struggled with simplification and technical consistency. DOSU showed isolated strengths in sound selection, alongside substantial variation in musical correspondence and structural coherence. Across models, adapting musical ideas to lower difficulties remained a recurring challenge.

== Community Evaluation Results ==

X osu!taiko players evaluated submissions on one test song: Himitsu feat. KAFU. Players assessed submissions from all 4 models, plus one beatmap created by a human mapper, on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. They were not informed that any of the beatmaps were human-made. Every participant selected their preferred difficulty level and evaluated only the beatmaps of that difficulty.

=== Himitsu feat. KAFU ===
{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Overall Quality Score
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
|
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-14T16:12:07Z

Ziyunliu: /* Silver Bullet */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/DOSU.pdf PDF]
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/FumenLab.pdf PDF]
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/HiTaiko.pdf PDF]
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/MALer.pdf PDF]
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| YUBIKIRI-GENMAN
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10.

We adopt the judge-score normalization approach used by the [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and report both '''within-song normalization''' and '''across-song normalization''' scores. For each category, a judge’s normalized score is calculated as '''(raw rating − judge’s mean rating) / judge’s population standard deviation'''. Within-song normalization uses the four submissions evaluated by that judge for the same song; across-song normalization uses all 12 submissions assigned to that judge across three songs. A submission’s category score is the '''sum of its three judges’ normalized scores'''. '''Combined Quality''' is calculated by first summing each judge’s raw ratings for Musical Representation, Creativity, and Gameplay, then normalizing these totals using the same procedure and summing the three judges’ normalized scores. '''Human-Likeness is evaluated separately and excluded from Combined Quality'''.

=== Silver Bullet ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| '''1.5872''' || 1.9303
| −2.6304 || −0.6119
| '''2.0099''' || '''1.2101'''
| −0.9236 || 0.8593
| −0.4552 || −0.4745
|-
| FumenLab
| 0.3005 || 1.8878
| 0.9401 || 1.1426
| −3.5863 || −2.9908
| −1.5011 || −0.0563
| −1.9478 || −1.6081
|-
| HiTaiko
| 1.2778 || '''2.6483'''
| '''1.8629''' || '''2.8452'''
| '''2.0099''' || '''1.2101'''
| '''3.6945''' || '''2.5621'''
| '''4.1634''' || '''3.0147'''
|-
| MALer
| −3.1656 || −0.6386
| −0.1726 || 0.6706
| −0.4335 || −1.0840
| −1.2698 || −0.3204
| −1.7604 || −1.4425
|}

{| class="wikitable"
! Model
! Qualitative feedback
|-
| DOSU
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== Silver Bullet ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| '''1.5872'''
| −2.6304
| '''2.0099'''
| −0.4552
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| 0.3005
| 0.9401
| −3.5863
| −1.9478
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| 1.2778
| '''1.8629'''
| '''2.0099'''
| '''4.1634'''
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| −3.1656
| −0.1726
| −0.4335
| −1.7604
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.7037
| −3.6090
| 0.4677
| −1.5881
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| 0.2720
| −0.2284
| −2.4438
| −0.1690
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| 2.0747
| 0.9776
| '''2.2563'''
| '''2.3546'''
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| '''2.3570'''
| '''2.8598'''
| −0.2803
| −0.5975
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −1.6143
| '''0.6706'''
| −1.2916
| −1.5202
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| 1.3093
| 0.3325
| '''2.5865'''
| 0.6172
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| '''1.3093'''
| −0.2970
| 1.8815
| '''4.0095'''
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| −1.0043
| −0.7060
| −3.1764
| −3.1065
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}
''Musical Representation scores for FumenLab and HiTaiko round to the same value; HiTaiko has the higher unrounded score.''

=== Something Fun ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.1362
| −3.0094
| −2.8967
| −3.9851
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| 1.7808
| 2.0497
| '''2.0645'''
| '''2.1521'''
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| −1.0707
| −1.3013
| −0.3393
| 0.6620
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| '''3.4261'''
| '''2.2610'''
| 1.1716
| 1.1710
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −0.5579
| 0.7683
| −0.7678
| −0.5907
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| '''3.3983'''
| '''4.2866'''
| '''4.4877'''
| '''3.5659'''
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| 1.6737
| −2.5275
| −0.1399
| 1.0151
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| −4.5141
| −2.5275
| −3.5800
| −3.9903
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

Qualitative feedback suggested distinct tendencies across the evaluated models. HiTaiko often favored coherent but conservative arrangements, while MALer explored more unusual rhythms with less consistent musical fit. FumenLab demonstrated effective improvisation and higher-difficulty patterning, but struggled with simplification and technical consistency. DOSU showed isolated strengths in sound selection, alongside substantial variation in musical correspondence and structural coherence. Across models, adapting musical ideas to lower difficulties remained a recurring challenge.

== Community Evaluation Results ==

X osu!taiko players evaluated submissions on one test song: Himitsu feat. KAFU. Players assessed submissions from all 4 models, plus one beatmap created by a human mapper, on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. They were not informed that any of the beatmaps were human-made. Every participant selected their preferred difficulty level and evaluated only the beatmaps of that difficulty.

=== Himitsu feat. KAFU ===
{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Overall Quality Score
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
|
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-14T16:11:35Z

Ziyunliu: /* Silver Bullet */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/DOSU.pdf PDF]
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/FumenLab.pdf PDF]
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/HiTaiko.pdf PDF]
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/MALer.pdf PDF]
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| YUBIKIRI-GENMAN
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10.

We adopt the judge-score normalization approach used by the [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and report both '''within-song normalization''' and '''across-song normalization''' scores. For each category, a judge’s normalized score is calculated as '''(raw rating − judge’s mean rating) / judge’s population standard deviation'''. Within-song normalization uses the four submissions evaluated by that judge for the same song; across-song normalization uses all 12 submissions assigned to that judge across three songs. A submission’s category score is the '''sum of its three judges’ normalized scores'''. '''Combined Quality''' is calculated by first summing each judge’s raw ratings for Musical Representation, Creativity, and Gameplay, then normalizing these totals using the same procedure and summing the three judges’ normalized scores. '''Human-Likeness is evaluated separately and excluded from Combined Quality'''.

=== Silver Bullet ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| '''1.5872''' || 1.9303
| −2.6304 || −0.6119
| '''2.0099''' || '''1.2101'''
| −0.9236 || 0.8593
| −0.4552 || −0.4745
|-
| FumenLab
| 0.3005 || 1.8878
| 0.9401 || 1.1426
| −3.5863 || −2.9908
| −1.5011 || −0.0563
| −1.9478 || −1.6081
|-
| HiTaiko
| 1.2778 || '''2.6483'''
| '''1.8629''' || '''2.8452'''
| '''2.0099''' || '''1.2101'''
| '''3.6945''' || '''2.5621'''
| '''4.1634''' || '''3.0147'''
|-
| MALer
| −3.1656 || −0.6386
| −0.1726 || 0.6706
| −0.4335 || −1.0840
| −1.2698 || −0.3204
| −1.7604 || −1.4425
|}

{| class="wikitable"
! Model
! Summary
|-
| DOSU
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== Silver Bullet ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| '''1.5872'''
| −2.6304
| '''2.0099'''
| −0.4552
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| 0.3005
| 0.9401
| −3.5863
| −1.9478
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| 1.2778
| '''1.8629'''
| '''2.0099'''
| '''4.1634'''
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| −3.1656
| −0.1726
| −0.4335
| −1.7604
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.7037
| −3.6090
| 0.4677
| −1.5881
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| 0.2720
| −0.2284
| −2.4438
| −0.1690
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| 2.0747
| 0.9776
| '''2.2563'''
| '''2.3546'''
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| '''2.3570'''
| '''2.8598'''
| −0.2803
| −0.5975
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −1.6143
| '''0.6706'''
| −1.2916
| −1.5202
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| 1.3093
| 0.3325
| '''2.5865'''
| 0.6172
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| '''1.3093'''
| −0.2970
| 1.8815
| '''4.0095'''
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| −1.0043
| −0.7060
| −3.1764
| −3.1065
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}
''Musical Representation scores for FumenLab and HiTaiko round to the same value; HiTaiko has the higher unrounded score.''

=== Something Fun ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.1362
| −3.0094
| −2.8967
| −3.9851
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| 1.7808
| 2.0497
| '''2.0645'''
| '''2.1521'''
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| −1.0707
| −1.3013
| −0.3393
| 0.6620
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| '''3.4261'''
| '''2.2610'''
| 1.1716
| 1.1710
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −0.5579
| 0.7683
| −0.7678
| −0.5907
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| '''3.3983'''
| '''4.2866'''
| '''4.4877'''
| '''3.5659'''
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| 1.6737
| −2.5275
| −0.1399
| 1.0151
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| −4.5141
| −2.5275
| −3.5800
| −3.9903
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

Qualitative feedback suggested distinct tendencies across the evaluated models. HiTaiko often favored coherent but conservative arrangements, while MALer explored more unusual rhythms with less consistent musical fit. FumenLab demonstrated effective improvisation and higher-difficulty patterning, but struggled with simplification and technical consistency. DOSU showed isolated strengths in sound selection, alongside substantial variation in musical correspondence and structural coherence. Across models, adapting musical ideas to lower difficulties remained a recurring challenge.

== Community Evaluation Results ==

X osu!taiko players evaluated submissions on one test song: Himitsu feat. KAFU. Players assessed submissions from all 4 models, plus one beatmap created by a human mapper, on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. They were not informed that any of the beatmaps were human-made. Every participant selected their preferred difficulty level and evaluated only the beatmaps of that difficulty.

=== Himitsu feat. KAFU ===
{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Overall Quality Score
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
|
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-14T16:10:58Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/DOSU.pdf PDF]
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/FumenLab.pdf PDF]
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/HiTaiko.pdf PDF]
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/MALer.pdf PDF]
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| YUBIKIRI-GENMAN
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10.

We adopt the judge-score normalization approach used by the [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and report both '''within-song normalization''' and '''across-song normalization''' scores. For each category, a judge’s normalized score is calculated as '''(raw rating − judge’s mean rating) / judge’s population standard deviation'''. Within-song normalization uses the four submissions evaluated by that judge for the same song; across-song normalization uses all 12 submissions assigned to that judge across three songs. A submission’s category score is the '''sum of its three judges’ normalized scores'''. '''Combined Quality''' is calculated by first summing each judge’s raw ratings for Musical Representation, Creativity, and Gameplay, then normalizing these totals using the same procedure and summing the three judges’ normalized scores. '''Human-Likeness is evaluated separately and excluded from Combined Quality'''.

=== Silver Bullet ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| '''1.5872''' || 1.9303
| −2.6304 || −0.6119
| '''2.0099''' || '''1.2101'''
| −0.9236 || 0.8593
| −0.4552 || −0.4745
|-
| FumenLab
| 0.3005 || 1.8878
| 0.9401 || 1.1426
| −3.5863 || −2.9908
| −1.5011 || −0.0563
| −1.9478 || −1.6081
|-
| HiTaiko
| 1.2778 || '''2.6483'''
| '''1.8629''' || '''2.8452'''
| '''2.0099''' || '''1.2101'''
| '''3.6945''' || '''2.5621'''
| '''4.1634''' || '''3.0147'''
|-
| MALer
| −3.1656 || −0.6386
| −0.1726 || 0.6706
| −0.4335 || −1.0840
| −1.2698 || −0.3204
| −1.7604 || −1.4425
|}

=== Silver Bullet ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| '''1.5872'''
| −2.6304
| '''2.0099'''
| −0.4552
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| 0.3005
| 0.9401
| −3.5863
| −1.9478
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| 1.2778
| '''1.8629'''
| '''2.0099'''
| '''4.1634'''
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| −3.1656
| −0.1726
| −0.4335
| −1.7604
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.7037
| −3.6090
| 0.4677
| −1.5881
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| 0.2720
| −0.2284
| −2.4438
| −0.1690
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| 2.0747
| 0.9776
| '''2.2563'''
| '''2.3546'''
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| '''2.3570'''
| '''2.8598'''
| −0.2803
| −0.5975
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −1.6143
| '''0.6706'''
| −1.2916
| −1.5202
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| 1.3093
| 0.3325
| '''2.5865'''
| 0.6172
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| '''1.3093'''
| −0.2970
| 1.8815
| '''4.0095'''
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| −1.0043
| −0.7060
| −3.1764
| −3.1065
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}
''Musical Representation scores for FumenLab and HiTaiko round to the same value; HiTaiko has the higher unrounded score.''

=== Something Fun ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.1362
| −3.0094
| −2.8967
| −3.9851
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| 1.7808
| 2.0497
| '''2.0645'''
| '''2.1521'''
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| −1.0707
| −1.3013
| −0.3393
| 0.6620
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| '''3.4261'''
| '''2.2610'''
| 1.1716
| 1.1710
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −0.5579
| 0.7683
| −0.7678
| −0.5907
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| '''3.3983'''
| '''4.2866'''
| '''4.4877'''
| '''3.5659'''
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| 1.6737
| −2.5275
| −0.1399
| 1.0151
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| −4.5141
| −2.5275
| −3.5800
| −3.9903
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

Qualitative feedback suggested distinct tendencies across the evaluated models. HiTaiko often favored coherent but conservative arrangements, while MALer explored more unusual rhythms with less consistent musical fit. FumenLab demonstrated effective improvisation and higher-difficulty patterning, but struggled with simplification and technical consistency. DOSU showed isolated strengths in sound selection, alongside substantial variation in musical correspondence and structural coherence. Across models, adapting musical ideas to lower difficulties remained a recurring challenge.

== Community Evaluation Results ==

X osu!taiko players evaluated submissions on one test song: Himitsu feat. KAFU. Players assessed submissions from all 4 models, plus one beatmap created by a human mapper, on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. They were not informed that any of the beatmaps were human-made. Every participant selected their preferred difficulty level and evaluated only the beatmaps of that difficulty.

=== Himitsu feat. KAFU ===
{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Overall Quality Score
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
|
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-14T16:10:49Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/DOSU.pdf PDF]
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/FumenLab.pdf PDF]
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/HiTaiko.pdf PDF]
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/MALer.pdf PDF]
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| YUBIKIRI-GENMAN
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10.

We adopt the judge-score normalization approach used by the [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and report both '''within-song normalization''' and '''across-song normalization''' scores. For each category, a judge’s normalized score is calculated as '''(raw rating − judge’s mean rating) / judge’s population standard deviation'''. Within-song normalization uses the four submissions evaluated by that judge for the same song; across-song normalization uses all 12 submissions assigned to that judge across three songs. A submission’s category score is the '''sum of its three judges’ normalized scores'''. '''Combined Quality''' is calculated by first summing each judge’s raw ratings for Musical Representation, Creativity, and Gameplay, then normalizing these totals using the same procedure and summing the three judges’ normalized scores. '''Human-Likeness is evaluated separately and excluded from Combined Quality'''.

=== Silver Bullet ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| '''1.5872''' || 1.9303
| −2.6304 || −0.6119
| '''2.0099''' || '''1.2101'''
| −0.9236 || 0.8593
| −0.4552 || −0.4745
|-
| FumenLab
| 0.3005 || 1.8878
| 0.9401 || 1.1426
| −3.5863 || −2.9908
| −1.5011 || −0.0563
| −1.9478 || −1.6081
|-
| HiTaiko
| 1.2778 || '''2.6483'''
| '''1.8629''' || '''2.8452'''
| '''2.0099''' || '''1.2101'''
| '''3.6945''' || '''2.5621'''
| '''4.1634''' || '''3.0147'''
|-
| MALer
| −3.1656 || −0.6386
| −0.1726 || 0.6706
| −0.4335 || −1.0840
| −1.2698 || −0.3204
| −1.7604 || −1.4425
|}

=== Silver Bullet ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| '''1.5872'''
| −2.6304
| '''2.0099'''
| −0.4552
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| 0.3005
| 0.9401
| −3.5863
| −1.9478
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| 1.2778
| '''1.8629'''
| '''2.0099'''
| '''4.1634'''
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| −3.1656
| −0.1726
| −0.4335
| −1.7604
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.7037
| −3.6090
| 0.4677
| −1.5881
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| 0.2720
| −0.2284
| −2.4438
| −0.1690
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| 2.0747
| 0.9776
| '''2.2563'''
| '''2.3546'''
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| '''2.3570'''
| '''2.8598'''
| −0.2803
| −0.5975
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −1.6143
| '''0.6706'''
| −1.2916
| −1.5202
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| 1.3093
| 0.3325
| '''2.5865'''
| 0.6172
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| '''1.3093'''
| −0.2970
| 1.8815
| '''4.0095'''
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| −1.0043
| −0.7060
| −3.1764
| −3.1065
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}
''Musical Representation scores for FumenLab and HiTaiko round to the same value; HiTaiko has the higher unrounded score.''

=== Something Fun ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.1362
| −3.0094
| −2.8967
| −3.9851
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| 1.7808
| 2.0497
| '''2.0645'''
| '''2.1521'''
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| −1.0707
| −1.3013
| −0.3393
| 0.6620
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| '''3.4261'''
| '''2.2610'''
| 1.1716
| 1.1710
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −0.5579
| 0.7683
| −0.7678
| −0.5907
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| '''3.3983'''
| '''4.2866'''
| '''4.4877'''
| '''3.5659'''
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| 1.6737
| −2.5275
| −0.1399
| 1.0151
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| −4.5141
| −2.5275
| −3.5800
| −3.9903
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

Qualitative feedback suggested distinct tendencies across the evaluated models. HiTaiko often favored coherent but conservative arrangements, while MALer explored more unusual rhythms with less consistent musical fit. FumenLab demonstrated effective improvisation and higher-difficulty patterning, but struggled with simplification and technical consistency. DOSU showed isolated strengths in sound selection, alongside substantial variation in musical correspondence and structural coherence. Across models, adapting musical ideas to lower difficulties remained a recurring challenge.

== Community Evaluation Results ==

X osu!taiko players evaluated submissions on one test song: Himitsu feat. KAFU. Players assessed submissions from all 4 models, plus one beatmap created by a human mapper, on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. They were not informed that any of the beatmaps were human-made. Every participant selected their preferred difficulty level and evaluated only the beatmaps of that difficulty.

=== Himitsu feat. KAFU ===
{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Overall Quality Score
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
|
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-14T16:05:49Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/DOSU.pdf PDF]
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/FumenLab.pdf PDF]
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/HiTaiko.pdf PDF]
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
| [http://futuremirex.com/portal/wp-content/uploads/2026/rhythm-game-chart-generation/MALer.pdf PDF]
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| YUBIKIRI-GENMAN
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu feat. KAFU
| OK
| OK
| OK
| OK
| OK
|-
| YUBIKIRI-GENMAN
| OK
| OK
| OK
| OK
| OK
|-
| Something Fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10.

We follow [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and adopt '''within-song normalization''' for per-song report. For each category, judge X's final score = (judge X's raw score - judge X's average raw score) / judge X's standard deviation within that song, and a submission's score is the sum of each judge's final score.

=== Silver Bullet ===

{| class="wikitable"
! rowspan="2" | Model
! colspan="2" | Musical Representation
! colspan="2" | Creativity
! colspan="2" | Gameplay
! colspan="2" | Combined Quality
! colspan="2" | Human-Likeness
|-
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
! Within-song
! Across-song
|-
| DOSU
| '''1.5872''' || 1.9303
| −2.6304 || −0.6119
| '''2.0099''' || '''1.2101'''
| −0.9236 || 0.8593
| −0.4552 || −0.4745
|-
| FumenLab
| 0.3005 || 1.8878
| 0.9401 || 1.1426
| −3.5863 || −2.9908
| −1.5011 || −0.0563
| −1.9478 || −1.6081
|-
| HiTaiko
| 1.2778 || '''2.6483'''
| '''1.8629''' || '''2.8452'''
| '''2.0099''' || '''1.2101'''
| '''3.6945''' || '''2.5621'''
| '''4.1634''' || '''3.0147'''
|-
| MALer
| −3.1656 || −0.6386
| −0.1726 || 0.6706
| −0.4335 || −1.0840
| −1.2698 || −0.3204
| −1.7604 || −1.4425
|}

''Scores sum three judges’ normalized scores. Within-song normalization uses each judge’s four submissions for this song; across-song normalization uses all 12 submissions assigned to that judge. Combined Quality normalizes the raw sum of Musical Representation, Creativity, and Gameplay, excluding Human-Likeness. Bold indicates the highest score in each subcolumn, including ties.''

=== Silver Bullet ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| '''1.5872'''
| −2.6304
| '''2.0099'''
| −0.4552
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| 0.3005
| 0.9401
| −3.5863
| −1.9478
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| 1.2778
| '''1.8629'''
| '''2.0099'''
| '''4.1634'''
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| −3.1656
| −0.1726
| −0.4335
| −1.7604
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.7037
| −3.6090
| 0.4677
| −1.5881
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| 0.2720
| −0.2284
| −2.4438
| −0.1690
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| 2.0747
| 0.9776
| '''2.2563'''
| '''2.3546'''
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| '''2.3570'''
| '''2.8598'''
| −0.2803
| −0.5975
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −1.6143
| '''0.6706'''
| −1.2916
| −1.5202
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| 1.3093
| 0.3325
| '''2.5865'''
| 0.6172
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| '''1.3093'''
| −0.2970
| 1.8815
| '''4.0095'''
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| −1.0043
| −0.7060
| −3.1764
| −3.1065
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}
''Musical Representation scores for FumenLab and HiTaiko round to the same value; HiTaiko has the higher unrounded score.''

=== Something Fun ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.1362
| −3.0094
| −2.8967
| −3.9851
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| 1.7808
| 2.0497
| '''2.0645'''
| '''2.1521'''
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| −1.0707
| −1.3013
| −0.3393
| 0.6620
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| '''3.4261'''
| '''2.2610'''
| 1.1716
| 1.1710
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −0.5579
| 0.7683
| −0.7678
| −0.5907
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| '''3.3983'''
| '''4.2866'''
| '''4.4877'''
| '''3.5659'''
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| 1.6737
| −2.5275
| −0.1399
| 1.0151
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| −4.5141
| −2.5275
| −3.5800
| −3.9903
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

Qualitative feedback suggested distinct tendencies across the evaluated models. HiTaiko often favored coherent but conservative arrangements, while MALer explored more unusual rhythms with less consistent musical fit. FumenLab demonstrated effective improvisation and higher-difficulty patterning, but struggled with simplification and technical consistency. DOSU showed isolated strengths in sound selection, alongside substantial variation in musical correspondence and structural coherence. Across models, adapting musical ideas to lower difficulties remained a recurring challenge.

== Community Evaluation Results ==

X osu!taiko players evaluated submissions on one test song: Himitsu feat. KAFU. Players assessed submissions from all 4 models, plus one beatmap created by a human mapper, on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. They were not informed that any of the beatmaps were human-made. Every participant selected their preferred difficulty level and evaluated only the beatmaps of that difficulty.

=== Himitsu feat. KAFU ===
{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Overall Quality Score
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
|
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T17:08:34Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10.

We follow [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and adopt '''within-song normalization''' for per-song report. For each category, judge X's final score = (judge X's raw score - judge X's average raw score) / judge X's standard deviation within that song, and a submission's score is the sum of each judge's final score.

=== Silver Bullet ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| '''1.5872'''
| −2.6304
| '''2.0099'''
| −0.4552
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| 0.3005
| 0.9401
| −3.5863
| −1.9478
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| 1.2778
| '''1.8629'''
| '''2.0099'''
| '''4.1634'''
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| −3.1656
| −0.1726
| −0.4335
| −1.7604
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.7037
| −3.6090
| 0.4677
| −1.5881
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| 0.2720
| −0.2284
| −2.4438
| −0.1690
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| 2.0747
| 0.9776
| '''2.2563'''
| '''2.3546'''
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| '''2.3570'''
| '''2.8598'''
| −0.2803
| −0.5975
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −1.6143
| '''0.6706'''
| −1.2916
| −1.5202
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| 1.3093
| 0.3325
| '''2.5865'''
| 0.6172
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| '''1.3093'''
| −0.2970
| 1.8815
| '''4.0095'''
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| −1.0043
| −0.7060
| −3.1764
| −3.1065
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}
''Musical Representation scores for FumenLab and HiTaiko round to the same value; HiTaiko has the higher unrounded score.''

=== Something Fun ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.1362
| −3.0094
| −2.8967
| −3.9851
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| 1.7808
| 2.0497
| '''2.0645'''
| '''2.1521'''
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| −1.0707
| −1.3013
| −0.3393
| 0.6620
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| '''3.4261'''
| '''2.2610'''
| 1.1716
| 1.1710
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −0.5579
| 0.7683
| −0.7678
| −0.5907
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| '''3.3983'''
| '''4.2866'''
| '''4.4877'''
| '''3.5659'''
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| 1.6737
| −2.5275
| −0.1399
| 1.0151
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| −4.5141
| −2.5275
| −3.5800
| −3.9903
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

Qualitative feedback suggested distinct tendencies across the evaluated models. HiTaiko often favored coherent but conservative arrangements, while MALer explored more unusual rhythms with less consistent musical fit. FumenLab demonstrated effective improvisation and higher-difficulty patterning, but struggled with simplification and technical consistency. DOSU showed isolated strengths in sound selection, alongside substantial variation in musical correspondence and structural coherence. Across models, adapting musical ideas to lower difficulties remained a recurring challenge.

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T17:03:56Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10.

We follow [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and adopt '''within-song normalization''' for per-song report. For each category, judge X's final score = (judge X's raw score - judge X's average raw score) / judge X's standard deviation within that song, and a submission's score is the sum of each judge's final score.

=== Silver Bullet ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| '''1.5872'''
| −2.6304
| '''2.0099'''
| −0.4552
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| 0.3005
| 0.9401
| −3.5863
| −1.9478
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| 1.2778
| '''1.8629'''
| '''2.0099'''
| '''4.1634'''
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| −3.1656
| −0.1726
| −0.4335
| −1.7604
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.7037
| −3.6090
| 0.4677
| −1.5881
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| 0.2720
| −0.2284
| −2.4438
| −0.1690
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| 2.0747
| 0.9776
| '''2.2563'''
| '''2.3546'''
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| '''2.3570'''
| '''2.8598'''
| −0.2803
| −0.5975
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −1.6143
| '''0.6706'''
| −1.2916
| −1.5202
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| 1.3093
| 0.3325
| '''2.5865'''
| 0.6172
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| '''1.3093'''
| −0.2970
| 1.8815
| '''4.0095'''
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| −1.0043
| −0.7060
| −3.1764
| −3.1065
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}
''Musical Representation scores for FumenLab and HiTaiko round to the same value; HiTaiko has the higher unrounded score.''

=== Something Fun ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.1362
| −3.0094
| −2.8967
| −3.9851
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| 1.7808
| 2.0497
| '''2.0645'''
| '''2.1521'''
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| −1.0707
| −1.3013
| −0.3393
| 0.6620
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| '''3.4261'''
| '''2.2610'''
| 1.1716
| 1.1710
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −0.5579
| 0.7683
| −0.7678
| −0.5907
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| '''3.3983'''
| '''4.2866'''
| '''4.4877'''
| '''3.5659'''
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| 1.6737
| −2.5275
| −0.1399
| 1.0151
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| −4.5141
| −2.5275
| −3.5800
| −3.9903
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T16:47:57Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10.

=== Per-song results ===

We follow [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and adopt '''within-song normalization''' for per-song report. For each category, judge X's final score = (judge X's raw score - judge X's average raw score) / judge X's standard deviation within that song, and a submission's score is the sum of each judge's final score.

==== Silver Bullet ====

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| '''1.5872'''
| −2.6304
| '''2.0099'''
| −0.4552
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| 0.3005
| 0.9401
| −3.5863
| −1.9478
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| 1.2778
| '''1.8629'''
| '''2.0099'''
| '''4.1634'''
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| −3.1656
| −0.1726
| −0.4335
| −1.7604
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

==== A fight in Tunisia ====

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.7037
| −3.6090
| 0.4677
| −1.5881
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| 0.2720
| −0.2284
| −2.4438
| −0.1690
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| 2.0747
| 0.9776
| '''2.2563'''
| '''2.3546'''
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| '''2.3570'''
| '''2.8598'''
| −0.2803
| −0.5975
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

==== YUBIKIRI-GENMAN ====

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −1.6143
| '''0.6706'''
| −1.2916
| −1.5202
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| 1.3093
| 0.3325
| '''2.5865'''
| 0.6172
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| '''1.3093'''
| −0.2970
| 1.8815
| '''4.0095'''
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| −1.0043
| −0.7060
| −3.1764
| −3.1065
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}
''Musical Representation scores for FumenLab and HiTaiko round to the same value; HiTaiko has the higher unrounded score.''

==== Something Fun ====

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.1362
| −3.0094
| −2.8967
| −3.9851
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| 1.7808
| 2.0497
| '''2.0645'''
| '''2.1521'''
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| −1.0707
| −1.3013
| −0.3393
| 0.6620
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| '''3.4261'''
| '''2.2610'''
| 1.1716
| 1.1710
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

==== closer to you ====

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −0.5579
| 0.7683
| −0.7678
| −0.5907
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| '''3.3983'''
| '''4.2866'''
| '''4.4877'''
| '''3.5659'''
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| 1.6737
| −2.5275
| −0.1399
| 1.0151
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| −4.5141
| −2.5275
| −3.5800
| −3.9903
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

=== Overall Results ===

The tables below summarize performance across all 5 songs using 2 normalization methods: '''within-song normalization''' and '''across-song normalization'''. Overall scores are the equally weighted mean of the 5 per-song scores. '''Combined Quality includes Musical Representation, Creativity, and Gameplay; Human-Likeness is evaluated separately.'''

==== Within-song Normalization ====

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Combined Quality
! Human-Likeness
|-
| DOSU
| −1.8850
| −1.5620
| −0.4957
| −1.9416
| −1.6278
|-
| FumenLab
| '''1.4122'''
| '''1.4761'''
| 0.6217
| '''1.2576'''
| 0.8437
|-
| HiTaiko
| 1.0530
| −0.2570
| '''1.1337'''
| 1.1165
| '''2.4409'''
|-
| MALer
| −0.5802
| 0.3429
| −1.2597
| −0.4325
| −1.6567
|}

==== Across-song Normalization ====

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Combined Quality
! Human-Likeness
|-
| DOSU
| −1.8592
| −1.3766
| −0.6081
| −1.4305
| −1.5213
|-
| FumenLab
| '''1.4946'''
| '''1.5760'''
| '''0.8282'''
| '''1.5429'''
| 0.8177
|-
| HiTaiko
| 0.7580
| −0.4161
| 0.7907
| 0.3365
| '''1.9699'''
|-
| MALer
| −0.3934
| 0.2167
| −1.0107
| −0.4489
| −1.2663
|}

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T16:43:32Z

Ziyunliu: /* Overall Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10.

We follow [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and adopt '''within-song normalization''' for per-song report. For each category, judge X's final score = (judge X's raw score - judge X's average raw score) / judge X's standard deviation within that song, and a submission's score is the sum of each judge's final score.

=== Silver Bullet ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| '''1.5872'''
| −2.6304
| '''2.0099'''
| −0.4552
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| 0.3005
| 0.9401
| −3.5863
| −1.9478
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| 1.2778
| '''1.8629'''
| '''2.0099'''
| '''4.1634'''
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| −3.1656
| −0.1726
| −0.4335
| −1.7604
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.7037
| −3.6090
| 0.4677
| −1.5881
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| 0.2720
| −0.2284
| −2.4438
| −0.1690
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| 2.0747
| 0.9776
| '''2.2563'''
| '''2.3546'''
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| '''2.3570'''
| '''2.8598'''
| −0.2803
| −0.5975
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −1.6143
| '''0.6706'''
| −1.2916
| −1.5202
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| 1.3093
| 0.3325
| '''2.5865'''
| 0.6172
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| '''1.3093'''
| −0.2970
| 1.8815
| '''4.0095'''
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| −1.0043
| −0.7060
| −3.1764
| −3.1065
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}
''Musical Representation scores for FumenLab and HiTaiko round to the same value; HiTaiko has the higher unrounded score.''

=== Something Fun ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.1362
| −3.0094
| −2.8967
| −3.9851
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| 1.7808
| 2.0497
| '''2.0645'''
| '''2.1521'''
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| −1.0707
| −1.3013
| −0.3393
| 0.6620
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| '''3.4261'''
| '''2.2610'''
| 1.1716
| 1.1710
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −0.5579
| 0.7683
| −0.7678
| −0.5907
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| '''3.3983'''
| '''4.2866'''
| '''4.4877'''
| '''3.5659'''
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| 1.6737
| −2.5275
| −0.1399
| 1.0151
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| −4.5141
| −2.5275
| −3.5800
| −3.9903
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

=== Overall Results ===

The tables below summarize performance across all 5 songs using 2 normalization methods: '''within-song normalization''' and '''across-song normalization'''. Overall scores are the equally weighted mean of the 5 per-song scores. '''Combined Quality includes Musical Representation, Creativity, and Gameplay; Human-Likeness is evaluated separately.'''

==== Within-song Normalization ====

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Combined Quality
! Human-Likeness
|-
| DOSU
| −1.8850
| −1.5620
| −0.4957
| −1.9416
| −1.6278
|-
| FumenLab
| '''1.4122'''
| '''1.4761'''
| 0.6217
| '''1.2576'''
| 0.8437
|-
| HiTaiko
| 1.0530
| −0.2570
| '''1.1337'''
| 1.1165
| '''2.4409'''
|-
| MALer
| −0.5802
| 0.3429
| −1.2597
| −0.4325
| −1.6567
|}

==== Across-song Normalization ====

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Combined Quality
! Human-Likeness
|-
| DOSU
| −1.8592
| −1.3766
| −0.6081
| −1.4305
| −1.5213
|-
| FumenLab
| '''1.4946'''
| '''1.5760'''
| '''0.8282'''
| '''1.5429'''
| 0.8177
|-
| HiTaiko
| 0.7580
| −0.4161
| 0.7907
| 0.3365
| '''1.9699'''
|-
| MALer
| −0.3934
| 0.2167
| −1.0107
| −0.4489
| −1.2663
|}

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T16:43:05Z

Ziyunliu: /* Overall Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10.

We follow [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and adopt '''within-song normalization''' for per-song report. For each category, judge X's final score = (judge X's raw score - judge X's average raw score) / judge X's standard deviation within that song, and a submission's score is the sum of each judge's final score.

=== Silver Bullet ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| '''1.5872'''
| −2.6304
| '''2.0099'''
| −0.4552
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| 0.3005
| 0.9401
| −3.5863
| −1.9478
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| 1.2778
| '''1.8629'''
| '''2.0099'''
| '''4.1634'''
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| −3.1656
| −0.1726
| −0.4335
| −1.7604
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.7037
| −3.6090
| 0.4677
| −1.5881
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| 0.2720
| −0.2284
| −2.4438
| −0.1690
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| 2.0747
| 0.9776
| '''2.2563'''
| '''2.3546'''
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| '''2.3570'''
| '''2.8598'''
| −0.2803
| −0.5975
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −1.6143
| '''0.6706'''
| −1.2916
| −1.5202
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| 1.3093
| 0.3325
| '''2.5865'''
| 0.6172
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| '''1.3093'''
| −0.2970
| 1.8815
| '''4.0095'''
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| −1.0043
| −0.7060
| −3.1764
| −3.1065
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}
''Musical Representation scores for FumenLab and HiTaiko round to the same value; HiTaiko has the higher unrounded score.''

=== Something Fun ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.1362
| −3.0094
| −2.8967
| −3.9851
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| 1.7808
| 2.0497
| '''2.0645'''
| '''2.1521'''
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| −1.0707
| −1.3013
| −0.3393
| 0.6620
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| '''3.4261'''
| '''2.2610'''
| 1.1716
| 1.1710
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −0.5579
| 0.7683
| −0.7678
| −0.5907
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| '''3.3983'''
| '''4.2866'''
| '''4.4877'''
| '''3.5659'''
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| 1.6737
| −2.5275
| −0.1399
| 1.0151
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| −4.5141
| −2.5275
| −3.5800
| −3.9903
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

=== Overall Results ===

The tables below summarize performance across all 5 songs using 2 normalization methods: within-song normalization and across-song normalization. Overall scores are the equally weighted mean of the 5 per-song scores. '''Combined Quality includes Musical Representation, Creativity, and Gameplay; Human-Likeness is evaluated separately.'''

==== Within-song Normalization ====

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Combined Quality
! Human-Likeness
|-
| DOSU
| −1.8850
| −1.5620
| −0.4957
| −1.9416
| −1.6278
|-
| FumenLab
| '''1.4122'''
| '''1.4761'''
| 0.6217
| '''1.2576'''
| 0.8437
|-
| HiTaiko
| 1.0530
| −0.2570
| '''1.1337'''
| 1.1165
| '''2.4409'''
|-
| MALer
| −0.5802
| 0.3429
| −1.2597
| −0.4325
| −1.6567
|}

==== Across-song Normalization ====

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Combined Quality
! Human-Likeness
|-
| DOSU
| −1.8592
| −1.3766
| −0.6081
| −1.4305
| −1.5213
|-
| FumenLab
| '''1.4946'''
| '''1.5760'''
| '''0.8282'''
| '''1.5429'''
| 0.8177
|-
| HiTaiko
| 0.7580
| −0.4161
| 0.7907
| 0.3365
| '''1.9699'''
|-
| MALer
| −0.3934
| 0.2167
| −1.0107
| −0.4489
| −1.2663
|}

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T16:00:39Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10.

We follow [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and adopt '''within-song normalization''' for per-song report. For each category, judge X's final score = (judge X's raw score - judge X's average raw score) / judge X's standard deviation within that song, and a submission's score is the sum of each judge's final score.

=== Silver Bullet ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| '''1.5872'''
| −2.6304
| '''2.0099'''
| −0.4552
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| 0.3005
| 0.9401
| −3.5863
| −1.9478
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| 1.2778
| '''1.8629'''
| '''2.0099'''
| '''4.1634'''
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| −3.1656
| −0.1726
| −0.4335
| −1.7604
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.7037
| −3.6090
| 0.4677
| −1.5881
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| 0.2720
| −0.2284
| −2.4438
| −0.1690
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| 2.0747
| 0.9776
| '''2.2563'''
| '''2.3546'''
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| '''2.3570'''
| '''2.8598'''
| −0.2803
| −0.5975
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −1.6143
| '''0.6706'''
| −1.2916
| −1.5202
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| 1.3093
| 0.3325
| '''2.5865'''
| 0.6172
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| '''1.3093'''
| −0.2970
| 1.8815
| '''4.0095'''
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| −1.0043
| −0.7060
| −3.1764
| −3.1065
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}
''Musical Representation scores for FumenLab and HiTaiko round to the same value; HiTaiko has the higher unrounded score.''

=== Something Fun ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.1362
| −3.0094
| −2.8967
| −3.9851
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| 1.7808
| 2.0497
| '''2.0645'''
| '''2.1521'''
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| −1.0707
| −1.3013
| −0.3393
| 0.6620
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| '''3.4261'''
| '''2.2610'''
| 1.1716
| 1.1710
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −0.5579
| 0.7683
| −0.7678
| −0.5907
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| '''3.3983'''
| '''4.2866'''
| '''4.4877'''
| '''3.5659'''
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| 1.6737
| −2.5275
| −0.1399
| 1.0151
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| −4.5141
| −2.5275
| −3.5800
| −3.9903
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

=== Overall Results ===

The tables below summarize performance across all 5 songs using 2 normalization methods: within-song normalization and across-song normalization. Overall scores are the equally weighted mean of the 5 per-song scores. Combined Quality includes Musical Representation, Creativity, and Gameplay; Human-Likeness is evaluated separately.

==== Within-song Normalization ====

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Combined Quality
! Human-Likeness
|-
| DOSU
| −1.8850
| −1.5620
| −0.4957
| −1.9416
| −1.6278
|-
| FumenLab
| '''1.4122'''
| '''1.4761'''
| 0.6217
| '''1.2576'''
| 0.8437
|-
| HiTaiko
| 1.0530
| −0.2570
| '''1.1337'''
| 1.1165
| '''2.4409'''
|-
| MALer
| −0.5802
| 0.3429
| −1.2597
| −0.4325
| −1.6567
|}

==== Across-song Normalization ====

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Combined Quality
! Human-Likeness
|-
| DOSU
| −1.8592
| −1.3766
| −0.6081
| −1.4305
| −1.5213
|-
| FumenLab
| '''1.4946'''
| '''1.5760'''
| '''0.8282'''
| '''1.5429'''
| 0.8177
|-
| HiTaiko
| 0.7580
| −0.4161
| 0.7907
| 0.3365
| '''1.9699'''
|-
| MALer
| −0.3934
| 0.2167
| −1.0107
| −0.4489
| −1.2663
|}

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T15:59:39Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10.

We follow [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and adopt '''within-song normalization''' for per-song report. For each category, judge X's final score = (judge X's raw score - judge X's average raw score) / judge X's standard deviation within that song, and a submission's score is the sum of each judge's final score.

=== Silver Bullet ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| '''1.5872'''
| −2.6304
| '''2.0099'''
| −0.4552
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| 0.3005
| 0.9401
| −3.5863
| −1.9478
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| 1.2778
| '''1.8629'''
| '''2.0099'''
| '''4.1634'''
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| −3.1656
| −0.1726
| −0.4335
| −1.7604
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.7037
| −3.6090
| 0.4677
| −1.5881
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| 0.2720
| −0.2284
| −2.4438
| −0.1690
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| 2.0747
| 0.9776
| '''2.2563'''
| '''2.3546'''
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| '''2.3570'''
| '''2.8598'''
| −0.2803
| −0.5975
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −1.6143
| '''0.6706'''
| −1.2916
| −1.5202
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| 1.3093
| 0.3325
| '''2.5865'''
| 0.6172
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| '''1.3093'''
| −0.2970
| 1.8815
| '''4.0095'''
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| −1.0043
| −0.7060
| −3.1764
| −3.1065
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}
''Musical Representation scores for FumenLab and HiTaiko round to the same value; HiTaiko has the higher unrounded score.''

=== Something Fun ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.1362
| −3.0094
| −2.8967
| −3.9851
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| 1.7808
| 2.0497
| '''2.0645'''
| '''2.1521'''
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| −1.0707
| −1.3013
| −0.3393
| 0.6620
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| '''3.4261'''
| '''2.2610'''
| 1.1716
| 1.1710
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −0.5579
| 0.7683
| −0.7678
| −0.5907
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| '''3.3983'''
| '''4.2866'''
| '''4.4877'''
| '''3.5659'''
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| 1.6737
| −2.5275
| −0.1399
| 1.0151
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| −4.5141
| −2.5275
| −3.5800
| −3.9903
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

The tables below summarize performance across all 5 songs using 2 normalization methods: within-song normalization and across-song normalization. Overall scores are the equally weighted mean of the 5 per-song scores. Combined Quality includes Musical Representation, Creativity, and Gameplay; Human-Likeness is evaluated separately.

==== Within-song Normalization ====

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Combined Quality
! Human-Likeness
|-
| DOSU
| −1.8850
| −1.5620
| −0.4957
| −1.9416
| −1.6278
|-
| FumenLab
| '''1.4122'''
| '''1.4761'''
| 0.6217
| '''1.2576'''
| 0.8437
|-
| HiTaiko
| 1.0530
| −0.2570
| '''1.1337'''
| 1.1165
| '''2.4409'''
|-
| MALer
| −0.5802
| 0.3429
| −1.2597
| −0.4325
| −1.6567
|}

==== Across-song Normalization ====

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Combined Quality
! Human-Likeness
|-
| DOSU
| −1.8592
| −1.3766
| −0.6081
| −1.4305
| −1.5213
|-
| FumenLab
| '''1.4946'''
| '''1.5760'''
| '''0.8282'''
| '''1.5429'''
| 0.8177
|-
| HiTaiko
| 0.7580
| −0.4161
| 0.7907
| 0.3365
| '''1.9699'''
|-
| MALer
| −0.3934
| 0.2167
| −1.0107
| −0.4489
| −1.2663
|}

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T15:52:49Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10.

We follow [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and adopt '''within-song normalization''' for per-song report. For each category, judge X's final score = (judge X's raw score - judge X's average raw score) / judge X's standard deviation within that song, and a submission's score is the sum of each judge's final score.

=== Silver Bullet ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| '''1.5872'''
| −2.6304
| '''2.0099'''
| −0.4552
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| 0.3005
| 0.9401
| −3.5863
| −1.9478
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| 1.2778
| '''1.8629'''
| '''2.0099'''
| '''4.1634'''
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| −3.1656
| −0.1726
| −0.4335
| −1.7604
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.7037
| −3.6090
| 0.4677
| −1.5881
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| 0.2720
| −0.2284
| −2.4438
| −0.1690
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| 2.0747
| 0.9776
| '''2.2563'''
| '''2.3546'''
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| '''2.3570'''
| '''2.8598'''
| −0.2803
| −0.5975
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −1.6143
| '''0.6706'''
| −1.2916
| −1.5202
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| 1.3093
| 0.3325
| '''2.5865'''
| 0.6172
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| '''1.3093'''
| −0.2970
| 1.8815
| '''4.0095'''
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| −1.0043
| −0.7060
| −3.1764
| −3.1065
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}
''Musical Representation scores for FumenLab and HiTaiko round to the same value; HiTaiko has the higher unrounded score.''

=== Something Fun ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.1362
| −3.0094
| −2.8967
| −3.9851
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| 1.7808
| 2.0497
| '''2.0645'''
| '''2.1521'''
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| −1.0707
| −1.3013
| −0.3393
| 0.6620
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| '''3.4261'''
| '''2.2610'''
| 1.1716
| 1.1710
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −0.5579
| 0.7683
| −0.7678
| −0.5907
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| '''3.3983'''
| '''4.2866'''
| '''4.4877'''
| '''3.5659'''
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| 1.6737
| −2.5275
| −0.1399
| 1.0151
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| −4.5141
| −2.5275
| −3.5800
| −3.9903
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

The tables below summarize performance across all 5 songs using 2 normalization methods: within-song normalization and across-song normalization. Overall scores are the equally weighted mean of the 5 per-song scores. Combined Quality includes Musical Representation, Creativity, and Gameplay; Human-Likeness is evaluated separately.

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T14:56:05Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10.

We follow [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and adopt '''within-song normalization''' for per-song report. For each category, judge X's final score = (judge X's raw score - judge X's average raw score) / judge X's standard deviation within that song, and a submission's score is the sum of each judge's final score.

=== Silver Bullet ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| '''1.5872'''
| −2.6304
| '''2.0099'''
| −0.4552
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| 0.3005
| 0.9401
| −3.5863
| −1.9478
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| 1.2778
| '''1.8629'''
| '''2.0099'''
| '''4.1634'''
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| −3.1656
| −0.1726
| −0.4335
| −1.7604
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.7037
| −3.6090
| 0.4677
| −1.5881
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| 0.2720
| −0.2284
| −2.4438
| −0.1690
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| 2.0747
| 0.9776
| '''2.2563'''
| '''2.3546'''
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| '''2.3570'''
| '''2.8598'''
| −0.2803
| −0.5975
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −1.6143
| '''0.6706'''
| −1.2916
| −1.5202
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| 1.3093
| 0.3325
| '''2.5865'''
| 0.6172
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| '''1.3093'''
| −0.2970
| 1.8815
| '''4.0095'''
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| −1.0043
| −0.7060
| −3.1764
| −3.1065
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}
''Musical Representation scores for FumenLab and HiTaiko round to the same value; HiTaiko has the higher unrounded score.''

=== Something Fun ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.1362
| −3.0094
| −2.8967
| −3.9851
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| 1.7808
| 2.0497
| '''2.0645'''
| '''2.1521'''
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| −1.0707
| −1.3013
| −0.3393
| 0.6620
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| '''3.4261'''
| '''2.2610'''
| 1.1716
| 1.1710
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −0.5579
| 0.7683
| −0.7678
| −0.5907
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| '''3.3983'''
| '''4.2866'''
| '''4.4877'''
| '''3.5659'''
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| 1.6737
| −2.5275
| −0.1399
| 1.0151
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| −4.5141
| −2.5275
| −3.5800
| −3.9903
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T14:33:41Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. We follow [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and adopt '''within-song normalization''' for per-song report. For each category, judge X's final score = (judge X's raw score - judge X's average raw score) / judge X's standard deviation within that song, and a submission's score is the sum of each judge's final score.

=== Silver Bullet ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| '''1.5872'''
| −2.6304
| '''2.0099'''
| −0.4552
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| 0.3005
| 0.9401
| −3.5863
| −1.9478
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| 1.2778
| '''1.8629'''
| '''2.0099'''
| '''4.1634'''
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| −3.1656
| −0.1726
| −0.4335
| −1.7604
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.7037
| −3.6090
| 0.4677
| −1.5881
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| 0.2720
| −0.2284
| −2.4438
| −0.1690
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| 2.0747
| 0.9776
| '''2.2563'''
| '''2.3546'''
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| '''2.3570'''
| '''2.8598'''
| −0.2803
| −0.5975
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −1.6143
| '''0.6706'''
| −1.2916
| −1.5202
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| 1.3093
| 0.3325
| '''2.5865'''
| 0.6172
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| '''1.3093'''
| −0.2970
| 1.8815
| '''4.0095'''
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| −1.0043
| −0.7060
| −3.1764
| −3.1065
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}
''Musical Representation scores for FumenLab and HiTaiko round to the same value; HiTaiko has the higher unrounded score.''

=== Something Fun ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.1362
| −3.0094
| −2.8967
| −3.9851
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| 1.7808
| 2.0497
| '''2.0645'''
| '''2.1521'''
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| −1.0707
| −1.3013
| −0.3393
| 0.6620
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| '''3.4261'''
| '''2.2610'''
| 1.1716
| 1.1710
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −0.5579
| 0.7683
| −0.7678
| −0.5907
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| '''3.3983'''
| '''4.2866'''
| '''4.4877'''
| '''3.5659'''
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| 1.6737
| −2.5275
| −0.1399
| 1.0151
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| −4.5141
| −2.5275
| −3.5800
| −3.9903
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T14:30:41Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. We follow [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and adopt '''within-song normalization'''. For each category, judge X's final score = (judge X's raw score - judge X's average raw score) / judge X's standard deviation within that song, and a submission's score is the sum of each judge's final score.

=== Silver Bullet ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| '''1.5872'''
| −2.6304
| '''2.0099'''
| −0.4552
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| 0.3005
| 0.9401
| −3.5863
| −1.9478
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| 1.2778
| '''1.8629'''
| '''2.0099'''
| '''4.1634'''
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| −3.1656
| −0.1726
| −0.4335
| −1.7604
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

=== A fight in Tunisia ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.7037
| −3.6090
| 0.4677
| −1.5881
| The mapping frequently missed prominent musical events across all difficulties. Conservative patterns supported playability, but omitted piano passages and notes in musically empty sections weakened representation. Isolated Inner Oni patterns showed potential without fitting the song.
|-
| FumenLab
| 0.2720
| −0.2284
| −2.4438
| −0.1690
| Awkward bursts, excessive local density and neglected piano passages weakened musical clarity. Kantan–Muzukashii lacked coherent sound selection; Oni was sometimes too demanding for its tier. Inner Oni was relatively stronger but remained rhythmically awkward.
|-
| HiTaiko
| 2.0747
| 0.9776
| '''2.2563'''
| '''2.3546'''
| Oni stood out for coherent sound selection and structure. Inner Oni was more conservative and relied on abrupt doublets, while Kantan–Muzukashii often omitted material or mixed musical layers inconsistently. Piano representation and repeated special-object placement remained weaknesses.
|-
| MALer
| '''2.3570'''
| '''2.8598'''
| −0.2803
| −0.5975
| Expressive color patterns attracted praise, but overall assessments differed. Complex snapping and inconsistent musical-layer selection reduced readability, particularly in Kantan–Muzukashii. Inner Oni offered some musical representation, although its structure and rhythmic emphasis remained uneven.
|}

=== YUBIKIRI-GENMAN ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −1.6143
| '''0.6706'''
| −1.2916
| −1.5202
| Excessive rhythmic improvisation disrupted the song’s gentle character. Muzukashii, Oni and Inner Oni often emphasized verses over choruses, weakening emotional progression. Kantan’s simpler rhythms were more acceptable, but consistency, object placement and musical correspondence remained concerns.
|-
| FumenLab
| 1.3093
| 0.3325
| '''2.5865'''
| 0.6172
| Assessments of musical coherence differed. Muzukashii and Oni sometimes followed the vocals effectively, but repeated phrases received inconsistent treatment. Inner Oni’s complex climax disrupted the gentle atmosphere. Kantan was sparse, and hitsound volume and effect choices required refinement.
|-
| HiTaiko
| '''1.3093'''
| −0.2970
| 1.8815
| '''4.0095'''
| Oni and Inner Oni showed effective vocal following and a convincing build toward the final chorus, although some feedback found them too conservative. Muzukashii’s density allocation was inconsistent; Kantan and Futsuu offered little content. Special-object use and omissions remained concerns.
|-
| MALer
| −1.0043
| −0.7060
| −3.1764
| −3.1065
| Irregular snapping and abrupt density changes were poorly suited to the gentle vocal/piano arrangement. Muzukashii, Oni and Inner Oni contained isolated difficulty spikes, with Oni reportedly harder than Inner Oni. Some color patterns and brief rhythm choices worked but were not sustained.
|}
''Musical Representation scores for FumenLab and HiTaiko round to the same value; HiTaiko has the higher unrounded score.''

=== Something Fun ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −4.1362
| −3.0094
| −2.8967
| −3.9851
| Rhythmic choices and sound selection were poorly aligned with the music. Missing notes, excessive finishers and misplaced spinners weakened consistency. Both Muzukashii and Inner Oni contained passages whose musical intent was unclear.
|-
| FumenLab
| 1.7808
| 2.0497
| '''2.0645'''
| '''2.1521'''
| The set was broadly serviceable, but repetitive color patterns and inconsistent finishers limited expressiveness. Kantan and Futsuu were weak, while some Inner Oni streams added unnecessary complexity. Isolated passages also raised timing concerns.
|-
| HiTaiko
| −1.0707
| −1.3013
| −0.3393
| 0.6620
| Some patterns followed the melody effectively, but prolonged simple rhythms, questionable drumrolls and uneven sectional difficulty made the experience repetitive. Finisher placement lacked consistency; no particular difficulty tier emerged as a clear strength.
|-
| MALer
| '''3.4261'''
| '''2.2610'''
| 1.1716
| 1.1710
| Creative ideas produced sharply divided assessments. Futsuu omitted a conspicuous musical passage, while Inner Oni showed uneven density and timing problems. Kantan and Muzukashii had questionable rhythmic choices; Oni was comparatively more successful but appeared too easy for its label.
|}

=== closer to you ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| −0.5579
| 0.7683
| −0.7678
| −0.5907
| Rhythmic improvisation showed promise, and Futsuu conveyed a pleasing feel. However, inconsistent finishers and uneven density weakened progression: Oni omitted the opening, while Inner Oni used fewer streams than Muzukashii.
|-
| FumenLab
| '''3.3983'''
| '''4.2866'''
| '''4.4877'''
| '''3.5659'''
| Strong structure and effective rhythmic improvisation were recurring positives, with Inner Oni receiving particular praise. Color-pattern variety, consistency and timing-point use still needed refinement, but the set conveyed a comparatively convincing mapping approach.
|-
| HiTaiko
| 1.6737
| −2.5275
| −0.1399
| 1.0151
| Patterns were coherent but repetitive, with little distinction between difficulty tiers. Even Inner Oni remained sparse and closer to a much easier difficulty. Drumroll use and the ending finisher were questionable choices for the song’s calm character.
|-
| MALer
| −4.5141
| −2.5275
| −3.5800
| −3.9903
| Missing sections, timing errors and inconsistent musical logic undermined the spread. Muzukashii was reportedly the hardest tier, while easier difficulties contained unexplained breaks. Inner Oni’s awkward fast bursts did not resolve the overall lack of musical coverage.
|}

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T14:28:09Z

Ziyunliu: /* Silver Bullet */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. We follow [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and adopt '''within-song normalization'''. For each category, judge X's final score = (judge X's raw score - judge X's average raw score) / judge X's standard deviation within that song, and a submission's score is the sum of each judge's final score.

=== Silver Bullet ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Qualitative Feedback
|-
| DOSU
| '''1.5872'''
| −2.6304
| '''2.0099'''
| −0.4552
| Musical representation drew mixed assessments. Oni and Muzukashii showed effective sound selection, but Inner Oni was conservative early and uneven near the ending. Inconsistent special-object use and variable-BPM handling weakened coherence across difficulties.
|-
| FumenLab
| 0.3005
| 0.9401
| −3.5863
| −1.9478
| Oni and Inner Oni showed promising sound selection, but awkward bursts and near-overlapping notes compromised gameplay near the ending. Kantan was excessively sparse, while intermediate difficulties were comparatively plain. Repeated musical phrases received inconsistent treatment.
|-
| HiTaiko
| 1.2778
| '''1.8629'''
| '''2.0099'''
| '''4.1634'''
| Coherent musical representation and expressive color patterns were recurring strengths. Inner Oni made quieter passages disproportionately dense, while Oni was comparatively restrained. Futsuu and Muzukashii showed promising structure, although assessments of the lower-tier ending differed. Finisher placement remained inconsistent.
|-
| MALer
| −3.1656
| −0.1726
| −0.4335
| −1.7604
| Imaginative Oni patterns and distinctive sectioning were offset by rhythms that often felt disconnected from the music. Inner Oni contained timing and overlap problems; unusual subdivisions in Muzukashii and questionable sound selection in Futsuu weakened the difficulty spread.
|}

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T14:26:14Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. We follow [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and adopt '''within-song normalization'''. For each category, judge X's final score = (judge X's raw score - judge X's average raw score) / judge X's standard deviation within that song, and a submission's score is the sum of each judge's final score.

=== Silver Bullet ===

{| class="wikitable"
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
|-
| DOSU
| '''1.5872'''
| −2.6304
| '''2.0099'''
| −0.4552
|-
| FumenLab
| 0.3005
| 0.9401
| −3.5863
| −1.9478
|-
| HiTaiko
| 1.2778
| '''1.8629'''
| '''2.0099'''
| '''4.1634'''
|-
| MALer
| −3.1656
| −0.1726
| −0.4335
| −1.7604
|}

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T14:25:31Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. We follow [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and adopt '''within-song normalization'''. For each category, judge X's final score = (judge X's raw score - judge X's average raw score) / judge X's standard deviation within that song, and a submission's score is the sum of each judge's final score.

{| class="wikitable"
|+ Silver Bullet
! Model
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
|-
| DOSU
| '''1.5872'''
| −2.6304
| '''2.0099'''
| −0.4552
|-
| FumenLab
| 0.3005
| 0.9401
| −3.5863
| −1.9478
|-
| HiTaiko
| 1.2778
| '''1.8629'''
| '''2.0099'''
| '''4.1634'''
|-
| MALer
| −3.1656
| −0.1726
| −0.4335
| −1.7604
|}

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T14:24:28Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. We follow [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and adopt '''within-song normalization'''. For each category, judge X's final score = (judge X's raw score - judge X's average raw score) / judge X's standard deviation within that song, and a submission's score is the sum of each judge's final score.

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T14:13:44Z

Ziyunliu: /* Algorithmic Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

'''Difficulty ordering warnings:'''
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. We follow [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and adopt '''within-song normalization'''. For each category, judge X's final score = (judge X's raw score - judge X's average raw score) / judge X's standard deviation within that song.

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T14:12:38Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

Difficulty ordering warnings:
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: '''Silver Bullet''', '''A fight in Tunisia''', '''YUBIKIRI-GENMAN''', '''Something Fun''', and '''closer to you'''. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. We follow [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and adopt '''within-song normalization'''. For each category, judge X's final score = (judge X's raw score - judge X's average raw score) / judge X's standard deviation within that song.

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T14:10:48Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

Difficulty ordering warnings:
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: Silver Bullet, A fight in Tunisia, YUBIKIRI-GENMAN, Something Fun, and closer to you. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. We follow [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and adopt within-song normalization. For each category, judge X's final score = (judge X's raw score - judge X's average raw score) / judge X's standard deviation within that song.

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T14:10:33Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

Difficulty ordering warnings:
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: Silver Bullet, A fight in Tunisia, YUBIKIRI-GENMAN, Something Fun, and closer to you. Each judge was assigned 3 songs based on their familiarity and interest of the songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models on 4 categories (Musical Representation, Creativity, Gameplay, and Human-Likeness) using an integer scale from 1 to 10. We follow [https://osu.ppy.sh/wiki/en/Contests/Monthly_Beatmapping_Contest Monthly Beatmapping Contest] and adopt within-song normalization for each judge and song. For each category, judge X's final score = (judge X's raw score - judge X's average raw score) / judge X's standard deviation within that song.

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T13:36:33Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

Difficulty ordering warnings:
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: Silver Bullet, A fight in Tunisia, YUBIKIRI-GENMAN, Something Fun, and closer to you. Each judge was assigned 3 songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models.

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T13:32:05Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

Difficulty ordering warnings:
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: Silver Bullet, A fight in Tunisia, YUBIKIRI-GENMAN, Something Fun, and closer to you. Each judge was assigned 3 songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all 4 models.

Each submission was rated on 4 categories, scores can be integers from 1 to 10: Musical Representation, Creativity, Gameplay, and Human-Likeness. Category scores are reported separately as the mean of the three judges’ ratings.

For the combined quality score, each judge’s raw score is the sum of Musical Representation, Creativity, and Gameplay, with a maximum of 30. Human-Likeness is excluded from the combined score and reported separately.

To adjust for differences in judges’ scoring ranges, raw scores are normalized:

Judge’s normalized score = (raw score − judge’s mean raw score) / judge’s standard deviation

We report results under two normalization methods:

- Across-song normalization: The mean and standard deviation are calculated across all 12 submissions evaluated by each judge: 4 models across 3 assigned songs.
- Within-song normalization: The mean and standard deviation are calculated separately across the 4 submissions evaluated by each judge for a given song.

Both methods use population standard deviation. A submission’s combined quality score is the sum of its 3 judges’ normalized scores. A model’s overall quality score is the sum of its submission scores across all five songs. Higher scores indicate stronger performance relative to the relevant normalization pool.

For each model, we also report an overall score for each of the 4 categories: Musical Representation, Creativity, Gameplay, and Human-Likeness. Each overall category score is the mean of its 5 per-song category scores, giving every song equal weight. These scores remain on the original 1–10 scale and are reported separately from the normalized combined quality scores.

For each song and scoring method, the highest score is highlighted, including all ties. If a normalization pool has zero standard deviation, its normalized scores are reported as unavailable.

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T13:31:29Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

Difficulty ordering warnings:
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: Silver Bullet, A fight in Tunisia, YUBIKIRI-GENMAN, Something Fun, and closer to you. Each judge was assigned 3 songs, and each song was evaluated by 3 judges. For every assigned song, judges assessed submissions from all four models.

Each submission was rated on 4 categories, scores can be integers from 1 to 10: Musical Representation, Creativity, Gameplay, and Human-Likeness. Category scores are reported separately as the mean of the three judges’ ratings.

For the combined quality score, each judge’s raw score is the sum of Musical Representation, Creativity, and Gameplay, with a maximum of 30. Human-Likeness is excluded from the combined score and reported separately.

To adjust for differences in judges’ scoring ranges, raw scores are normalized:

Judge’s normalized score = (raw score − judge’s mean raw score) / judge’s standard deviation

We report results under two normalization methods:

- Across-song normalization: The mean and standard deviation are calculated across all 12 submissions evaluated by each judge: 4 models across 3 assigned songs.
- Within-song normalization: The mean and standard deviation are calculated separately across the 4 submissions evaluated by each judge for a given song.

Both methods use population standard deviation. A submission’s combined quality score is the sum of its 3 judges’ normalized scores. A model’s overall quality score is the sum of its submission scores across all five songs. Higher scores indicate stronger performance relative to the relevant normalization pool.

For each model, we also report an overall score for each of the 4 categories: Musical Representation, Creativity, Gameplay, and Human-Likeness. Each overall category score is the mean of its 5 per-song category scores, giving every song equal weight. These scores remain on the original 1–10 scale and are reported separately from the normalized combined quality scores.

For each song and scoring method, the highest score is highlighted, including all ties. If a normalization pool has zero standard deviation, its normalized scores are reported as unavailable.

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T13:22:10Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

Difficulty ordering warnings:
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: Silver Bullet, A fight in Tunisia, YUBIKIRI-GENMAN, Something Fun, and closer to you. Each judge was assigned three songs, and each song was evaluated by three judges. For every assigned song, judges assessed submissions from all four models.

Each submission was rated on four categories, each scored out of 10: **Musical Representation, Creativity, Gameplay, and Human-Likeness**. Category scores are reported separately as the mean of the three judges’ ratings.

For the combined quality score, each judge’s **raw score** is the sum of Musical Representation, Creativity, and Gameplay, with a maximum of 30. Human-Likeness is excluded from the combined score and reported separately.

To adjust for differences in judges’ scoring ranges, raw scores are normalized:

Judge’s normalized score = (raw score − judge’s mean raw score) / judge’s standard deviation

We report results under two normalization methods:

- **Across-song normalization:** The mean and standard deviation are calculated across all 12 submissions evaluated by each judge: four models across three assigned songs.
- **Within-song normalization:** The mean and standard deviation are calculated separately across the four submissions evaluated by each judge for a given song.

Both methods use population standard deviation. A submission’s combined quality score is the **sum of its three judges’ normalized scores**. A model’s overall quality score is the sum of its submission scores across all five songs. Higher scores indicate stronger performance relative to the relevant normalization pool.

Overall category scores are calculated by averaging the per-song category scores equally across the five songs. **Human-Likeness rankings use the original mean ratings out of 10**, independently of either normalization method.

For each song and scoring method, the highest score is highlighted, including all ties. If a normalization pool has zero standard deviation, its normalized scores are reported as unavailable.

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T13:21:40Z

Ziyunliu: /* Expert Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

Difficulty ordering warnings:
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

5 osu!taiko mappers evaluated submissions across 5 songs: Silver Bullet, A fight in Tunisia, YUBIKIRI-GENMAN, Something Fun, and closer to you. Each judge was assigned three songs, and each song was evaluated by three judges. For every assigned song, judges assessed submissions from all four models.

Each submission was rated on four categories, each scored out of 10: **Musical Representation, Creativity, Gameplay, and Human-Likeness**. Category scores are reported separately as the mean of the three judges’ ratings.

For the combined quality score, each judge’s **raw score** is the sum of Musical Representation, Creativity, and Gameplay, with a maximum of 30. Human-Likeness is excluded from the combined score and reported separately.

To adjust for differences in judges’ scoring ranges, raw scores are normalized:

**Judge’s normalized score = (raw score − judge’s mean raw score) / judge’s standard deviation**

We report results under two normalization methods:

- **Across-song normalization:** The mean and standard deviation are calculated across all 12 submissions evaluated by each judge: four models across three assigned songs.
- **Within-song normalization:** The mean and standard deviation are calculated separately across the four submissions evaluated by each judge for a given song.

Both methods use population standard deviation. A submission’s combined quality score is the **sum of its three judges’ normalized scores**. A model’s overall quality score is the sum of its submission scores across all five songs. Higher scores indicate stronger performance relative to the relevant normalization pool.

Overall category scores are calculated by averaging the per-song category scores equally across the five songs. **Human-Likeness rankings use the original mean ratings out of 10**, independently of either normalization method.

For each song and scoring method, the highest score is highlighted, including all ties. If a normalization pool has zero standard deviation, its normalized scores are reported as unavailable.

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T09:08:29Z

Ziyunliu: /* Community Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

Difficulty ordering warnings:
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T09:08:13Z

Ziyunliu: /* Community Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

Difficulty ordering warnings:
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

== Community Evaluation Results ==

{| class="wikitable"
|-
! Mapper
! Musical Representation
! Creativity
! Gameplay
! Human-Likeness
! Overall Mean
|-
| DOSU
|
|
|
|
|
|-
| FumenLab
|
|
|
|
|
|-
| MALer
|
|
|
|
|
|-
| HiTaiko
|
|
|
|
|
|-
| Amasugi (human mapper)
|
|
|
|
|
|}
Defaults

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

2026:Rhythm Game Chart Generation Results

2026-10-11T09:06:24Z

Ziyunliu: /* Default Settings */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

{| class="wikitable"
|-
! Parameter
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Overall Difficulty
| 3
| 4
| 5
| 5
| 6
|-
| HP Drain Rate
| 8
| 7
| 6
| 5
| 5
|}

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

Difficulty ordering warnings:
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

== Community Evaluation Results ==

2026:Rhythm Game Chart Generation Results

2026-10-11T08:49:48Z

Ziyunliu: /* Algorithmic Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.

Difficulty ordering warnings:
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

== Community Evaluation Results ==

2026:Rhythm Game Chart Generation Results

2026-10-11T08:48:35Z

Ziyunliu: /* Algorithmic Evaluation Results */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

= Results =

== Algorithmic Evaluation Results ==

120 beatmaps were checked using [https://osu.ppy.sh/wiki/en/Client/Beatmap_editor/AiMod AiMod] across 4 models, 6 songs, and 5 difficulties.
Difficulty ordering warnings:
* DOSU - closer to you - Inner Oni < Oni
* MALer - YUBIKIRI-GENMAN - Inner Oni < Oni
* MALer - closer to you - Kantan < Oni < Futsuu < Inner Oni < Muzukashii

=== DOSU ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== FumenLab ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Objects <10ms apart and concurrent objects
| Objects <10ms apart and concurrent objects
|-
| A fight in Tunisia
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
|-
| yubikiri-genman
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| OK
| OK
| OK
| OK
| OK
|}

=== HiTaiko ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| Minor snapping issue on drumrolls and swells
| Minor snapping issue on drumrolls and swells
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| OK
|}

=== MALer ===

{| class="wikitable"
|-
! Song
! Kantan
! Futsuu
! Muzukashii
! Oni
! Inner Oni
|-
| Silver Bullet
| OK
| OK
| OK
| OK
| OK
|-
| A fight in Tunisia
| OK
| OK
| OK
| OK
| OK
|-
| Himitsu
| OK
| OK
| OK
| OK
| OK
|-
| yubikiri-genman
| OK
| OK
| OK
| OK
| OK
|-
| something fun
| OK
| OK
| OK
| OK
| OK
|-
| closer to you
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
| Unused audio at the end
|}

== Expert Evaluation Results ==

== Community Evaluation Results ==

2026:Rhythm Game Chart Generation Results

2026-10-08T20:06:53Z

Ziyunliu: /* Test Set */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

=== Default Settings ===

= Results =

== Algorithmic Evaluation Results ==

== Expert Evaluation Results ==

== Community Evaluation Results ==

2026:Rhythm Game Chart Generation Results

2026-10-08T20:05:05Z

Ziyunliu: /* Test Set */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =
=== Song Selection ===
{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

= Results =

== Algorithmic Evaluation Results ==

== Expert Evaluation Results ==

== Community Evaluation Results ==

2026:Rhythm Game Chart Generation Results

2026-10-08T20:04:54Z

Ziyunliu: /* Song Selection */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

=== Song Selection ===

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

= Results =

== Algorithmic Evaluation Results ==

== Expert Evaluation Results ==

== Community Evaluation Results ==

2026:Rhythm Game Chart Generation Results

2026-10-08T20:04:40Z

Ziyunliu: /* Test Set */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

== Song Selection ==

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

= Results =

== Algorithmic Evaluation Results ==

== Expert Evaluation Results ==

== Community Evaluation Results ==

2026:Rhythm Game Chart Generation Results

2026-10-08T19:54:14Z

Ziyunliu: /* Test Set */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
| 89-379 (mostly 175)
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
| 148
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
| 194
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
| 110
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
| 59-146 (mostly 146)
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
| 168
|}

= Results =

== Algorithmic Evaluation Results ==

== Expert Evaluation Results ==

== Community Evaluation Results ==

2026:Rhythm Game Chart Generation Results

2026-10-08T19:45:56Z

Ziyunliu: /* Test Set */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! BPM
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
|
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
|
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
|
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
|
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
|
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
|
|}

= Results =

== Algorithmic Evaluation Results ==

== Expert Evaluation Results ==

== Community Evaluation Results ==

2026:Rhythm Game Chart Generation Results

2026-10-08T19:45:38Z

Ziyunliu: /* Test Set */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
! bpm
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
|
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
|
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
|
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
|
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
|
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
|
|}

= Results =

== Algorithmic Evaluation Results ==

== Expert Evaluation Results ==

== Community Evaluation Results ==

2026:Rhythm Game Chart Generation Results

2026-10-07T19:44:08Z

Ziyunliu: /* Test Set */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive, female vocal
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
|}

= Results =

== Algorithmic Evaluation Results ==

== Expert Evaluation Results ==

== Community Evaluation Results ==

2026:Rhythm Game Chart Generation Results

2026-10-07T19:43:30Z

Ziyunliu: /* Test Set */

= Submissions =

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| DOSU
| DOSU: DIFFICULTY-CONDITIONED ON-GRID SEQUENCE UNMASKING FOR OSU!TAIKO CHART GENERATION
|
| Junyoung Koh, Hao-Wen Dong
|-
| FumenLab
| FUMENLAB: PLAN-CONDITIONED JOINT GENERATION AND REFINEMENT OF OSU!TAIKO CHARTS
|
| Ryo Mitoma
|-
| HiTaiko
| HiTaiko: Hierarchical osu!Taiko Chart Generation via Metrical Candidate Selection
|
| Sungjung Park
|-
| MALer
| RHYTHM GAME CHART GENERATION WITH PRE-TRAINED MUSIC TRANSCRIPTION MODEL
|
| Sojeong An, Chris Donahue, Dasaem Jeong
|}

= Test Set =

{| class="wikitable"
|-
! Title
! Artist
! Genre
! Language
! Tags
|-
| Silver Bullet
| Ennnn
| Electronic
| Instrumental
| breakcore, neurofunk, tech
|-
| A fight in Tunisia
| Sobrem & NIWASHI
| Jazz
| Instrumental
| piano
|-
| Something Fun
| JOYLESS
| Rock
| English
| male vocal
|-
| closer to you (than ever before)
| xiiiac13
| Electronic
| Instrumental
| lo-fi
|-
| YUBIKIRI-GENMAN
| Mili
| Pop
| Japanese
| j-pop, progressive
|-
| Himitsu feat. KAFU
| MIMI
| Pop
| Japanese
| j-pop, vocaloid
|}

= Results =

== Algorithmic Evaluation Results ==

== Expert Evaluation Results ==

== Community Evaluation Results ==