Junyan: MIREX 2026 Audio Key Detection results

2026-10-14T18:54:05Z

MIREX 2026 Audio Key Detection results

New page

== Submissions ==

{| class="wikitable"
|-
! Submission
! Title
! PDF
! Authors
|-
| style="vertical-align:bottom; background-color:#F8F9FA; color:#222;" | Baseline: CN1
| style="vertical-align:bottom; background-color:#F8F9FA; color:#222;" | QM Key Detector (QM Vamp Plugins 1.7.1)
| [https://vamp-plugins.org/plugin-doc/qm-vamp-plugins.html Link]
|
|-
| ChordyV-Key
| ChordyV: A Symbolic Harmonic Progression and Tonal Audit System for Audio Key Detection
| [http://futuremirex.com/portal/wp-content/uploads/2026/audio-key-detection/ChordyV-Key.pdf PDF]
| Mulfie Ansyori Sofyan
|-
| Chord-LLM
| Key Detection via LLM Processing of Chord Recognizer Outputs
| [http://futuremirex.com/portal/wp-content/uploads/2026/audio-key-detection/Chord-LLM.pdf PDF]
| Jeffrey Gordon
|-
| Hurliman_K10
| K10: A Compact Convolutional Network for Global Key Estimation
| [http://futuremirex.com/portal/wp-content/uploads/2026/audio-key-detection/Hurliman_K10.pdf PDF]
| John Hurliman
|-
| MusicFM-MLP
| Fully Fine-Tuned MusicFM with a Lightweight MLP Head for Global Key Detection
| [http://futuremirex.com/portal/wp-content/uploads/2026/audio-key-detection/MusicFM-MLP.pdf PDF]
| Xinwei Jiang, Yaolong Ju
|-
| RESON
| An Unsupervised Spectral Pitch-Class Baseline for Audio Key Detection
| [http://futuremirex.com/portal/wp-content/uploads/2026/audio-key-detection/RESON.pdf PDF]
| Ziyi Xu
|-
| UFAL-PMCG-music-flamingo-reasoning-full
| UFAL-PMCG Systems at the MIREX 2026 Audio Key Detection Challenge: Audio-LLMs Are No Longer Off-Key
| [http://futuremirex.com/portal/wp-content/uploads/2026/audio-key-detection/UFAL-PMCG-music-flamingo-reasoning-full.pdf PDF]
| Tomáš Sourada, Jan Hajič jr.
|-
| UFAL-PMCG-qwen3-omni-30b-direct-full
| UFAL-PMCG Systems at the MIREX 2026 Audio Key Detection Challenge: Audio-LLMs Are No Longer Off-Key
| [http://futuremirex.com/portal/wp-content/uploads/2026/audio-key-detection/UFAL-PMCG-qwen3-omni-30b-direct-full.pdf PDF]
| Tomáš Sourada, Jan Hajič jr.
|-
| UFAL-PMCG-qwen25-omni-7b-direct-full
| UFAL-PMCG Systems at the MIREX 2026 Audio Key Detection Challenge: Audio-LLMs Are No Longer Off-Key
| [http://futuremirex.com/portal/wp-content/uploads/2026/audio-key-detection/UFAL-PMCG-qwen25-omni-7b-direct-full.pdf PDF]
| Tomáš Sourada, Jan Hajič jr.
|}

== Test Sets ==

* '''GiantSteps Key''': 604 two-minute excerpts of electronic dance music (the MIREX key test set since 2017).
* '''GTZAN''': the 837 GTZAN excerpts with a single key in the annotations of Kraft and Lerch (classical and excerpts marked as modulating or unknown are excluded).
* '''FMAKv2''' (new in 2026): 5,489 full-length Creative Commons songs of the Free Music Archive in 17 genres, one global key each, annotated by an expert ([https://doi.org/10.5281/zenodo.12759100 FMAKv2], Kong et al., ISMIR 2024; audio from [https://doi.org/10.5281/zenodo.10719860 FMAK]).
* '''Yamaha_JPop''': A private dataset annotated by Yamaha Corporation (174 JPOP songs).
* '''Yamaha_Balanced''': A private dataset annotated by Yamaha Corporation (185 songs). While it is still biased towards JPOP songs, the dataset covers a wider range of genres: J.Pop (10.37%), Rock (10.37%), J.Enka (10.37%), J.Kayoukyoku (10.37%), Soundtrack (10.37%), Western Pop (10.37%), Children's Song (10.37%), R&B (6.22%), Hiphop (4.56%), Jazz (2.49%), Dance (2.49%), World (2.07%), Techno (1.24%), Easy listening (1.24%), J.Minyou (1.24%), Others (5.81%).

== Results ==

Weighted score: 1 for the correct key, 0.5 for a perfect fifth, 0.3 for the relative key, 0.2 for the parallel key, 0 otherwise. '''Weighted (sym.)''' gives 0.5 to a fifth above or below the reference (as in MIREX 2017–2019); '''Weighted (asym.)''' only to a fifth above (mir_eval 0.8.2 default). The other columns are the percentage of files in each category.

For the two weighted scores and Correct, the best result is shown in bold and the second best underlined.

== GiantSteps Key ==

{| class="wikitable" style="text-align:right;"
|- style="font-weight:bold; text-align:left;"
! style="vertical-align:bottom;" | Group
! style="vertical-align:bottom;" | Weighted (sym.)
! style="vertical-align:bottom;" | Weighted (asym.)
! style="vertical-align:bottom;" | Correct
! style="vertical-align:bottom;" | Fifth up
! style="vertical-align:bottom;" | Fifth down
! style="vertical-align:bottom;" | Relative
! style="vertical-align:bottom;" | Parallel
! style="vertical-align:bottom;" | Chromatic
! style="vertical-align:bottom;" | Other
|- style="vertical-align:bottom;"
| style="text-align:left;" | Chord-LLM †
| 74.40
| 72.42
| 68.05
| 3.31
| 3.97
| 5.96
| 4.64
| 3.31
| 10.76
|- style="vertical-align:bottom;"
| style="text-align:left;" | ChordyV-Key
| 39.74
| 35.68
| 28.81
| 2.98
| 8.11
| 10.10
| 11.76
| 1.99
| 36.26
|- style="vertical-align:bottom;"
| style="text-align:left;" | Hurliman_K10
| 74.57
| 72.91
| 67.88
| 4.30
| 3.31
| 6.95
| 3.97
| 3.15
| 10.43
|- style="vertical-align:bottom;"
| style="text-align:left;" | MusicFM-MLP
| '''77.62'''
| '''76.37'''
| '''72.19'''
| 4.30
| 2.48
| 4.14
| 3.97
| 3.97
| 8.94
|- style="vertical-align:bottom;"
| style="text-align:left;" | RESON
| 42.30
| 41.23
| 29.30
| 13.08
| 2.15
| 5.79
| 18.21
| 2.48
| 28.97
|- style="vertical-align:bottom;"
| style="text-align:left;" | UFAL-PMCG-music-flamingo-reasoning-full
| 60.17
| 59.17
| 52.15
| 3.15
| 1.99
| 10.76
| 11.09
| 1.32
| 19.54
|- style="vertical-align:bottom;"
| style="text-align:left;" | UFAL-PMCG-qwen25-omni-7b-direct-full
| 56.54
| 53.23
| 45.86
| 8.94
| 6.62
| 7.78
| 2.81
| 1.99
| 25.99
|- style="vertical-align:bottom;"
| style="text-align:left;" | UFAL-PMCG-qwen3-omni-30b-direct-full
| 70.94
| 68.79
| 62.91
| 6.13
| 4.30
| 6.29
| 4.64
| 2.48
| 13.24
|- style="vertical-align:bottom;"
| style="text-align:left;" | Baseline: CN1
| 50.53
| 46.97
| 39.74
| 4.80
| 7.12
| 13.24
| 4.30
| 2.65
| 28.15
|}

== GTZAN ==

{| class="wikitable" style="text-align:right;"
|- style="font-weight:bold; text-align:left;"
! style="vertical-align:bottom;" | Group
! style="vertical-align:bottom;" | Weighted (sym.)
! style="vertical-align:bottom;" | Weighted (asym.)
! style="vertical-align:bottom;" | Correct
! style="vertical-align:bottom;" | Fifth up
! style="vertical-align:bottom;" | Fifth down
! style="vertical-align:bottom;" | Relative
! style="vertical-align:bottom;" | Parallel
! style="vertical-align:bottom;" | Chromatic
! style="vertical-align:bottom;" | Other
|- style="vertical-align:bottom;"
| style="text-align:left;" | Chord-LLM †
| '''73.76'''
| '''72.09'''
| '''67.03'''
| 3.70
| 3.35
| 2.51
| 12.31
| 0.84
| 10.27
|- style="vertical-align:bottom;"
| style="text-align:left;" | ChordyV-Key
| 48.64
| 43.44
| 36.44
| 5.73
| 10.39
| 5.26
| 12.78
| 1.67
| 27.72
|- style="vertical-align:bottom;"
| style="text-align:left;" | Hurliman_K10
| 72.03
| 70.24
| 64.64
| 4.90
| 3.58
| 5.02
| 8.24
| 1.79
| 11.83
|- style="vertical-align:bottom;"
| style="text-align:left;" | MusicFM-MLP
| 73.42
| 71.80
| 66.91
| 2.15
| 3.23
| 3.82
| 13.38
| 1.19
| 9.32
|- style="vertical-align:bottom;"
| style="text-align:left;" | RESON
| 48.48
| 47.35
| 34.29
| 16.97
| 2.27
| 5.62
| 14.46
| 2.63
| 23.78
|- style="vertical-align:bottom;"
| style="text-align:left;" | UFAL-PMCG-music-flamingo-reasoning-full
| 54.15
| 52.77
| 44.68
| 4.90
| 2.75
| 7.17
| 17.44
| 0.36
| 22.70
|- style="vertical-align:bottom;"
| style="text-align:left;" | UFAL-PMCG-qwen25-omni-7b-direct-full
| 55.94
| 52.47
| 45.04
| 7.53
| 6.93
| 7.53
| 7.05
| 1.55
| 24.37
|- style="vertical-align:bottom;"
| style="text-align:left;" | UFAL-PMCG-qwen3-omni-30b-direct-full
| 67.60
| 64.43
| 58.90
| 4.54
| 6.33
| 5.62
| 7.89
| 2.87
| 13.86
|- style="vertical-align:bottom;"
| style="text-align:left;" | Baseline: CN1
| 47.08
| 43.14
| 36.68
| 4.18
| 7.89
| 8.84
| 8.60
| 6.69
| 27.12
|}

== FMAKv2 ==

{| class="wikitable" style="text-align:right;"
|- style="font-weight:bold; text-align:left;"
! style="vertical-align:bottom;" | Group
! style="vertical-align:bottom;" | Weighted (sym.)
! style="vertical-align:bottom;" | Weighted (asym.)
! style="vertical-align:bottom;" | Correct
! style="vertical-align:bottom;" | Fifth up
! style="vertical-align:bottom;" | Fifth down
! style="vertical-align:bottom;" | Relative
! style="vertical-align:bottom;" | Parallel
! style="vertical-align:bottom;" | Chromatic
! style="vertical-align:bottom;" | Other
|- style="vertical-align:bottom;"
| style="text-align:left;" | Chord-LLM †
| n/a
| n/a
| n/a
| n/a
| n/a
| n/a
| n/a
| n/a
| n/a
|- style="vertical-align:bottom;"
| style="text-align:left;" | ChordyV-Key
| 53.40
| 47.11
| 41.12
| 5.21
| 12.57
| 8.11
| 4.77
| 1.95
| 26.27
|- style="vertical-align:bottom;"
| style="text-align:left;" | Hurliman_K10
| 72.43
| 70.33
| 64.40
| 5.56
| 4.21
| 7.62
| 4.32
| 1.55
| 12.35
|- style="vertical-align:bottom;"
| style="text-align:left;" | MusicFM-MLP
| '''75.63'''
| '''73.79'''
| '''68.46'''
| 4.39
| 3.68
| 8.31
| 3.21
| 2.17
| 9.78
|- style="vertical-align:bottom;"
| style="text-align:left;" | RESON
| 56.66
| 55.45
| 43.58
| 15.49
| 2.42
| 8.09
| 8.53
| 1.13
| 20.77
|- style="vertical-align:bottom;"
| style="text-align:left;" | UFAL-PMCG-music-flamingo-reasoning-full
| 69.52
| 67.41
| 61.14
| 5.72
| 4.23
| 8.58
| 4.15
| 1.82
| 14.36
|- style="vertical-align:bottom;"
| style="text-align:left;" | UFAL-PMCG-qwen25-omni-7b-direct-full
| 66.00
| 63.25
| 56.33
| 6.74
| 5.50
| 9.75
| 3.12
| 2.00
| 16.56
|- style="vertical-align:bottom;"
| style="text-align:left;" | UFAL-PMCG-qwen3-omni-30b-direct-full
| 74.86
| 72.69
| 67.41
| 4.28
| 4.35
| 7.76
| 4.04
| 1.88
| 10.28
|- style="vertical-align:bottom;"
| style="text-align:left;" | Baseline: CN1
| 63.02
| 58.91
| 52.94
| 4.01
| 8.22
| 10.49
| 4.10
| 3.15
| 17.09
|}


== YAMAHA_Balanced ==

{| class="wikitable" style="text-align:right;"
|- style="font-weight:bold; text-align:left;"
! style="vertical-align:bottom;" | Group
! style="vertical-align:bottom;" | Weighted (sym.)
! style="vertical-align:bottom;" | Weighted (asym.)
! style="vertical-align:bottom;" | Correct
! style="vertical-align:bottom;" | Fifth up
! style="vertical-align:bottom;" | Fifth down
! style="vertical-align:bottom;" | Relative
! style="vertical-align:bottom;" | Parallel
! style="vertical-align:bottom;" | Chromatic
! style="vertical-align:bottom;" | Other
|- style="vertical-align:bottom;"
| style="text-align:left;" | Chord-LLM †
| n/a
| n/a
| n/a
| n/a
| n/a
| n/a
| n/a
| n/a
| n/a
|- style="vertical-align:bottom;"
| style="text-align:left;" | ChordyV-Key
|
|
|
|
|
|
|
|
|
|- style="vertical-align:bottom;"
| style="text-align:left;" | Hurliman_K10
|
|
|
|
|
|
|
|
|
|- style="vertical-align:bottom;"
| style="text-align:left;" | MusicFM-MLP
|
|
|
|
|
|
|
|
|
|- style="vertical-align:bottom;"
| style="text-align:left;" | RESON
|
|
|
|
|
|
|
|
|
|- style="vertical-align:bottom;"
| style="text-align:left;" | UFAL-PMCG-music-flamingo-reasoning-full
|
|
|
|
|
|
|
|
|
|- style="vertical-align:bottom;"
| style="text-align:left;" | UFAL-PMCG-qwen25-omni-7b-direct-full
|
|
|
|
|
|
|
|
|
|- style="vertical-align:bottom;"
| style="text-align:left;" | UFAL-PMCG-qwen3-omni-30b-direct-full
|
|
|
|
|
|
|
|
|
|- style="vertical-align:bottom;"
| style="text-align:left;" | Baseline: CN1
|
|
|
|
|
|
|
|
|
|}

== YAMAHA_JPop ==

{| class="wikitable" style="text-align:right;"
|- style="font-weight:bold; text-align:left;"
! style="vertical-align:bottom;" | Group
! style="vertical-align:bottom;" | Weighted (sym.)
! style="vertical-align:bottom;" | Weighted (asym.)
! style="vertical-align:bottom;" | Correct
! style="vertical-align:bottom;" | Fifth up
! style="vertical-align:bottom;" | Fifth down
! style="vertical-align:bottom;" | Relative
! style="vertical-align:bottom;" | Parallel
! style="vertical-align:bottom;" | Chromatic
! style="vertical-align:bottom;" | Other
|- style="vertical-align:bottom;"
| style="text-align:left;" | Chord-LLM †
| n/a
| n/a
| n/a
| n/a
| n/a
| n/a
| n/a
| n/a
| n/a
|- style="vertical-align:bottom;"
| style="text-align:left;" | ChordyV-Key
|
|
|
|
|
|
|
|
|
|- style="vertical-align:bottom;"
| style="text-align:left;" | Hurliman_K10
|
|
|
|
|
|
|
|
|
|- style="vertical-align:bottom;"
| style="text-align:left;" | MusicFM-MLP
|
|
|
|
|
|
|
|
|
|- style="vertical-align:bottom;"
| style="text-align:left;" | RESON
|
|
|
|
|
|
|
|
|
|- style="vertical-align:bottom;"
| style="text-align:left;" | UFAL-PMCG-music-flamingo-reasoning-full
|
|
|
|
|
|
|
|
|
|- style="vertical-align:bottom;"
| style="text-align:left;" | UFAL-PMCG-qwen25-omni-7b-direct-full
|
|
|
|
|
|
|
|
|
|- style="vertical-align:bottom;"
| style="text-align:left;" | UFAL-PMCG-qwen3-omni-30b-direct-full
|
|
|
|
|
|
|
|
|
|- style="vertical-align:bottom;"
| style="text-align:left;" | Baseline: CN1
|
|
|
|
|
|
|
|
|
|}

== Notes ==

* † Chord-LLM is not evaluated on FMAKv2: according to its extended abstract, the system was developed and tuned on FMAKv2. It uses an online API at inference time and could not be run on the Yamaha sets.
* MusicFM-MLP was trained on the Hooktheory annotations released with SheetSage, which may overlap with some popular song datasets to a small extent.

2026:Audio Key Detection Results - Revision history

Junyan: MIREX 2026 Audio Key Detection results