2026:Audio Key Detection Results

From MIREX Wiki
Revision as of 13:54, 14 October 2026 by Junyan (talk | contribs) (MIREX 2026 Audio Key Detection results)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Submissions

Submission Title PDF Authors
Baseline: CN1 QM Key Detector (QM Vamp Plugins 1.7.1) Link
ChordyV-Key ChordyV: A Symbolic Harmonic Progression and Tonal Audit System for Audio Key Detection PDF Mulfie Ansyori Sofyan
Chord-LLM Key Detection via LLM Processing of Chord Recognizer Outputs PDF Jeffrey Gordon
Hurliman_K10 K10: A Compact Convolutional Network for Global Key Estimation PDF John Hurliman
MusicFM-MLP Fully Fine-Tuned MusicFM with a Lightweight MLP Head for Global Key Detection PDF Xinwei Jiang, Yaolong Ju
RESON An Unsupervised Spectral Pitch-Class Baseline for Audio Key Detection PDF Ziyi Xu
UFAL-PMCG-music-flamingo-reasoning-full UFAL-PMCG Systems at the MIREX 2026 Audio Key Detection Challenge: Audio-LLMs Are No Longer Off-Key PDF Tomáš Sourada, Jan Hajič jr.
UFAL-PMCG-qwen3-omni-30b-direct-full UFAL-PMCG Systems at the MIREX 2026 Audio Key Detection Challenge: Audio-LLMs Are No Longer Off-Key PDF Tomáš Sourada, Jan Hajič jr.
UFAL-PMCG-qwen25-omni-7b-direct-full UFAL-PMCG Systems at the MIREX 2026 Audio Key Detection Challenge: Audio-LLMs Are No Longer Off-Key PDF Tomáš Sourada, Jan Hajič jr.

Test Sets

  • GiantSteps Key: 604 two-minute excerpts of electronic dance music (the MIREX key test set since 2017).
  • GTZAN: the 837 GTZAN excerpts with a single key in the annotations of Kraft and Lerch (classical and excerpts marked as modulating or unknown are excluded).
  • FMAKv2 (new in 2026): 5,489 full-length Creative Commons songs of the Free Music Archive in 17 genres, one global key each, annotated by an expert (FMAKv2, Kong et al., ISMIR 2024; audio from FMAK).
  • Yamaha_JPop: A private dataset annotated by Yamaha Corporation (174 JPOP songs).
  • Yamaha_Balanced: A private dataset annotated by Yamaha Corporation (185 songs). While it is still biased towards JPOP songs, the dataset covers a wider range of genres: J.Pop (10.37%), Rock (10.37%), J.Enka (10.37%), J.Kayoukyoku (10.37%), Soundtrack (10.37%), Western Pop (10.37%), Children's Song (10.37%), R&B (6.22%), Hiphop (4.56%), Jazz (2.49%), Dance (2.49%), World (2.07%), Techno (1.24%), Easy listening (1.24%), J.Minyou (1.24%), Others (5.81%).

Results

Weighted score: 1 for the correct key, 0.5 for a perfect fifth, 0.3 for the relative key, 0.2 for the parallel key, 0 otherwise. Weighted (sym.) gives 0.5 to a fifth above or below the reference (as in MIREX 2017–2019); Weighted (asym.) only to a fifth above (mir_eval 0.8.2 default). The other columns are the percentage of files in each category.

For the two weighted scores and Correct, the best result is shown in bold and the second best underlined.

GiantSteps Key

Group Weighted (sym.) Weighted (asym.) Correct Fifth up Fifth down Relative Parallel Chromatic Other
Chord-LLM † 74.40 72.42 68.05 3.31 3.97 5.96 4.64 3.31 10.76
ChordyV-Key 39.74 35.68 28.81 2.98 8.11 10.10 11.76 1.99 36.26
Hurliman_K10 74.57 72.91 67.88 4.30 3.31 6.95 3.97 3.15 10.43
MusicFM-MLP 77.62 76.37 72.19 4.30 2.48 4.14 3.97 3.97 8.94
RESON 42.30 41.23 29.30 13.08 2.15 5.79 18.21 2.48 28.97
UFAL-PMCG-music-flamingo-reasoning-full 60.17 59.17 52.15 3.15 1.99 10.76 11.09 1.32 19.54
UFAL-PMCG-qwen25-omni-7b-direct-full 56.54 53.23 45.86 8.94 6.62 7.78 2.81 1.99 25.99
UFAL-PMCG-qwen3-omni-30b-direct-full 70.94 68.79 62.91 6.13 4.30 6.29 4.64 2.48 13.24
Baseline: CN1 50.53 46.97 39.74 4.80 7.12 13.24 4.30 2.65 28.15

GTZAN

Group Weighted (sym.) Weighted (asym.) Correct Fifth up Fifth down Relative Parallel Chromatic Other
Chord-LLM † 73.76 72.09 67.03 3.70 3.35 2.51 12.31 0.84 10.27
ChordyV-Key 48.64 43.44 36.44 5.73 10.39 5.26 12.78 1.67 27.72
Hurliman_K10 72.03 70.24 64.64 4.90 3.58 5.02 8.24 1.79 11.83
MusicFM-MLP 73.42 71.80 66.91 2.15 3.23 3.82 13.38 1.19 9.32
RESON 48.48 47.35 34.29 16.97 2.27 5.62 14.46 2.63 23.78
UFAL-PMCG-music-flamingo-reasoning-full 54.15 52.77 44.68 4.90 2.75 7.17 17.44 0.36 22.70
UFAL-PMCG-qwen25-omni-7b-direct-full 55.94 52.47 45.04 7.53 6.93 7.53 7.05 1.55 24.37
UFAL-PMCG-qwen3-omni-30b-direct-full 67.60 64.43 58.90 4.54 6.33 5.62 7.89 2.87 13.86
Baseline: CN1 47.08 43.14 36.68 4.18 7.89 8.84 8.60 6.69 27.12

FMAKv2

Group Weighted (sym.) Weighted (asym.) Correct Fifth up Fifth down Relative Parallel Chromatic Other
Chord-LLM † n/a n/a n/a n/a n/a n/a n/a n/a n/a
ChordyV-Key 53.40 47.11 41.12 5.21 12.57 8.11 4.77 1.95 26.27
Hurliman_K10 72.43 70.33 64.40 5.56 4.21 7.62 4.32 1.55 12.35
MusicFM-MLP 75.63 73.79 68.46 4.39 3.68 8.31 3.21 2.17 9.78
RESON 56.66 55.45 43.58 15.49 2.42 8.09 8.53 1.13 20.77
UFAL-PMCG-music-flamingo-reasoning-full 69.52 67.41 61.14 5.72 4.23 8.58 4.15 1.82 14.36
UFAL-PMCG-qwen25-omni-7b-direct-full 66.00 63.25 56.33 6.74 5.50 9.75 3.12 2.00 16.56
UFAL-PMCG-qwen3-omni-30b-direct-full 74.86 72.69 67.41 4.28 4.35 7.76 4.04 1.88 10.28
Baseline: CN1 63.02 58.91 52.94 4.01 8.22 10.49 4.10 3.15 17.09

YAMAHA_Balanced

Group Weighted (sym.) Weighted (asym.) Correct Fifth up Fifth down Relative Parallel Chromatic Other
Chord-LLM † n/a n/a n/a n/a n/a n/a n/a n/a n/a
ChordyV-Key
Hurliman_K10
MusicFM-MLP
RESON
UFAL-PMCG-music-flamingo-reasoning-full
UFAL-PMCG-qwen25-omni-7b-direct-full
UFAL-PMCG-qwen3-omni-30b-direct-full
Baseline: CN1

YAMAHA_JPop

Group Weighted (sym.) Weighted (asym.) Correct Fifth up Fifth down Relative Parallel Chromatic Other
Chord-LLM † n/a n/a n/a n/a n/a n/a n/a n/a n/a
ChordyV-Key
Hurliman_K10
MusicFM-MLP
RESON
UFAL-PMCG-music-flamingo-reasoning-full
UFAL-PMCG-qwen25-omni-7b-direct-full
UFAL-PMCG-qwen3-omni-30b-direct-full
Baseline: CN1

Notes

  • † Chord-LLM is not evaluated on FMAKv2: according to its extended abstract, the system was developed and tuned on FMAKv2. It uses an online API at inference time and could not be run on the Yamaha sets.
  • MusicFM-MLP was trained on the Hooktheory annotations released with SheetSage, which may overlap with some popular song datasets to a small extent.