2010:Audio Classification (Train/Test) Tasks

Description

Many tasks in music classification can be characterized to a two-stage process: train classification models using labeled data, and test the models using new/unseen data. Therefore, we propose this "super" task which includes various audio classification tasks that follow this Train/Test process. In this year, three classification tasks are included:

• Audio Artist Identification
• Audio Genre Classification
• Audio Mood Classification

All three classification tasks were conducted in previous MIREX runs. This page presents the evaluation of these tasks, including the datasets, the submission rules and formats, as well as links to the wiki pages of previous runs of these tasks. Additionally background information can be found here that should help explain some of the reasoning behind the approach taken in the evaluation. Please feel free to edit this page and conduct discussion of the task format and evaluation on the MRX-COM00 mailing list (List interface).

Data

The three classification tasks use three different datasets.

Audio Artist Identification

There are two datasets for this task: 1) The collection used at MIREX 2009 will be re-used. Collection statistics:

• 3150 30-second 22.05kHz mono wav audio clips drawn from 105 artists (30 clips per artist drawn from 3 albums).

2) The second collection is composed classical composers:

• 2772 30-second 22.05 kHz mono wav clips organised into 11 "classical" composers (252 clips per composer). At present the database contains tracks for:
  • Bach
  • Beethoven
  • Brahms
  • Chopin
  • Dvorak
  • Handel
  • Haydn
  • Mendelssohn
  • Mozart
  • Schubert
  • Vivaldi

Audio Genre Classification

This task will use two different datasets. 1) The MIREX 2007 Genre Collection: The first collection may either be the MIREX 2007 genre classification set (details below) or a new dataset drawn from the same distribution of over 22,000 tracks. If a new set is selected it is expected to contain 10-12 genres, with between 700 and 1000 tracks per genre.

MIREX 2007 collection statistics: 7000 30-second audio clips in 22.05kHz mono WAV format drawn from 10 genres (700 clips from each genre). Genres:

• Blues
• Jazz
• Country/Western
• Baroque
• Classical
• Romantic
• Electronica
• Hip-Hop
• Rock
• HardRock/Metal

2) Latin Genre Collection: Carlos Silla (cns2 (at) kent (dot) ac (dot) uk) has contributed a second dataset of Latin popular and dance music sourced from Brazil and hand labeled by music experts. This collection is likely to contain a greater number of styles of music that will be differentiated by rhythmic characteristics than the MIREX 2007 dataset.

More precisely, the Latin Music Database has 3,227 audio files from 10 Latin music genres:

• Ax├⌐
• Bachata
• Bolero
• Forr├│
• Ga├║cha
• Merengue
• Pagode
• Sertaneja
• Tango