2007:Audio Music Mood Classification - Revision history

Kahyun Choi: /* Exemplar Songs in Each Category */

2011-12-20T04:05:07Z

‎Exemplar Songs in Each Category

IMIRSELBot: Robot: Automated text replacement (-\[http:\/\/(www.)?music-ir.org\/mirex\/200([5-9])\/index.php\/([^\s]+)( .+)?\] +200\2:\3)

2010-06-07T19:09:21Z

Robot: Automated text replacement (-\[http:\/\/(www.)?music-ir.org\/mirex\/200([5-9])\/index.php\/([^\s]+)( .+)?\] +200\2:\3)

IMIRSELBot: Robot: Automated text replacement (-\[\[([A-Z][^:]+)\]\] +2007:\1)

2010-05-13T21:57:42Z

Robot: Automated text replacement (-\[\[([A-Z][^:]+)\]\] +2007:\1)

IMIRSELBot: Robot: Automated text replacement (-\[\[([A-Z][^:]+)\]\] +2007:\1)

2010-05-13T18:18:30Z

Robot: Automated text replacement (-\[\[([A-Z][^:]+)\]\] +2007:\1)

WikiSysop: fixed hyperlinks to mirex2006 wiki

2007-12-11T18:19:13Z

fixed hyperlinks to mirex2006 wiki

Sachin: /* Participants */

2007-08-26T13:49:56Z

‎Participants

Fornari: /* Participants */

2007-08-20T19:35:54Z

‎Participants

JDownie: /* Classification output files */

2007-08-19T17:03:45Z

‎Classification output files

Sachin: /* Participants */

2007-08-17T14:26:24Z

‎Participants

Claurier: /* Groundtruth Set */

2007-08-15T20:55:00Z

‎Groundtruth Set

@@ Line 129: / Line 129: @@
 Exemplar songs for each mood cluster are manually selected by multiple human assessors. The purpose is to further clarify the perceptual identities of the mood clusters.
-There are 190 candidate songs in the intersection of AMG mood repository and the USPOP collection in IMIRSEL, and each of these songs has only one unanimous mood cluster label assigned by AMG editors. The mood labels by AMG editors are important benchmark which can help us reach cross-listener consistency on such a subjective task. So far, 6 human assessors have listened to the 190 songs and assigned cluster labels to them. 50 songs are unanimously labeled by the 6 human assessors, 42 songs are unanimously labeled by 5 of the 6 human assessors, and another 40 songs by 4 of the 6 human assessors. The song titles are listed in [[exemplar songs]].
+There are 190 candidate songs in the intersection of AMG mood repository and the USPOP collection in IMIRSEL, and each of these songs has only one unanimous mood cluster label assigned by AMG editors. The mood labels by AMG editors are important benchmark which can help us reach cross-listener consistency on such a subjective task. So far, 6 human assessors have listened to the 190 songs and assigned cluster labels to them. 50 songs are unanimously labeled by the 6 human assessors, 42 songs are unanimously labeled by 5 of the 6 human assessors, and another 40 songs by 4 of the 6 human assessors. The song titles are listed in [[2007:exemplar songs]].
 The advantages of the exemplar songs are two folds: 1. they will help people better understand what kind of mood each cluster refers to; 2. they can possibly be taken as training data for the algorithms (see the section of [[#Training Set]]).

@@ Line 199: / Line 199: @@
 * Be sure that your submission accepts the proper [[#Input_File]] format
 * Be sure that your submission produces the proper [[#Output_File]] format
-* Be sure to follow the [[https://www.music-ir.org/mirex/2006/index.php/Best_Coding_Practices_for_MIREX Best Coding Practices for MIREX]]
+* Be sure to follow the [[[2006:Best_Coding_Practices_for_MIREX]]
 * Be sure to follow the [[2007:MIREX 2007 Submission Instructions]]
 * In the README file that is included with your submission, please answer the following additional questions:
@@ Line 210: / Line 210: @@
 == Submission Format ==
-A submission to the Audio Music Mood Classification evaluation is expected to follow the [https://www.music-ir.org/mirex/2006/index.php/Best_Coding_Practices_for_MIREX Best Coding Practices for MIREX] and must conform to the following for execution:
+A submission to the Audio Music Mood Classification evaluation is expected to follow the [[2006:Best_Coding_Practices_for_MIREX]] and must conform to the following for execution:
 === One Call Format ===

@@ Line 124: / Line 124: @@
 [[2007:Previous Discussion on Mood Taxonomy]]
-[[Discussion on Mood Categories]]
+[[2007:Discussion on Mood Categories]]
 == Exemplar Songs in Each Category ==

@@ Line 8: / Line 8: @@
 # Audio files: 30 sec., 22kHz, mono, 16 bit
-Do take a look at the [[Audio Genre Classification]] task wiki as we are basing the underlying structure of this task on Audio Genre. In fact, an Audio Genre submission should work out of the box with Audio Mood Classification. Note: we really want folks to do a FEATURE EXTRACTION phase first against all the files and then have these features cached some place for re-use during the TRAIN-TEST phase. This way we can really speed up the n-fold processing. Thus, like GENRE, we need to pass three input files to your algos:
+Do take a look at the [[2007:Audio Genre Classification]] task wiki as we are basing the underlying structure of this task on Audio Genre. In fact, an Audio Genre submission should work out of the box with Audio Mood Classification. Note: we really want folks to do a FEATURE EXTRACTION phase first against all the files and then have these features cached some place for re-use during the TRAIN-TEST phase. This way we can really speed up the n-fold processing. Thus, like GENRE, we need to pass three input files to your algos:
 ==== 1. Feature extraction list file ====
@@ Line 122: / Line 122: @@
-[[Previous Discussion on Mood Taxonomy]]
+[[2007:Previous Discussion on Mood Taxonomy]]
 [[Discussion on Mood Categories]]
@@ Line 135: / Line 135: @@
 Note: Lyrics issue: when labeling the songs, the human assessors were asked to ignore lyrics. As this is a contest focuses on music audio, lyrics should not be taken into consideration.
-[[Previous Discussion on Ground Truth]]
+[[2007:Previous Discussion on Ground Truth]]
 == Two Evaluation Scenarios ==
@@ Line 166: / Line 166: @@
 === Human Validation ===
-Subjective judgments by human assessors will be collected for the above mentioned APM audio set using a web-based system, Evalutron6000, developed by the IMIRSEL. (An introduction of this piece of Evalutron 6000 is shown here [[Evalutron6000_Walkthrough_For_Audio_Mood_Classification]]
+Subjective judgments by human assessors will be collected for the above mentioned APM audio set using a web-based system, Evalutron6000, developed by the IMIRSEL. (An introduction of this piece of Evalutron 6000 is shown here [[2007:Evalutron6000_Walkthrough_For_Audio_Mood_Classification]]
 Each audio clip is 30 seconds long, and will have 3 human judges listen to it and choose which mood category it belongs to. If 2 of the 3 judges agree on its category, an audio clip will be selected into the groundtruth set.
@@ Line 200: / Line 200: @@
 * Be sure that your submission produces the proper [[#Output_File]] format
 * Be sure to follow the [[https://www.music-ir.org/mirex/2006/index.php/Best_Coding_Practices_for_MIREX Best Coding Practices for MIREX]]
-* Be sure to follow the [[MIREX 2007 Submission Instructions]]
+* Be sure to follow the [[2007:MIREX 2007 Submission Instructions]]
 * In the README file that is included with your submission, please answer the following additional questions:
 ** Approximately how long will the submission take to process ~1000 wav files?
 ** Approximately how much scratch disk space will the submission need to store any feature/cache files?
 ** Any special notice regarding to running your algorith
-* Submit your system via the URL located at the bottom of [[MIREX 2007 Submission Instructions]] page
+* Submit your system via the URL located at the bottom of [[2007:MIREX 2007 Submission Instructions]] page
 Note that the information that you place in the README file is '''extremely''' important in ensuring that your submission is evaluated properly.
@@ Line 328: / Line 328: @@
 === Human Assessment===
-Subjective judgments by human assessors will be collected for the pooled results using a web-based system, Evalutron6000, developed by the IMIRSEL. (An introduction of this piece of Evalutron 6000 is shown here [[Evalutron6000_Walkthrough_For_Audio_Mood_Classification]]
+Subjective judgments by human assessors will be collected for the pooled results using a web-based system, Evalutron6000, developed by the IMIRSEL. (An introduction of this piece of Evalutron 6000 is shown here [[2007:Evalutron6000_Walkthrough_For_Audio_Mood_Classification]]
 ==== How many judgments and assessors ====

@@ Line 199: / Line 199: @@
 * Be sure that your submission accepts the proper [[#Input_File]] format
 * Be sure that your submission produces the proper [[#Output_File]] format
-* Be sure to follow the [[https://www.music-ir.org/mirex2006/index.php/Best_Coding_Practices_for_MIREX Best Coding Practices for MIREX]]
+* Be sure to follow the [[https://www.music-ir.org/mirex/2006/index.php/Best_Coding_Practices_for_MIREX Best Coding Practices for MIREX]]
 * Be sure to follow the [[MIREX 2007 Submission Instructions]]
 * In the README file that is included with your submission, please answer the following additional questions:
@@ Line 210: / Line 210: @@
 == Submission Format ==
-A submission to the Audio Music Mood Classification evaluation is expected to follow the [https://www.music-ir.org/mirex2006/index.php/Best_Coding_Practices_for_MIREX Best Coding Practices for MIREX] and must conform to the following for execution:
+A submission to the Audio Music Mood Classification evaluation is expected to follow the [https://www.music-ir.org/mirex/2006/index.php/Best_Coding_Practices_for_MIREX Best Coding Practices for MIREX] and must conform to the following for execution:
 === One Call Format ===

@@ Line 392: / Line 392: @@
 * Matt Hoffman (mdhoffma <i>a t</i> cs <i>d o t</i> princeton <i>d o t</i> edu)
 * Yi-Hsuan Yang (affige at gmail dot com)
 * Jose Fornari ( fornari at campus dot jyu dot fi )

@@ Line 393: / Line 393: @@
 * Yi-Hsuan Yang (affige at gmail dot com)
 * Sachin Pant ( sachinp at ee dot iitb dot ac dot in )
 == Moderators ==

@@ Line 29: / Line 29: @@
 Participating algorithms should produce a simple ASCII list file identical in
 format to the Training list file. This file will contain one path per line,
-followed by a tab character and the genre label, again with no header line.
+followed by a tab character and the MOOD label, again with no header line.
 E.g.:
   <example path and filename>\t<mood classification>
@@ Line 37: / Line 37: @@
 ********************************************
 == Audio collection poll ==

@@ Line 162: / Line 162: @@
 After the human validation on this audio set, participating algorithms/ models will be trained and tested within IMIRSEL.
-Proposed audio format:
+'''Audio format: 30 second clips, 22.05kHz, mono, 16bit, WAV files'''
 === Human Validation ===