2008:Audio Genre Classification - Revision history

Gina at 22:54, 7 September 2008

2008-09-07T22:54:28Z

Gina: /* Overall Summary Results */

2008-09-07T22:47:34Z

‎Overall Summary Results

Gina: /* Team ID */

2008-09-07T20:31:36Z

‎Team ID

Gina at 20:30, 7 September 2008

2008-09-07T20:30:54Z

Mertbay: /* Submission closing date */

2008-07-31T19:06:18Z

‎Submission closing date

Kriswest at 17:16, 17 July 2008

2008-07-17T17:16:49Z

Kriswest at 17:15, 17 July 2008

2008-07-17T17:15:35Z

Mim: /* Submission opening date */

2008-07-08T14:00:53Z

‎Submission opening date

Kriswest: /* Example submission calling formats */

2008-07-01T10:12:30Z

‎Example submission calling formats

Kriswest: /* I/O formats */

2008-07-01T10:11:26Z

‎I/O formats

← Older revision		Revision as of 22:54, 7 September 2008
Line 1:		Line 1:
−	~~==Overall Summary Results==~~
−	~~===General Legend===~~
−	~~====Team ID====~~
−	~~'''LRPPI''' = [https://www.music-ir.org/mirex/2008/abs/.pdf T. Lidy, A. Rauber, A. Pertusa, P. Peonce de Leon, J. M. I├▒esta]<br />~~
−	~~'''GT''' = [https://www.music-ir.org/mirex/2008/abs/.pdf G. Tzanetakis]<br />~~
−	~~'''GP''' = [https://www.music-ir.org/mirex/2008/abs/.pdf G. Peeters]<br />~~
−
−	~~===MIREX 2008 Audio Genre Classification Summary Results - TBA===~~
−
−	~~<csv>---.csv</csv>~~
−
	== Status ==		== Status ==

@@ Line 2: / Line 2: @@
 ===General Legend===
 ====Team ID====
-'''LRPPI''' = [https://www.music-ir.org/mirex/2008/abs/.pdf Lidy, T., Rauber, A., Pertusa, A. Peonce de Leon, P., I├▒esta, J. M.]<br />
+'''LRPPI''' = [https://www.music-ir.org/mirex/2008/abs/.pdf T. Lidy, A. Rauber, A. Pertusa, P. Peonce de Leon, J. M. I├▒esta]<br />
-'''GT''' = [https://www.music-ir.org/mirex/2008/abs/.pdf Tzanetakis, G.]<br />
+'''GT''' = [https://www.music-ir.org/mirex/2008/abs/.pdf G. Tzanetakis]<br />
-'''GP''' = [https://www.music-ir.org/mirex/2008/abs/.pdf Peeters, G.]<br />
+'''GP''' = [https://www.music-ir.org/mirex/2008/abs/.pdf G. Peeters]<br />
 ===MIREX 2008 Audio Genre Classification Summary Results - TBA===
 <csv>---.csv</csv>
 == Status ==

@@ Line 3: / Line 3: @@
 ====Team ID====
 '''LRPPI''' = [https://www.music-ir.org/mirex/2008/abs/.pdf Lidy, T., Rauber, A., Pertusa, A. Peonce de Leon, P., I├▒esta, J. M.]<br />
-'''GT''' = [https://www.music-ir.org/mirex/2008/abs/.pdf  George Tzanetakis]<br />
+'''GT''' = [https://www.music-ir.org/mirex/2008/abs/.pdf Tzanetakis, G.]<br />
 '''GP''' = [https://www.music-ir.org/mirex/2008/abs/.pdf Peeters, G.]<br />
 ===MIREX 2008 Audio Genre Classification Summary Results - TBA===

← Older revision		Revision as of 20:30, 7 September 2008
Line 1:		Line 1:
		+	==Overall Summary Results==
		+	===General Legend===
		+	====Team ID====
		+	'''LRPPI''' = [https://www.music-ir.org/mirex/2008/abs/.pdf Lidy, T., Rauber, A., Pertusa, A. Peonce de Leon, P., I├▒esta, J. M.]<br />
		+	'''GT''' = [https://www.music-ir.org/mirex/2008/abs/.pdf George Tzanetakis]<br />
		+	'''GP''' = [https://www.music-ir.org/mirex/2008/abs/.pdf Peeters, G.]<br />
		+
		+
		+	===MIREX 2008 Audio Genre Classification Summary Results - TBA===
		+
		+	<csv>---.csv</csv>
		+
		+
	== Status ==		== Status ==
−

	A provisional specification of the genre classification task is detailed below. This proposal may be refined based on feedback from the participants.		A provisional specification of the genre classification task is detailed below. This proposal may be refined based on feedback from the participants.

← Older revision		Revision as of 19:06, 31 July 2008
Line 235:		Line 235:

	TBA		TBA
		+
		+	== Potential Participants ==
		+	If you think there is a slight chance that you would participate, please add your name and email below.

@@ Line 6: / Line 6: @@
 Note that audio genre classification algorithms have been evaluated at ISMIR 2004, MIREX 2005 and MIREX 2007. However, there was no genre classification task in 2006.
-Please feel free to edit this page.
+Please feel free to edit this page but please conduct discussion of the task format and evaluation on the [mailto:mrx-com00@lists.lis.uiuc.edu MRX-COM00] mailing list ([https://mail.lis.uiuc.edu/mailman/listinfo/mrx-com00 List interface]).
 === Possible additional tasks ===
@@ Line 205: / Line 205: @@
 === Packaging submissions ===
-All submissions should be statically linked to all libraries (the presence of dynamically linked libraries cannot be guaranteed).
+All submissions should be statically linked to all libraries (the presence of dynamically linked libraries cannot be guaranteed). [mailto:mirproject@lists.lis.uiuc.edu IMIRSEL] should be notified of any dependencies that you cannot include with your submission at the earliest opportunity (in order to give them time to satisfy the dependency).
 All submissions should include a README file including the following the information:

@@ Line 27: / Line 27: @@
 === Collections ===
-Systems will be evaluated on two different collections. The first collection may either be the MIREX 2007 genre classification set (details below) or a new dataset drawn from the same distribution of over 22,000 tracks. If a new set is selected it is expected to contain 10-12 genres, with beteen 700 and 1000 tracks per genre.
+Systems will be evaluated on two different collections. The first collection may either be the MIREX 2007 genre classification set (details below) or a new dataset drawn from the same distribution of over 22,000 tracks. If a new set is selected it is expected to contain 10-12 genres, with between 700 and 1000 tracks per genre.
-MIREX 2007 collection statistics: 7000 30-second audio clips in 22.05kHz mono wav format drawn from 10 genres (700 clips from each genre). Genres:
+MIREX 2007 collection statistics: 7000 30-second audio clips in 22.05kHz mono WAV format drawn from 10 genres (700 clips from each genre). Genres:
 * Blues
@@ Line 202: / Line 202: @@
    myAlgo.sh -train /path/to/scratch/folder /path/to/trainListFile.txt
    myAlgo.sh -classify /path/to/testListFile.txt /path/to/outputListFile.txt
 === Packaging submissions ===
@@ Line 218: / Line 217: @@
 === Pre-trained submissions ===
-Pre-trained submissions to this task will be accepted - however they will have to ensure that they return the correct classification labels (as listed in the hierachy file).
+Pre-trained submissions to this task will be accepted - however they will have to ensure that they return the correct classification labels (as listed in the hierarchy file).
 === Time and hardware limits ===
@@ Line 226: / Line 225: @@
 A hard limit of 24 hours will be imposed on feature extraction times.
-A hard limit of 24 hours will be imposed on each training/classificaiton cycle. Leading to a total runtime limit of 72 hours.
+A hard limit of 24 hours will be imposed on each training/classification cycle. Leading to a total runtime limit of 72 hours.
 == Submission opening date ==

@@ Line 184: / Line 184: @@
    extractFeatures.sh /path/to/scratch/folder /path/to/featureExtractionListFile.txt
-   TrainAndClassify.sh /path/to/scratch/folder /path/to/trainListFile.txt /path/to/testListFile.txt /path/to/outputListFile.txt /path/to/gradualOutputListFile.txt
+   TrainAndClassify.sh /path/to/scratch/folder /path/to/trainListFile.txt /path/to/testListFile.txt /path/to/outputListFile.txt
    extractFeatures.sh /path/to/scratch/folder /path/to/featureExtractionListFile.txt
-   TrainAndClassify.sh /path/to/scratch/folder /path/to/hierachy/file /path/to/trainListFile.txt /path/to/testListFile.txt /path/to/outputListFile.txt /path/to/gradualOutputListFile.txt
+   TrainAndClassify.sh /path/to/scratch/folder /path/to/hierachy/file /path/to/trainListFile.txt /path/to/testListFile.txt /path/to/outputListFile.txt
    extractFeatures.sh -numThreads 8 /path/to/scratch/folder /path/to/featureExtractionListFile.txt
-   TrainAndClassify.sh -numThreads 8 /path/to/scratch/folder /path/to/trainListFile.txt /path/to/testListFile.txt /path/to/outputListFile.txt /path/to/gradualOutputListFile.txt
+   TrainAndClassify.sh -numThreads 8 /path/to/scratch/folder /path/to/trainListFile.txt /path/to/testListFile.txt /path/to/outputListFile.txt
    extractFeatures.sh /path/to/scratch/folder /path/to/featureExtractionListFile.txt
    Train.sh /path/to/scratch/folder /path/to/trainListFile.txt
-   Classify.sh /path/to/testListFile.txt /path/to/outputListFile.txt /path/to/gradualOutputListFile.txt
+   Classify.sh /path/to/testListFile.txt /path/to/outputListFile.txt
    myAlgo.sh -extract -numThreads 8 /path/to/scratch/folder /path/to/featureExtractionListFile.txt
-   myAlgo.sh -TrainAndClassify -numThreads 8 /path/to/scratch/folder /path/to/trainListFile.txt /path/to/testListFile.txt /path/to/outputListFile.txt /path/to/gradualOutputListFile.txt
+   myAlgo.sh -TrainAndClassify -numThreads 8 /path/to/scratch/folder /path/to/trainListFile.txt /path/to/testListFile.txt /path/to/outputListFile.txt
    myAlgo.sh -extract /path/to/scratch/folder /path/to/featureExtractionListFile.txt
    myAlgo.sh -train /path/to/scratch/folder /path/to/trainListFile.txt
-   myAlgo.sh -classify /path/to/testListFile.txt /path/to/outputListFile.txt /path/to/gradualOutputListFile.txt
+   myAlgo.sh -classify /path/to/testListFile.txt /path/to/outputListFile.txt
 === Packaging submissions ===

@@ Line 36: / Line 36: @@
 * Baroque
 * Classical
 * Romantic
 * Electronica
@@ Line 180: / Line 179: @@
 ==== New Optional Output File ====
-Furthermore, we encourage the participating algorithms to produce an additional gradual output file that indicates to which degree the different genres (i.e. the different leafs of the genre taxonomy) are regarded applicable to each track. This file should also be in the TSV format [1], but in this case a header line is necessary:
+Furthermore, we encourage the participating algorithms to produce an additional output file representing the feature extracted from each file in a format of the authors choice. One possible format would be Weka ARFF, but participants are not limited to it. A simple CSV (Comma Separated Value) list would suffice.
 === Example submission calling formats ===