Difference between revisions of "2010:Runtime"
From MIREX Wiki
| Line 1: | Line 1: | ||
| + | |||
| + | ===Info about run time information=== | ||
| + | There are various kinds of overheads involved in the running of people's algorithm including launching Matlab, remoting the streams and overhead of the workflow infrastructure. | ||
| + | |||
'''Task 4''' (MIREX 2010: Audio Train/Test: Genre Classification (Latin) - MIREX09 Dataset) | '''Task 4''' (MIREX 2010: Audio Train/Test: Genre Classification (Latin) - MIREX09 Dataset) | ||
:Music classification task requiring participants to classify music audio tracks by Genre, where the genres are drawn from a set of Latin music genres collected in Brazil and annotated by experts. | :Music classification task requiring participants to classify music audio tracks by Genre, where the genres are drawn from a set of Latin music genres collected in Brazil and annotated by experts. | ||
Revision as of 17:12, 26 October 2010
Info about run time information
There are various kinds of overheads involved in the running of people's algorithm including launching Matlab, remoting the streams and overhead of the workflow infrastructure.
Task 4 (MIREX 2010: Audio Train/Test: Genre Classification (Latin) - MIREX09 Dataset)
- Music classification task requiring participants to classify music audio tracks by Genre, where the genres are drawn from a set of Latin music genres collected in Brazil and annotated by experts.
- Flow 39 -Mirex2010 Train and Classify template (one call format)
| Submission Code | Runtime |
|---|---|
| TN1 | 08:08:13 |
Task 4 (MIREX 2010: Audio Train/Test: Genre Classification (Latin) - MIREX09 Dataset)
- Music classification task requiring participants to classify music audio tracks by Genre, where the genres are drawn from a set of Latin music genres collected in Brazil and annotated by experts.
- Flow 35 -Mirex2010 Feature Extraction
| Submission Code | Runtime |
|---|---|
| BMPE2 | 07:06:26 |
| BRPC1 | 68:57:30 |
| GP1 | 38:38:16 |
| HE1 | 00:55:28 |
| MBP1 | 03:06:47 |
| MP2 | 16:04:11 |
| RRS1 | 00:00:32 |
| SL1 | 39:46:28 |
| SSPK1 | 35:27:45 |
| TN2 | 05:27:54 |
| WLB1 | 11:18:53 |
| WLJW2 | 00:00:48 |
Task 4 (MIREX 2010: Audio Train/Test: Genre Classification (Latin) - MIREX09 Dataset)
- Music classification task requiring participants to classify music audio tracks by Genre, where the genres are drawn from a set of Latin music genres collected in Brazil and annotated by experts.
- Flow 36 -Mirex2010 Train and Classify task template - with precomputed features
| Submission Code | Runtime |
|---|---|
| BRPC1 | 00:46:12 |
| GP1 | 00:00:45 |
| HE1 | 10:31:54 |
| MBP1 | 00:03:28 |
| MP2 | 20:09:25 |
| TN2 | 00:00:52 |
| WLB1 | 00:45:20 |
| WLB2 | 00:01:45 |
| WLB3 | 00:15:21 |
Task 5 (MIREX 2010: Audio Train/Test: Classical Composer Identification - MIREX08 Dataset)
- Music classification task requiring participants to classify music audio tracks according by composer, where the composers and dataset are drawn from a set of western classical art music genres.
- Flow 39 -Mirex2010 Train and Classify template (one call format)
| Submission Code | Runtime |
|---|---|
| TN1 | 01:11:56 |
| TN4 | 01:03:02 |
Task 5 (MIREX 2010: Audio Train/Test: Classical Composer Identification - MIREX08 Dataset)
- Music classification task requiring participants to classify music audio tracks according by composer, where the composers and dataset are drawn from a set of western classical art music genres.
- Flow 35 -Mirex2010 Feature Extraction
| Submission Code | Runtime |
|---|---|
| BMPE2 | 00:33:35 |
| BRPC1 | 02:44:43 |
| BRPC2 | 06:20:17 |
| GP1 | 03:39:15 |
| HE1 | 00:16:47 |
| MBP1 | 00:17:44 |
| MP2 | 00:23:27 |
| RRS1 | 11:32:43 |
| SSPK1 | 03:51:08 |
| TN2 | 03:58:16 |
| WLB1 | 19:41:01 |
Task 5 (MIREX 2010: Audio Train/Test: Classical Composer Identification - MIREX08 Dataset)
- Music classification task requiring participants to classify music audio tracks according by composer, where the composers and dataset are drawn from a set of western classical art music genres.
- Flow 36 -Mirex2010 Train and Classify task template - with precomputed features
| Submission Code | Runtime |
|---|---|
| BMPE2 | 02:07:12 |
| GP1 | 00:06:43 |
| HE1 | 22:31:45 |
| MBP1 | 00:03:19 |
| TN2 | 01:09:11 |
| WLB1 | 00:38:19 |
| WLB2 | 00:01:23 |
| WLB3 | 00:21:05 |
| WLB4 | 00:08:41 |
Task 8 (MIREX 2010: Audio Train/Test: Mood Classification - MIREX08 Dataset)
- Music classification task requiring participants to classify music audio tracks by Mood, where the moods are drawn from a set of commercial production music.
- Flow 35 -Mirex2010 Feature Extraction
| Submission Code | Runtime |
|---|---|
| BMPE2 | 00:04:32 |
| BRPC1 | 01:54:16 |
| BRPC2 | 00:36:56 |
| GP1 | 02:00:01 |
| HE1 | 00:09:30 |
| MBP1 | 00:12:15 |
| MP2 | 00:20:03 |
| RRS1 | 00:05:01 |
| SL1 | 14:49:42 |
| SSPK1 | 02:03:29 |
| TN2 | 00:58:40 |
| TS1 | 00:00:58 |
| WLB1 | 02:39:32 |
| WLJW1 | 09:44:57 |
| WLJW2 | 08:12:07 |
Task 8 (MIREX 2010: Audio Train/Test: Mood Classification - MIREX08 Dataset)
- Music classification task requiring participants to classify music audio tracks by Mood, where the moods are drawn from a set of commercial production music.
- Flow 36 -Mirex2010 Train and Classify task template - with precomputed features
| Submission Code | Runtime |
|---|---|
| BMPE2 | 00:34:07 |
| BRPC1 | 00:10:44 |
| BRPC2 | 03:29:04 |
| GP1 | 00:02:31 |
| HE1 | 00:39:38 |
| MBP1 | 00:01:08 |
| MP2 | 07:53:30 |
| RRS1 | 00:25:19 |
| SSPK1 | 00:20:07 |
| TN2 | 00:07:35 |
| WLB1 | 00:10:48 |
| WLB2 | 00:03:00 |
| WLB3 | 00:04:29 |
| WLB4 | 00:01:00 |
Task 9 (MIREX 2010: Audio Melody Extraction - ADC04 Dataset)
- Melody extraction from audio task requiring participants to annotate the dominant F0 at each 10ms timestep on the ADC04 dataset.
- Flow 1 -Mirex2010 Analysis task template
| Submission Code | Runtime |
|---|---|
| HJ1 | 00:30:53 |
| JJY1 | 00:26:06 |
| JJY2 | 00:36:17 |
| SG1 | 01:05:58 |
| TOOS1 | 00:04:26 |
Task 11 (MIREX 2010: Audio Melody Extraction - MIREX05 Dataset)
- Melody extraction from audio task requiring participants to annotate the dominant F0 at each 10ms timestep on the MIREX05 dataset.
- Flow 1 -Mirex2010 Analysis task template
| Submission Code | Runtime |
|---|---|
| HJ1 | 00:59:31 |
| JJY1 | 00:50:31 |
| JJY2 | 01:09:30 |
| SG1 | 03:48:02 |
| TOOS1 | 00:08:15 |
Task 13 (MIREX 2010: Audio Melody Extraction - INDIAN08 Dataset)
- Melody extraction from audio task requiring participants to annotate the dominant F0 at each 10ms timestep on the INDIAN08 dataset.
- Flow 1 -Mirex2010 Analysis task template
| Submission Code | Runtime |
|---|---|
| HJ1 | 00:38:18 |
| JJY1 | 00:53:50 |
| JJY2 | 00:52:14 |
| SG1 | 11:27:29 |
| TOOS1 | 00:05:53 |
Task 14 (MIREX 2010: Audio Melody Extraction - MIREX09 0dB Dataset)
- Melody extraction from audio task requiring participants to annotate the dominant F0 at each 10ms timestep on the MIREX09 0dB vocal to accompaniment ratio dataset.
- Flow 1 -Mirex2010 Analysis task template
| Submission Code | Runtime |
|---|---|
| HJ1 | 14:39:16 |
| JJY1 | 12:07:21 |
| JJY2 | 14:06:20 |
| SG1 | 65:21:11 |
| TOOS1 | 01:56:27 |
Task 15 (MIREX 2010: Audio Melody Extraction - MIREX09 -5dB Dataset)
- Melody extraction from audio task requiring participants to annotate the dominant F0 at each 10ms timestep on the MIREX09 -5dB vocal to accompaniment ratio dataset.
- Flow 1 -Mirex2010 Analysis task template
| Submission Code | Runtime |
|---|---|
| AR1 | 14:33:21 |
| HJ1 | 10:58:35 |
| JJY1 | 08:43:59 |
| JJY2 | 14:10:22 |
| SG1 | 48:21:52 |
| TOOS1 | 01:31:01 |
Task 17 (MIREX 2010: Audio Chord Description - MIREX09 Dataset)
- Chord transcription task requiring participants to annotate and segment the chord events in the MIREX09chord transcription dataset.
Please note that:- Evaluations are performed at the triad level,
- results for both pretrained algorithms and algorithms trained and tested under 3 fold cross-validation are reported here.
- pretrained algorithms are likely to have been trained on the evaluation dataset hence they are expected to achieve higher results than algorithms evaluated on held out data.
- Flow 1 -Mirex2010 Analysis task template
| Submission Code | Runtime |
|---|---|
| CWB1 | 02:53:50 |
| EW3 | 01:12:41 |
| EW4 | 00:45:25 |
| JJY2 | 04:49:09 |
| KO1 | 10:50:30 |
| MD1 | 05:44:47 |
| MM1 | 15:05:16 |
| OFG1 | 00:27:22 |
| PVM1 | 01:06:26 |
| RRH1 | 07:29:00 |
| RRHS1 | 08:41:56 |
| RRHS2 | 07:23:41 |
| RVCCR2 | 05:53:03 |
| UUOS1 | 01:56:56 |
Task 16 (MIREX 2010: Audio Melody Extraction - MIREX09 +5dB Dataset)
- Melody extraction from audio task requiring participants to annotate the dominant F0 at each 10ms timestep on the MIREX09 +5dB vocal to accompaniment ratio dataset.
- Flow 1 -Mirex2010 Analysis task template
| Submission Code | Runtime |
|---|---|
| HJ1 | 11:16:37 |
| JJY1 | 08:56:31 |
| JJY2 | 13:55:51 |
| SG1 | 59:31:31 |
| TOOS1 | 01:56:56 |
Task 19 (MIREX 2010: Audio Structural Segmentation - MIREX09 Dataset)
- Structural Segmentation task requiring participants to analyse tracks and determine a (verse/chorus/bridge etc) structure and repeated sections in the music.
- Flow 1 -Mirex2010 Analysis task template
| Submission Code | Runtime |
|---|---|
| BV1 | 21:43:13 |
| BV2 | 24:26:04 |
| MHRAF2 | 13:01:15 |
| MND1 | 10:27:03 |
| WB1 | 07:58:04 |
Task 18 (MIREX 2010: Audio Tempo Extraction - MIREX06 Dataset)
- Tempo estimation task requiring participants to estimate two tempo and relative strength between them for tracks from the MIREX 2006 Tempo estimation dataset.
- Flow 1 -Mirex2010 Analysis task template
| Submission Code | Runtime |
|---|---|
| BES2 | 02:22:14 |
| ES1 | 00:02:19 |
| GKC1 | 03:12:28 |
| GT1 | 00:02:39 |
| NW2 | 00:02:03 |
| OL1 | 00:41:38 |
| TL1 | 00:19:21 |
Task 25 (MIREX 2010: Audio Onset Detection - MIREX05 Dataset)
- Onset detection task requiring participants to analyse tracks and determine the onset times of audio events in the MIREX05 onset detection dataset.
- Flow 1 -Mirex2010 Analysis task template
| Submission Code | Runtime |
|---|---|
| AR2 | 00:03:53 |
| AR3 | 00:04:02 |
| AR4 | 00:03:52 |
| AR5 | 00:03:46 |
| BES1 | 00:00:20 |
| BT1 | 00:54:05 |
| BT2 | 00:53:46 |
| BT3 | 00:53:06 |
| BT4 | 00:58:26 |
| ME1 | 00:06:56 |
| RVCCR1 | 02:19:17 |
| RVCCR2 | 00:44:33 |
| TGGL1 | 00:01:52 |
| TZC1 | 02:30:29 |
| TZC2 | 03:39:24 |
| TZC3 | 04:22:07 |
| TZC4 | 03:49:30 |
| TZC5 | 04:09:49 |
Task 27 (MIREX 2010: Audio Key Detection - MIREX05 Dataset)
- Music Key classification task requiring participants to classify music audio tracks (synthesized from MIDI files) according to Key.
- Flow 1 -Mirex2010 Analysis task template
| Submission Code | Runtime |
|---|---|
| GP8 | 00:25:00 |
| PVM2 | 07:02:07 |
| RRH1 | 14:44:08 |
| RRH2 | 11:01:22 |
| UUOS2 | 01:37:51 |
Task 26 (Demo: Classification Latin Genre)
- Music classification task requiring participants to classify music audio tracks by Genre, where the genres are drawn from a set of Latin music genres collected in Brazil and annotated by experts. This is reduced size dataset for testing classifiers and demonstrations.
- Flow 1 -Mirex2010 Analysis task template
| Submission Code | Runtime |
|---|---|
| BRPC2 | 00:00:48 |
Task 26 (Demo: Classification Latin Genre)
- Music classification task requiring participants to classify music audio tracks by Genre, where the genres are drawn from a set of Latin music genres collected in Brazil and annotated by experts. This is reduced size dataset for testing classifiers and demonstrations.
- Flow 5 -Mirex2010 Test Train task template NEW
| Submission Code | Runtime |
|---|---|
| BRPC2 | 00:00:48 |
Task 31 (Demo: Key Classification MIREX05)
- Music Key classification task requiring participants to classify music audio tracks (synthesized from MIDI files) according to Key. A reduced size dataset is used to simplify testing and demonstration.
- Flow 4 -Mirex2010 Feature Extraction
| Submission Code | Runtime |
|---|---|
| BRPC2 | 00:00:50 |
Task 31 (Demo: Key Classification MIREX05)
- Music Key classification task requiring participants to classify music audio tracks (synthesized from MIDI files) according to Key. A reduced size dataset is used to simplify testing and demonstration.
- Flow 1 -Mirex2010 Analysis task template
| Submission Code | Runtime |
|---|---|
| BRPC2 | 00:00:48 |
Task 31 (Demo: Key Classification MIREX05)
- Music Key classification task requiring participants to classify music audio tracks (synthesized from MIDI files) according to Key. A reduced size dataset is used to simplify testing and demonstration.
- Flow 5 -Mirex2010 Test Train task template NEW
| Submission Code | Runtime |
|---|---|
| BRPC2 | 00:00:25 |
Task 34 (MIREX 2010: Audio Beat Tracking - MIREX09 MAZ Dataset)
- Beat detection task requiring participants to analyse tracks and determine the beat times for tracks in the MIREX09 Beat detection dataset.
- Flow 1 -Mirex2010 Analysis task template
| Submission Code | Runtime |
|---|---|
| BES3 | 29:32:28 |
| BES4 | 34:09:38 |
| LGG1 | 00:57:34 |
| LGG2 | 00:48:56 |
| MRVCC2 | 53:49:15 |
| NW1 | 00:23:14 |
| TL2 | 02:01:39 |
| ZTC1 | 04:17:39 |
Task 33 (MIREX 2010: Audio Beat Tracking - MIREX06 MCK Dataset)
- Beat detection task requiring participants to analyse tracks and determine the beat times for tracks in the MIREX06 Beat detection dataset.
- Flow 1 -Mirex2010 Analysis task template
| Submission Code | Runtime |
|---|---|
| BES3 | 02:25:32 |
| BES4 | 02:16:01 |
| LGG1 | 00:09:44 |
| LGG2 | 00:08:14 |
| MRVCC1 | 14:01:43 |
| NW1 | 00:05:16 |
| TL2 | 00:24:00 |
Task 37 (MIREX 2010: Audio Structural Segmentation - MIREX10 Dataset)
- Structural Segmentation task requiring participants to analyse tracks and determine a (verse/chorus/bridge etc) structure and repeated sections in the music.
- Flow 1 -Mirex2010 Analysis task template
| Submission Code | Runtime |
|---|---|
| BV1 | 15:41:16 |
| BV2 | 09:28:00 |
| MHRAF2 | 11:01:24 |
| MND1 | 11:04:28 |
| WB1 | 05:39:55 |
