Difference between revisions of "2006:Audio Melody Extraction"
(looking for potential participants) |
|||
| Line 2: | Line 2: | ||
In the absence of better suggestions, I propose that we re-run the 2005 audio melody extraction in 2006 i.e. use the same test data at least. We may subsequently come up with some improved metrics (particularly with a view to significance testing) but basically the results will be directly comparable with last year. --[[User:Dpwe|Dpwe]] 15:28, 23 March 2006 (CST) | In the absence of better suggestions, I propose that we re-run the 2005 audio melody extraction in 2006 i.e. use the same test data at least. We may subsequently come up with some improved metrics (particularly with a view to significance testing) but basically the results will be directly comparable with last year. --[[User:Dpwe|Dpwe]] 15:28, 23 March 2006 (CST) | ||
| + | |||
| + | ==Potential Participants== | ||
| + | |||
| + | The following researchers have confirmed their interest in participating: | ||
| + | *Karin Dressler (Fraunhofer IDMT) - dresslkn@idmt.fraunhofer.de - Likely | ||
| + | |||
| + | Additional potential participants include: | ||
| + | * Graham Poliner and Dan Ellis (Columbia University) | ||
| + | * Emmanuel Vincent (Queen Mary, University of London) | ||
| + | * Rui Pedro Paiva (University of Coimbra) | ||
| + | * Matija Marolt (University of Ljubljana) | ||
| + | * Matti Ryynänen and Anssi Klapuri (Tampere University of Technology) | ||
| + | * Masataka Goto (AIST) | ||
| + | * Paul Brossier (Queen Mary, University of London) | ||
| + | |||
| + | ==Karin's comments== | ||
| + | published and "secret" test data: | ||
| + | |||
| + | I would find it very usefull if melody extraction results are computed for two different data sets - one published (for example the ISMIR2004 data set), one "secret" (the MIREX2005 data set). | ||
| + | This way the new results will be comparable with last year's results, and at the same time we gain a better insight into the performance of the algorithms in very specific situations, because we have access to the music files. I think this knowledge would be very valuable for the further development of the algorithms. | ||
Revision as of 10:06, 6 June 2006
Overview
In the absence of better suggestions, I propose that we re-run the 2005 audio melody extraction in 2006 i.e. use the same test data at least. We may subsequently come up with some improved metrics (particularly with a view to significance testing) but basically the results will be directly comparable with last year. --Dpwe 15:28, 23 March 2006 (CST)
Potential Participants
The following researchers have confirmed their interest in participating:
- Karin Dressler (Fraunhofer IDMT) - dresslkn@idmt.fraunhofer.de - Likely
Additional potential participants include:
- Graham Poliner and Dan Ellis (Columbia University)
- Emmanuel Vincent (Queen Mary, University of London)
- Rui Pedro Paiva (University of Coimbra)
- Matija Marolt (University of Ljubljana)
- Matti Ryynänen and Anssi Klapuri (Tampere University of Technology)
- Masataka Goto (AIST)
- Paul Brossier (Queen Mary, University of London)
Karin's comments
published and "secret" test data:
I would find it very usefull if melody extraction results are computed for two different data sets - one published (for example the ISMIR2004 data set), one "secret" (the MIREX2005 data set). This way the new results will be comparable with last year's results, and at the same time we gain a better insight into the performance of the algorithms in very specific situations, because we have access to the music files. I think this knowledge would be very valuable for the further development of the algorithms.
