MIREX Wiki - User contributions [en]

2012:Multiple Fundamental Frequency Estimation & Tracking Results

2012-10-03T23:47:56Z

Mertbay: /* General Legend */

==Introduction==
These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the [[2012:Multiple Fundamental Frequency Estimation & Tracking]] page.

==General Legend==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! BD1
| BenetosDixon MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/BD1.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD2
| BenetosDixon NoteTracking1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/BD2.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD3
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/BD3.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! CPG1
| Zhuo&DAn_MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG1.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham Grindlay]
|-
! CPG2
| CPG2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG2.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham Grindlay]
|-
! CPG3
| CPG3 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG3.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://perso.telecom-paristech.fr/~grichard/ Graham Grindlay]
|-
! FBR1
| FBR1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FBR1.pdf PDF] || [http://perso.telecom-paristech.fr/~fuentes/ Benoit Fuentes], [http://perso.telecom-paristech.fr/~rbadeau/ Roland Badeau] [http://www.ee.columbia.edu/~grindlay/ Gael Richard]
|-
! FBR2
| FBR || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FBR2.pdf PDF] || [http://perso.telecom-paristech.fr/~fuentes/ Benoit Fuentes], [http://perso.telecom-paristech.fr/~rbadeau/ Roland Badeau] [http://www.ee.columbia.edu/~grindlay/ Gael Richard]
|-
! FT1
| TAVTZAN || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FT1.pdf PDF] || [http://www.dca.fee.unicamp.br/~tavares Tiago Fernandes Tavares], [http://www.cs.uvic.ca/~gtzan George Tzanetakis]
|-
! KD1
| multif0 2012a || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/KD1.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! KD2
| multi f0 2012b || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/KD2.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! KD3
| multif0 2012c || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/KD3.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! SB5
| PianoTranscriptor || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/SB5.pdf PDF] || [http://www.cp.jku.at Sebastian Böck ]
|}

==Task 1: Multiple Fundamental Frequency Estimation (MF0E)==

===MF0E Overall Summary Results===
Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.

<csv>2012/mf0/est/summary/task1.overall.csv</csv>

====Detailed Results====

<csv>2012/mf0/est/summary/task1.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/est/summary/task1.chroma.results.csv</csv>

===Individual Results Files for Task 1===
'''BD1'''= [https://music-ir.org/mirex/results/2012/mf0/est/tars/BD1.tar.gz Emmanouil Benetos, Simon Dixon] 
'''CPG1'''= [https://music-ir.org/mirex/results/2012/mf0/est/tars/CPG1.tar.gz Zhuo Chen, Danile P.W. Ellis Graham Grindlay] 
'''CPG2'''= [https://music-ir.org/mirex/results/2012/mf0/est/tars/CPG2.tar.gz Zhuo Chen, Danile P.W. Ellis Graham Grindlay] 
'''CPG3'''= [https://music-ir.org/mirex/results/2012/mf0/est/tars/CPG3.tar.gz Zhuo Chen, Danile P.W. Ellis Graham Grindlay] 
'''FBR1'''= [https://music-ir.org/mirex/results/2012/mf0/est/tars/FBR1.tar.gz Benoit Fuentes, Roland Badeau Gael Richard] 
'''KD1'''= [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD1.tar.gz Karin Dressler ] 
'''KD2'''= [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD2.tar.gz Karin Dressler ] 

=====Info about the filenames=====
The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

'''bs''' = bassoon,
'''cl''' = clarinet,
'''fl''' = flute,
'''hn''' = horn,
'''ob''' = oboe,
'''vl''' = violin,
'''cel''' = cello,
'''gtr''' = guitar,
'''sax''' = saxophone,
'''bass''' = electric bass guitar

===Run Times===

<csv>2012/mf0/est/runtimes_mf0_2011.csv</csv>

===Friedman tests for Multiple Fundamental Frequency Estimation (MF0E)===
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the performance (accuracy) on individual files.

====Tukey-Kramer HSD Multi-Comparison====

<csv>2012/mf0/est/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_Mean_Ranks.png|500px]]

==Task 2:Note Tracking (NT)==
===NT Mixed Set Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.

A total of 34 files were used in this subtask: 16 from woodwind recording, 8 from IAL quintet recording and 6 piano.

<csv>2012/mf0/nt/summary/task2.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary/task2.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary/task2.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.chroma.results.csv</csv>

====Run Times====

TBD

====Friedman Tests for Note Tracking====
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the F-measure on individual files.

=====Tukey-Kramer HSD Multi-Comparison for Task2=====

<csv>2012/mf0/nt/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2012Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_Mean_Ranks.png|500px]]

===NT Piano-Only Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.
6 piano recordings are evaluated separately for this subtask.

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.chroma.results.csv</csv>

===Individual Results Files for Task 2===
'''BD2'''= [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD2.tar.gz Emmanouil Benetos, Simon Dixon] 
'''BD3'''= [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD3.tar.gz Emmanouil Benetos, Simon Dixon] 
'''CPG1'''= [https://music-ir.org/mirex/results/2012/mf0/nt/tars/CPG1.tar.gz Zhuo Chen, Danile P.W. Ellis Graham Grindlay] 
'''CPG2'''= [https://music-ir.org/mirex/results/2012/mf0/nt/tars/CPG2.tar.gz Zhuo Chen, Danile P.W. Ellis Graham Grindlay] 
'''CPG3'''= [https://music-ir.org/mirex/results/2012/mf0/nt/tars/CPG3.tar.gz Zhuo Chen, Danile P.W. Ellis Graham Grindlay] 
'''FBR2'''= [https://music-ir.org/mirex/results/2012/mf0/nt/tars/FBR2.tar.gz Benoit Fuentes, Roland Badeau Gael Richard] 
'''FT1'''= [https://music-ir.org/mirex/results/2012/mf0/nt/tars/FT1.tar.gz Candidate Tiago Fernandes, George Tzanetakis] 
'''KD3'''= [https://music-ir.org/mirex/results/2012/mf0/nt/tars/KD3.tar.gz Karin Dressler ] 
'''SB5'''= [https://music-ir.org/mirex/results/2012/mf0/nt/tars/SB5.tar.gz Sebastian Böck ]

2012:Multiple Fundamental Frequency Estimation & Tracking Results

2012-10-03T01:53:22Z

Mertbay: /* Individual Results Files for Task 2 */

==Introduction==
These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the [[2012:Multiple Fundamental Frequency Estimation & Tracking]] page.

==General Legend==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! BD1
| BenetosDixon MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/BD1.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD2
| BenetosDixon NoteTracking1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD2.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD3
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD3.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! CPG1
| Zhuo&DAn_MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG1.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham Grindlay]
|-
! CPG2
| CPG2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG2.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham Grindlay]
|-
! CPG3
| CPG3 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG3.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://perso.telecom-paristech.fr/~grichard/ Graham Grindlay]
|-
! FBR1
| FBR1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FBR1.pdf PDF] || [http://perso.telecom-paristech.fr/~fuentes/ Benoit Fuentes], [http://perso.telecom-paristech.fr/~rbadeau/ Roland Badeau] [http://www.ee.columbia.edu/~grindlay/ Gael Richard]
|-
! FBR2
| FBR || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FBR2.pdf PDF] || [http://perso.telecom-paristech.fr/~fuentes/ Benoit Fuentes], [http://perso.telecom-paristech.fr/~rbadeau/ Roland Badeau] [http://www.ee.columbia.edu/~grindlay/ Gael Richard]
|-
! FT1
| TAVTZAN || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FT1.pdf PDF] || [http://www.dca.fee.unicamp.br/~tavares Candidate Tiago Fernandes], [http://www.cs.uvic.ca/~gtzan George Tzanetakis]
|-
! KD1
| multif0 2012a || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/KD1.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! KD2
| multi f0 2012b || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/KD2.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! KD3
| multif0 2012c || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/KD3.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! SB5
| PianoTranscriptor || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/SB5.pdf PDF] || [http://www.cp.jku.at Sebastian Böck ]
|}

==Task 1: Multiple Fundamental Frequency Estimation (MF0E)==

===MF0E Overall Summary Results===
Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.

<csv>2012/mf0/est/summary/task1.overall.csv</csv>

====Detailed Results====

<csv>2012/mf0/est/summary/task1.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/est/summary/task1.chroma.results.csv</csv>

===Individual Results Files for Task 1===
'''BD1'''= [https://music-ir.org/mirex/results/2012/mf0/est/tars/BD1.tar.gz Emmanouil Benetos, Simon Dixon] 
'''CPG1'''= [https://music-ir.org/mirex/results/2012/mf0/est/tars/CPG1.tar.gz Zhuo Chen, Danile P.W. Ellis Graham Grindlay] 
'''CPG2'''= [https://music-ir.org/mirex/results/2012/mf0/est/tars/CPG2.tar.gz Zhuo Chen, Danile P.W. Ellis Graham Grindlay] 
'''CPG3'''= [https://music-ir.org/mirex/results/2012/mf0/est/tars/CPG3.tar.gz Zhuo Chen, Danile P.W. Ellis Graham Grindlay] 
'''FBR1'''= [https://music-ir.org/mirex/results/2012/mf0/est/tars/FBR1.tar.gz Benoit Fuentes, Roland Badeau Gael Richard] 
'''KD1'''= [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD1.tar.gz Karin Dressler ] 
'''KD2'''= [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD2.tar.gz Karin Dressler ] 

=====Info about the filenames=====
The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

'''bs''' = bassoon,
'''cl''' = clarinet,
'''fl''' = flute,
'''hn''' = horn,
'''ob''' = oboe,
'''vl''' = violin,
'''cel''' = cello,
'''gtr''' = guitar,
'''sax''' = saxophone,
'''bass''' = electric bass guitar

===Run Times===

<csv>2012/mf0/est/runtimes_mf0_2011.csv</csv>

===Friedman tests for Multiple Fundamental Frequency Estimation (MF0E)===
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the performance (accuracy) on individual files.

====Tukey-Kramer HSD Multi-Comparison====

<csv>2012/mf0/est/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_Mean_Ranks.png|500px]]

==Task 2:Note Tracking (NT)==
===NT Mixed Set Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.

A total of 34 files were used in this subtask: 16 from woodwind recording, 8 from IAL quintet recording and 6 piano.

<csv>2012/mf0/nt/summary/task2.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary/task2.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary/task2.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.chroma.results.csv</csv>

====Run Times====

TBD

====Friedman Tests for Note Tracking====
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the F-measure on individual files.

=====Tukey-Kramer HSD Multi-Comparison for Task2=====

<csv>2012/mf0/nt/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2012Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_Mean_Ranks.png|500px]]

===NT Piano-Only Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.
6 piano recordings are evaluated separately for this subtask.

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.chroma.results.csv</csv>

===Individual Results Files for Task 2===
'''BD2'''= [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD2.tar.gz Emmanouil Benetos, Simon Dixon] 
'''BD3'''= [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD3.tar.gz Emmanouil Benetos, Simon Dixon] 
'''CPG1'''= [https://music-ir.org/mirex/results/2012/mf0/nt/tars/CPG1.tar.gz Zhuo Chen, Danile P.W. Ellis Graham Grindlay] 
'''CPG2'''= [https://music-ir.org/mirex/results/2012/mf0/nt/tars/CPG2.tar.gz Zhuo Chen, Danile P.W. Ellis Graham Grindlay] 
'''CPG3'''= [https://music-ir.org/mirex/results/2012/mf0/nt/tars/CPG3.tar.gz Zhuo Chen, Danile P.W. Ellis Graham Grindlay] 
'''FBR2'''= [https://music-ir.org/mirex/results/2012/mf0/nt/tars/FBR2.tar.gz Benoit Fuentes, Roland Badeau Gael Richard] 
'''FT1'''= [https://music-ir.org/mirex/results/2012/mf0/nt/tars/FT1.tar.gz Candidate Tiago Fernandes, George Tzanetakis] 
'''KD3'''= [https://music-ir.org/mirex/results/2012/mf0/nt/tars/KD3.tar.gz Karin Dressler ] 
'''SB5'''= [https://music-ir.org/mirex/results/2012/mf0/nt/tars/SB5.tar.gz Sebastian Böck ]

2012:Multiple Fundamental Frequency Estimation & Tracking Results

2012-10-03T01:50:02Z

Mertbay: /* Individual Results Files for Task 1 */

==Introduction==
These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the [[2012:Multiple Fundamental Frequency Estimation & Tracking]] page.

==General Legend==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! BD1
| BenetosDixon MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/BD1.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD2
| BenetosDixon NoteTracking1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD2.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD3
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD3.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! CPG1
| Zhuo&DAn_MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG1.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham Grindlay]
|-
! CPG2
| CPG2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG2.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham Grindlay]
|-
! CPG3
| CPG3 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG3.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://perso.telecom-paristech.fr/~grichard/ Graham Grindlay]
|-
! FBR1
| FBR1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FBR1.pdf PDF] || [http://perso.telecom-paristech.fr/~fuentes/ Benoit Fuentes], [http://perso.telecom-paristech.fr/~rbadeau/ Roland Badeau] [http://www.ee.columbia.edu/~grindlay/ Gael Richard]
|-
! FBR2
| FBR || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FBR2.pdf PDF] || [http://perso.telecom-paristech.fr/~fuentes/ Benoit Fuentes], [http://perso.telecom-paristech.fr/~rbadeau/ Roland Badeau] [http://www.ee.columbia.edu/~grindlay/ Gael Richard]
|-
! FT1
| TAVTZAN || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FT1.pdf PDF] || [http://www.dca.fee.unicamp.br/~tavares Candidate Tiago Fernandes], [http://www.cs.uvic.ca/~gtzan George Tzanetakis]
|-
! KD1
| multif0 2012a || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/KD1.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! KD2
| multi f0 2012b || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/KD2.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! KD3
| multif0 2012c || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/KD3.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! SB5
| PianoTranscriptor || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/SB5.pdf PDF] || [http://www.cp.jku.at Sebastian Böck ]
|}

==Task 1: Multiple Fundamental Frequency Estimation (MF0E)==

===MF0E Overall Summary Results===
Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.

<csv>2012/mf0/est/summary/task1.overall.csv</csv>

====Detailed Results====

<csv>2012/mf0/est/summary/task1.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/est/summary/task1.chroma.results.csv</csv>

===Individual Results Files for Task 1===
'''BD1'''= [https://music-ir.org/mirex/results/2012/mf0/est/tars/BD1.tar.gz Emmanouil Benetos, Simon Dixon] 
'''CPG1'''= [https://music-ir.org/mirex/results/2012/mf0/est/tars/CPG1.tar.gz Zhuo Chen, Danile P.W. Ellis Graham Grindlay] 
'''CPG2'''= [https://music-ir.org/mirex/results/2012/mf0/est/tars/CPG2.tar.gz Zhuo Chen, Danile P.W. Ellis Graham Grindlay] 
'''CPG3'''= [https://music-ir.org/mirex/results/2012/mf0/est/tars/CPG3.tar.gz Zhuo Chen, Danile P.W. Ellis Graham Grindlay] 
'''FBR1'''= [https://music-ir.org/mirex/results/2012/mf0/est/tars/FBR1.tar.gz Benoit Fuentes, Roland Badeau Gael Richard] 
'''KD1'''= [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD1.tar.gz Karin Dressler ] 
'''KD2'''= [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD2.tar.gz Karin Dressler ] 

=====Info about the filenames=====
The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

'''bs''' = bassoon,
'''cl''' = clarinet,
'''fl''' = flute,
'''hn''' = horn,
'''ob''' = oboe,
'''vl''' = violin,
'''cel''' = cello,
'''gtr''' = guitar,
'''sax''' = saxophone,
'''bass''' = electric bass guitar

===Run Times===

<csv>2012/mf0/est/runtimes_mf0_2011.csv</csv>

===Friedman tests for Multiple Fundamental Frequency Estimation (MF0E)===
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the performance (accuracy) on individual files.

====Tukey-Kramer HSD Multi-Comparison====

<csv>2012/mf0/est/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_Mean_Ranks.png|500px]]

==Task 2:Note Tracking (NT)==
===NT Mixed Set Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.

A total of 34 files were used in this subtask: 16 from woodwind recording, 8 from IAL quintet recording and 6 piano.

<csv>2012/mf0/nt/summary/task2.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary/task2.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary/task2.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.chroma.results.csv</csv>

====Run Times====

TBD

====Friedman Tests for Note Tracking====
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the F-measure on individual files.

=====Tukey-Kramer HSD Multi-Comparison for Task2=====

<csv>2012/mf0/nt/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2012Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_Mean_Ranks.png|500px]]

===NT Piano-Only Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.
6 piano recordings are evaluated separately for this subtask.

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.chroma.results.csv</csv>

===Individual Results Files for Task 2===
'''BD2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD2.tar.gz Emmanouil Benetos, Simon Dixon] 
'''BD3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD3.tar.gz Emmanouil Benetos, Simon Dixon] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel]

2012:Multiple Fundamental Frequency Estimation & Tracking Results

2012-10-03T01:43:36Z

Mertbay: /* General Legend */

==Introduction==
These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the [[2012:Multiple Fundamental Frequency Estimation & Tracking]] page.

==General Legend==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! BD1
| BenetosDixon MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/BD1.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD2
| BenetosDixon NoteTracking1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD2.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD3
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD3.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! CPG1
| Zhuo&DAn_MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG1.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham Grindlay]
|-
! CPG2
| CPG2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG2.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham Grindlay]
|-
! CPG3
| CPG3 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG3.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://perso.telecom-paristech.fr/~grichard/ Graham Grindlay]
|-
! FBR1
| FBR1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FBR1.pdf PDF] || [http://perso.telecom-paristech.fr/~fuentes/ Benoit Fuentes], [http://perso.telecom-paristech.fr/~rbadeau/ Roland Badeau] [http://www.ee.columbia.edu/~grindlay/ Gael Richard]
|-
! FBR2
| FBR || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FBR2.pdf PDF] || [http://perso.telecom-paristech.fr/~fuentes/ Benoit Fuentes], [http://perso.telecom-paristech.fr/~rbadeau/ Roland Badeau] [http://www.ee.columbia.edu/~grindlay/ Gael Richard]
|-
! FT1
| TAVTZAN || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FT1.pdf PDF] || [http://www.dca.fee.unicamp.br/~tavares Candidate Tiago Fernandes], [http://www.cs.uvic.ca/~gtzan George Tzanetakis]
|-
! KD1
| multif0 2012a || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/KD1.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! KD2
| multi f0 2012b || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/KD2.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! KD3
| multif0 2012c || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/KD3.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! SB5
| PianoTranscriptor || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/SB5.pdf PDF] || [http://www.cp.jku.at Sebastian Böck ]
|}

==Task 1: Multiple Fundamental Frequency Estimation (MF0E)==

===MF0E Overall Summary Results===
Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.

<csv>2012/mf0/est/summary/task1.overall.csv</csv>

====Detailed Results====

<csv>2012/mf0/est/summary/task1.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/est/summary/task1.chroma.results.csv</csv>

===Individual Results Files for Task 1===
'''BD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/BD1.tar.gz Emmanouil Benetos, Simon Dixon] 
'''KD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD1.tar.gz Karin Dressler ] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR2.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR4''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR4.tar.gz Chunghsin YEH,Axel Roebel] 

=====Info about the filenames=====
The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

'''bs''' = bassoon,
'''cl''' = clarinet,
'''fl''' = flute,
'''hn''' = horn,
'''ob''' = oboe,
'''vl''' = violin,
'''cel''' = cello,
'''gtr''' = guitar,
'''sax''' = saxophone,
'''bass''' = electric bass guitar

===Run Times===

<csv>2012/mf0/est/runtimes_mf0_2011.csv</csv>

===Friedman tests for Multiple Fundamental Frequency Estimation (MF0E)===
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the performance (accuracy) on individual files.

====Tukey-Kramer HSD Multi-Comparison====

<csv>2012/mf0/est/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_Mean_Ranks.png|500px]]

==Task 2:Note Tracking (NT)==
===NT Mixed Set Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.

A total of 34 files were used in this subtask: 16 from woodwind recording, 8 from IAL quintet recording and 6 piano.

<csv>2012/mf0/nt/summary/task2.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary/task2.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary/task2.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.chroma.results.csv</csv>

====Run Times====

TBD

====Friedman Tests for Note Tracking====
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the F-measure on individual files.

=====Tukey-Kramer HSD Multi-Comparison for Task2=====

<csv>2012/mf0/nt/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2012Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_Mean_Ranks.png|500px]]

===NT Piano-Only Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.
6 piano recordings are evaluated separately for this subtask.

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.chroma.results.csv</csv>

===Individual Results Files for Task 2===
'''BD2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD2.tar.gz Emmanouil Benetos, Simon Dixon] 
'''BD3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD3.tar.gz Emmanouil Benetos, Simon Dixon] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel]

2012:Multiple Fundamental Frequency Estimation & Tracking Results

2012-10-03T01:42:06Z

Mertbay: /* General Legend */

==Introduction==
These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the [[2012:Multiple Fundamental Frequency Estimation & Tracking]] page.

==General Legend==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! BD1
| BenetosDixon MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/BD1.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD2
| BenetosDixon NoteTracking1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD2.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD3
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD3.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! CPG1
| Zhuo&DAn_MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG1.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham Grindlay]
|-
! CPG2
| CPG2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG2.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham Grindlay]
|-
! CPG3
| CPG3 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG3.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://perso.telecom-paristech.fr/~grichard/ Graham Grindlay]
|-
! FBR1
| FBR1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FBR1.pdf PDF] || [http://perso.telecom-paristech.fr/~fuentes/ Benoit Fuentes], [http://perso.telecom-paristech.fr/~rbadeau/ Roland Badeau] [http://www.ee.columbia.edu/~grindlay/ Gael Richard]
|-
! FBR2
| FBR || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FBR2.pdf PDF] || [http://perso.telecom-paristech.fr/~fuentes/ Benoit Fuentes], [http://perso.telecom-paristech.fr/~rbadeau/ Roland Badeau] [http://www.ee.columbia.edu/~grindlay/ Gael Richard]
|-
! FT1
| TAVTZAN || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FT1.pdf PDF] || [http://www.dca.fee.unicamp.br/~tavares Candidate Tiago Fernandes], [http://www.cs.uvic.ca/~gtzan George Tzanetakis]
|-
! KD1
| multif0 2012a || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/KD1.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! KD2
| multi f0 2012b || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/KD2.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! KD3
| multif0 2012c || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/KD3.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|}

==Task 1: Multiple Fundamental Frequency Estimation (MF0E)==

===MF0E Overall Summary Results===
Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.

<csv>2012/mf0/est/summary/task1.overall.csv</csv>

====Detailed Results====

<csv>2012/mf0/est/summary/task1.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/est/summary/task1.chroma.results.csv</csv>

===Individual Results Files for Task 1===
'''BD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/BD1.tar.gz Emmanouil Benetos, Simon Dixon] 
'''KD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD1.tar.gz Karin Dressler ] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR2.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR4''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR4.tar.gz Chunghsin YEH,Axel Roebel] 

=====Info about the filenames=====
The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

'''bs''' = bassoon,
'''cl''' = clarinet,
'''fl''' = flute,
'''hn''' = horn,
'''ob''' = oboe,
'''vl''' = violin,
'''cel''' = cello,
'''gtr''' = guitar,
'''sax''' = saxophone,
'''bass''' = electric bass guitar

===Run Times===

<csv>2012/mf0/est/runtimes_mf0_2011.csv</csv>

===Friedman tests for Multiple Fundamental Frequency Estimation (MF0E)===
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the performance (accuracy) on individual files.

====Tukey-Kramer HSD Multi-Comparison====

<csv>2012/mf0/est/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_Mean_Ranks.png|500px]]

==Task 2:Note Tracking (NT)==
===NT Mixed Set Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.

A total of 34 files were used in this subtask: 16 from woodwind recording, 8 from IAL quintet recording and 6 piano.

<csv>2012/mf0/nt/summary/task2.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary/task2.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary/task2.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.chroma.results.csv</csv>

====Run Times====

TBD

====Friedman Tests for Note Tracking====
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the F-measure on individual files.

=====Tukey-Kramer HSD Multi-Comparison for Task2=====

<csv>2012/mf0/nt/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2012Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_Mean_Ranks.png|500px]]

===NT Piano-Only Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.
6 piano recordings are evaluated separately for this subtask.

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.chroma.results.csv</csv>

===Individual Results Files for Task 2===
'''BD2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD2.tar.gz Emmanouil Benetos, Simon Dixon] 
'''BD3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD3.tar.gz Emmanouil Benetos, Simon Dixon] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel]

2012:Multiple Fundamental Frequency Estimation & Tracking Results

2012-10-03T01:39:49Z

Mertbay: /* General Legend */

==Introduction==
These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the [[2012:Multiple Fundamental Frequency Estimation & Tracking]] page.

==General Legend==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! BD1
| BenetosDixon MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/BD1.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD2
| BenetosDixon NoteTracking1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD2.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD3
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD3.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! CPG1
| Zhuo&DAn_MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG1.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham Grindlay]
|-
! CPG2
| CPG2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG2.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham Grindlay]
|-
! CPG3
| CPG3 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG3.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://perso.telecom-paristech.fr/~grichard/ Graham Grindlay]
|-
! FBR1
| FBR1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FBR1.pdf PDF] || [http://perso.telecom-paristech.fr/~fuentes/ Benoit Fuentes], [http://perso.telecom-paristech.fr/~rbadeau/ Roland Badeau] [http://www.ee.columbia.edu/~grindlay/ Gael Richard]
|-
! FBR2
| FBR || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FBR2.pdf PDF] || [http://perso.telecom-paristech.fr/~fuentes/ Benoit Fuentes], [http://perso.telecom-paristech.fr/~rbadeau/ Roland Badeau] [http://www.ee.columbia.edu/~grindlay/ Gael Richard]
|-
! FT1
| TAVTZAN || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FT1.pdf PDF] || [http://www.dca.fee.unicamp.br/~tavares Candidate Tiago Fernandes], [http://www.cs.uvic.ca/~gtzan George Tzanetakis]
|-
! KD1
| Karin Dressler || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/KD1.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]

|}

==Task 1: Multiple Fundamental Frequency Estimation (MF0E)==

===MF0E Overall Summary Results===
Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.

<csv>2012/mf0/est/summary/task1.overall.csv</csv>

====Detailed Results====

<csv>2012/mf0/est/summary/task1.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/est/summary/task1.chroma.results.csv</csv>

===Individual Results Files for Task 1===
'''BD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/BD1.tar.gz Emmanouil Benetos, Simon Dixon] 
'''KD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD1.tar.gz Karin Dressler ] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR2.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR4''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR4.tar.gz Chunghsin YEH,Axel Roebel] 

=====Info about the filenames=====
The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

'''bs''' = bassoon,
'''cl''' = clarinet,
'''fl''' = flute,
'''hn''' = horn,
'''ob''' = oboe,
'''vl''' = violin,
'''cel''' = cello,
'''gtr''' = guitar,
'''sax''' = saxophone,
'''bass''' = electric bass guitar

===Run Times===

<csv>2012/mf0/est/runtimes_mf0_2011.csv</csv>

===Friedman tests for Multiple Fundamental Frequency Estimation (MF0E)===
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the performance (accuracy) on individual files.

====Tukey-Kramer HSD Multi-Comparison====

<csv>2012/mf0/est/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_Mean_Ranks.png|500px]]

==Task 2:Note Tracking (NT)==
===NT Mixed Set Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.

A total of 34 files were used in this subtask: 16 from woodwind recording, 8 from IAL quintet recording and 6 piano.

<csv>2012/mf0/nt/summary/task2.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary/task2.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary/task2.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.chroma.results.csv</csv>

====Run Times====

TBD

====Friedman Tests for Note Tracking====
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the F-measure on individual files.

=====Tukey-Kramer HSD Multi-Comparison for Task2=====

<csv>2012/mf0/nt/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2012Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_Mean_Ranks.png|500px]]

===NT Piano-Only Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.
6 piano recordings are evaluated separately for this subtask.

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.chroma.results.csv</csv>

===Individual Results Files for Task 2===
'''BD2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD2.tar.gz Emmanouil Benetos, Simon Dixon] 
'''BD3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD3.tar.gz Emmanouil Benetos, Simon Dixon] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel]

2012:Multiple Fundamental Frequency Estimation & Tracking Results

2012-10-03T01:37:20Z

Mertbay: /* General Legend */

==Introduction==
These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the [[2012:Multiple Fundamental Frequency Estimation & Tracking]] page.

==General Legend==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! BD1
| BenetosDixon MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/BD1.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD2
| BenetosDixon NoteTracking1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD2.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD3
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD3.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! CPG1
| Zhuo&DAn_MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG1.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham Grindlay]
|-
! CPG2
| CPG2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG2.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham Grindlay]
|-
! CPG3
| CPG3 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG3.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://perso.telecom-paristech.fr/~grichard/ Graham Grindlay]
|-
! FBR1
| FBR1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FBR1.pdf PDF] || [http://perso.telecom-paristech.fr/~fuentes/ Benoit Fuentes], [http://perso.telecom-paristech.fr/~rbadeau/ Roland;Badeau] [http://www.ee.columbia.edu/~grindlay/ Gael Richard]
|-
! FBR2
| FBR || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FBR2.pdf PDF] || [http://perso.telecom-paristech.fr/~fuentes/ Benoit Fuentes], [http://perso.telecom-paristech.fr/~rbadeau/ Roland;Badeau] [http://www.ee.columbia.edu/~grindlay/ Gael Richard]
|-
! KD1
| Karin Dressler || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/KD1.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]

|}

==Task 1: Multiple Fundamental Frequency Estimation (MF0E)==

===MF0E Overall Summary Results===
Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.

<csv>2012/mf0/est/summary/task1.overall.csv</csv>

====Detailed Results====

<csv>2012/mf0/est/summary/task1.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/est/summary/task1.chroma.results.csv</csv>

===Individual Results Files for Task 1===
'''BD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/BD1.tar.gz Emmanouil Benetos, Simon Dixon] 
'''KD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD1.tar.gz Karin Dressler ] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR2.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR4''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR4.tar.gz Chunghsin YEH,Axel Roebel] 

=====Info about the filenames=====
The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

'''bs''' = bassoon,
'''cl''' = clarinet,
'''fl''' = flute,
'''hn''' = horn,
'''ob''' = oboe,
'''vl''' = violin,
'''cel''' = cello,
'''gtr''' = guitar,
'''sax''' = saxophone,
'''bass''' = electric bass guitar

===Run Times===

<csv>2012/mf0/est/runtimes_mf0_2011.csv</csv>

===Friedman tests for Multiple Fundamental Frequency Estimation (MF0E)===
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the performance (accuracy) on individual files.

====Tukey-Kramer HSD Multi-Comparison====

<csv>2012/mf0/est/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_Mean_Ranks.png|500px]]

==Task 2:Note Tracking (NT)==
===NT Mixed Set Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.

A total of 34 files were used in this subtask: 16 from woodwind recording, 8 from IAL quintet recording and 6 piano.

<csv>2012/mf0/nt/summary/task2.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary/task2.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary/task2.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.chroma.results.csv</csv>

====Run Times====

TBD

====Friedman Tests for Note Tracking====
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the F-measure on individual files.

=====Tukey-Kramer HSD Multi-Comparison for Task2=====

<csv>2012/mf0/nt/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2012Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_Mean_Ranks.png|500px]]

===NT Piano-Only Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.
6 piano recordings are evaluated separately for this subtask.

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.chroma.results.csv</csv>

===Individual Results Files for Task 2===
'''BD2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD2.tar.gz Emmanouil Benetos, Simon Dixon] 
'''BD3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD3.tar.gz Emmanouil Benetos, Simon Dixon] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel]

2012:Multiple Fundamental Frequency Estimation & Tracking Results

2012-10-03T01:36:20Z

Mertbay: /* General Legend */

==Introduction==
These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the [[2012:Multiple Fundamental Frequency Estimation & Tracking]] page.

==General Legend==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! BD1
| BenetosDixon MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/BD1.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD2
| BenetosDixon NoteTracking1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD2.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD3
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD3.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! CPG1
| Zhuo&DAn_MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG1.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham Grindlay]
|-
! CPG2
| CPG2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG2.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham Grindlay]
|-
! CPG3
| CPG3 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG3.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://perso.telecom-paristech.fr/~grichard/ Graham Grindlay]
|-
! FBR1
| FBR1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FBR1.pdf PDF] || [http://perso.telecom-paristech.fr/~fuentes/ Benoit Fuentes], [http://perso.telecom-paristech.fr/~rbadeau/ Roland;Badeau] [http://www.ee.columbia.edu/~grindlay/ Gael Richard]
|-
! KD1
| Karin Dressler || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/KD1.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]

|}

==Task 1: Multiple Fundamental Frequency Estimation (MF0E)==

===MF0E Overall Summary Results===
Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.

<csv>2012/mf0/est/summary/task1.overall.csv</csv>

====Detailed Results====

<csv>2012/mf0/est/summary/task1.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/est/summary/task1.chroma.results.csv</csv>

===Individual Results Files for Task 1===
'''BD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/BD1.tar.gz Emmanouil Benetos, Simon Dixon] 
'''KD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD1.tar.gz Karin Dressler ] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR2.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR4''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR4.tar.gz Chunghsin YEH,Axel Roebel] 

=====Info about the filenames=====
The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

'''bs''' = bassoon,
'''cl''' = clarinet,
'''fl''' = flute,
'''hn''' = horn,
'''ob''' = oboe,
'''vl''' = violin,
'''cel''' = cello,
'''gtr''' = guitar,
'''sax''' = saxophone,
'''bass''' = electric bass guitar

===Run Times===

<csv>2012/mf0/est/runtimes_mf0_2011.csv</csv>

===Friedman tests for Multiple Fundamental Frequency Estimation (MF0E)===
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the performance (accuracy) on individual files.

====Tukey-Kramer HSD Multi-Comparison====

<csv>2012/mf0/est/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_Mean_Ranks.png|500px]]

==Task 2:Note Tracking (NT)==
===NT Mixed Set Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.

A total of 34 files were used in this subtask: 16 from woodwind recording, 8 from IAL quintet recording and 6 piano.

<csv>2012/mf0/nt/summary/task2.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary/task2.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary/task2.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.chroma.results.csv</csv>

====Run Times====

TBD

====Friedman Tests for Note Tracking====
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the F-measure on individual files.

=====Tukey-Kramer HSD Multi-Comparison for Task2=====

<csv>2012/mf0/nt/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2012Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_Mean_Ranks.png|500px]]

===NT Piano-Only Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.
6 piano recordings are evaluated separately for this subtask.

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.chroma.results.csv</csv>

===Individual Results Files for Task 2===
'''BD2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD2.tar.gz Emmanouil Benetos, Simon Dixon] 
'''BD3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD3.tar.gz Emmanouil Benetos, Simon Dixon] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel]

2012:Multiple Fundamental Frequency Estimation & Tracking Results

2012-10-03T01:35:40Z

Mertbay: /* General Legend */

==Introduction==
These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the [[2012:Multiple Fundamental Frequency Estimation & Tracking]] page.

==General Legend==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! BD1
| BenetosDixon MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/BD1.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD2
| BenetosDixon NoteTracking1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD2.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD3
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD3.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! CPG1
| Zhuo&DAn_MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG1.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham Grindlay]
|-
! CPG2
| CPG2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG2.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham Grindlay]
|-
! CPG3
| CPG3 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG3.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://perso.telecom-paristech.fr/~grichard/ Gael Richard]
|-
! FBR1
| FBR1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/FBR1.pdf PDF] || [http://perso.telecom-paristech.fr/~fuentes/ Benoit Fuentes], [http://perso.telecom-paristech.fr/~rbadeau/ Roland;Badeau] [http://www.ee.columbia.edu/~grindlay/ Graham;Grindlay]
|-
! KD1
| Karin Dressler || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/KD1.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]

|}

==Task 1: Multiple Fundamental Frequency Estimation (MF0E)==

===MF0E Overall Summary Results===
Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.

<csv>2012/mf0/est/summary/task1.overall.csv</csv>

====Detailed Results====

<csv>2012/mf0/est/summary/task1.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/est/summary/task1.chroma.results.csv</csv>

===Individual Results Files for Task 1===
'''BD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/BD1.tar.gz Emmanouil Benetos, Simon Dixon] 
'''KD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD1.tar.gz Karin Dressler ] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR2.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR4''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR4.tar.gz Chunghsin YEH,Axel Roebel] 

=====Info about the filenames=====
The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

'''bs''' = bassoon,
'''cl''' = clarinet,
'''fl''' = flute,
'''hn''' = horn,
'''ob''' = oboe,
'''vl''' = violin,
'''cel''' = cello,
'''gtr''' = guitar,
'''sax''' = saxophone,
'''bass''' = electric bass guitar

===Run Times===

<csv>2012/mf0/est/runtimes_mf0_2011.csv</csv>

===Friedman tests for Multiple Fundamental Frequency Estimation (MF0E)===
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the performance (accuracy) on individual files.

====Tukey-Kramer HSD Multi-Comparison====

<csv>2012/mf0/est/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_Mean_Ranks.png|500px]]

==Task 2:Note Tracking (NT)==
===NT Mixed Set Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.

A total of 34 files were used in this subtask: 16 from woodwind recording, 8 from IAL quintet recording and 6 piano.

<csv>2012/mf0/nt/summary/task2.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary/task2.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary/task2.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.chroma.results.csv</csv>

====Run Times====

TBD

====Friedman Tests for Note Tracking====
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the F-measure on individual files.

=====Tukey-Kramer HSD Multi-Comparison for Task2=====

<csv>2012/mf0/nt/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2012Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_Mean_Ranks.png|500px]]

===NT Piano-Only Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.
6 piano recordings are evaluated separately for this subtask.

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.chroma.results.csv</csv>

===Individual Results Files for Task 2===
'''BD2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD2.tar.gz Emmanouil Benetos, Simon Dixon] 
'''BD3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD3.tar.gz Emmanouil Benetos, Simon Dixon] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel]

2012:Multiple Fundamental Frequency Estimation & Tracking Results

2012-10-03T01:32:32Z

Mertbay: /* General Legend */

==Introduction==
These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the [[2012:Multiple Fundamental Frequency Estimation & Tracking]] page.

==General Legend==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! BD1
| BenetosDixon MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/BD1.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD2
| BenetosDixon NoteTracking1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD2.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD3
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD3.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! CPG1
| Zhuo&DAn_MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG1.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham;Grindlay]
|-
! CPG2
| CPG2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG2.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham;Grindlay]
|-
! CPG3
| CPG3 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG3.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham;Grindlay]
|-
! KD1
| Karin Dressler || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/KD1.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]

|}

==Task 1: Multiple Fundamental Frequency Estimation (MF0E)==

===MF0E Overall Summary Results===
Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.

<csv>2012/mf0/est/summary/task1.overall.csv</csv>

====Detailed Results====

<csv>2012/mf0/est/summary/task1.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/est/summary/task1.chroma.results.csv</csv>

===Individual Results Files for Task 1===
'''BD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/BD1.tar.gz Emmanouil Benetos, Simon Dixon] 
'''KD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD1.tar.gz Karin Dressler ] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR2.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR4''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR4.tar.gz Chunghsin YEH,Axel Roebel] 

=====Info about the filenames=====
The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

'''bs''' = bassoon,
'''cl''' = clarinet,
'''fl''' = flute,
'''hn''' = horn,
'''ob''' = oboe,
'''vl''' = violin,
'''cel''' = cello,
'''gtr''' = guitar,
'''sax''' = saxophone,
'''bass''' = electric bass guitar

===Run Times===

<csv>2012/mf0/est/runtimes_mf0_2011.csv</csv>

===Friedman tests for Multiple Fundamental Frequency Estimation (MF0E)===
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the performance (accuracy) on individual files.

====Tukey-Kramer HSD Multi-Comparison====

<csv>2012/mf0/est/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_Mean_Ranks.png|500px]]

==Task 2:Note Tracking (NT)==
===NT Mixed Set Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.

A total of 34 files were used in this subtask: 16 from woodwind recording, 8 from IAL quintet recording and 6 piano.

<csv>2012/mf0/nt/summary/task2.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary/task2.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary/task2.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.chroma.results.csv</csv>

====Run Times====

TBD

====Friedman Tests for Note Tracking====
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the F-measure on individual files.

=====Tukey-Kramer HSD Multi-Comparison for Task2=====

<csv>2012/mf0/nt/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2012Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_Mean_Ranks.png|500px]]

===NT Piano-Only Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.
6 piano recordings are evaluated separately for this subtask.

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.chroma.results.csv</csv>

===Individual Results Files for Task 2===
'''BD2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD2.tar.gz Emmanouil Benetos, Simon Dixon] 
'''BD3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD3.tar.gz Emmanouil Benetos, Simon Dixon] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel]

2012:Multiple Fundamental Frequency Estimation & Tracking Results

2012-10-03T01:31:05Z

Mertbay: /* General Legend */

==Introduction==
These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the [[2012:Multiple Fundamental Frequency Estimation & Tracking]] page.

==General Legend==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! BD1
| BenetosDixon MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/BD1.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD2
| BenetosDixon NoteTracking1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD2.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD3
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD3.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! CPG1
| Zhuo&DAn_MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG1.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham;Grindlay]
|-
! KD1
| Karin Dressler || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/KD1.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]

|}

==Task 1: Multiple Fundamental Frequency Estimation (MF0E)==

===MF0E Overall Summary Results===
Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.

<csv>2012/mf0/est/summary/task1.overall.csv</csv>

====Detailed Results====

<csv>2012/mf0/est/summary/task1.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/est/summary/task1.chroma.results.csv</csv>

===Individual Results Files for Task 1===
'''BD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/BD1.tar.gz Emmanouil Benetos, Simon Dixon] 
'''KD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD1.tar.gz Karin Dressler ] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR2.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR4''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR4.tar.gz Chunghsin YEH,Axel Roebel] 

=====Info about the filenames=====
The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

'''bs''' = bassoon,
'''cl''' = clarinet,
'''fl''' = flute,
'''hn''' = horn,
'''ob''' = oboe,
'''vl''' = violin,
'''cel''' = cello,
'''gtr''' = guitar,
'''sax''' = saxophone,
'''bass''' = electric bass guitar

===Run Times===

<csv>2012/mf0/est/runtimes_mf0_2011.csv</csv>

===Friedman tests for Multiple Fundamental Frequency Estimation (MF0E)===
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the performance (accuracy) on individual files.

====Tukey-Kramer HSD Multi-Comparison====

<csv>2012/mf0/est/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_Mean_Ranks.png|500px]]

==Task 2:Note Tracking (NT)==
===NT Mixed Set Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.

A total of 34 files were used in this subtask: 16 from woodwind recording, 8 from IAL quintet recording and 6 piano.

<csv>2012/mf0/nt/summary/task2.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary/task2.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary/task2.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.chroma.results.csv</csv>

====Run Times====

TBD

====Friedman Tests for Note Tracking====
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the F-measure on individual files.

=====Tukey-Kramer HSD Multi-Comparison for Task2=====

<csv>2012/mf0/nt/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2012Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_Mean_Ranks.png|500px]]

===NT Piano-Only Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.
6 piano recordings are evaluated separately for this subtask.

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.chroma.results.csv</csv>

===Individual Results Files for Task 2===
'''BD2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD2.tar.gz Emmanouil Benetos, Simon Dixon] 
'''BD3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD3.tar.gz Emmanouil Benetos, Simon Dixon] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel]

2012:Multiple Fundamental Frequency Estimation & Tracking Results

2012-10-03T01:30:39Z

Mertbay: /* General Legend */

==Introduction==
These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the [[2012:Multiple Fundamental Frequency Estimation & Tracking]] page.

==General Legend==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! BD1
| BenetosDixon MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/BD1.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD2
| BenetosDixon NoteTracking1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD2.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD3
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD3.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! CPG1
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2012/CPG1.pdf PDF] || [http://labrosa.ee.columbia.edu/ Zhuo Chen], [http://www.ee.columbia.edu/~dpwe/ Danile P.W. Ellis] [http://www.ee.columbia.edu/~grindlay/ Graham;Grindlay]
|-
! KD1
| Karin Dressler || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/KD1.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]

|}

==Task 1: Multiple Fundamental Frequency Estimation (MF0E)==

===MF0E Overall Summary Results===
Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.

<csv>2012/mf0/est/summary/task1.overall.csv</csv>

====Detailed Results====

<csv>2012/mf0/est/summary/task1.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/est/summary/task1.chroma.results.csv</csv>

===Individual Results Files for Task 1===
'''BD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/BD1.tar.gz Emmanouil Benetos, Simon Dixon] 
'''KD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD1.tar.gz Karin Dressler ] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR2.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR4''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR4.tar.gz Chunghsin YEH,Axel Roebel] 

=====Info about the filenames=====
The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

'''bs''' = bassoon,
'''cl''' = clarinet,
'''fl''' = flute,
'''hn''' = horn,
'''ob''' = oboe,
'''vl''' = violin,
'''cel''' = cello,
'''gtr''' = guitar,
'''sax''' = saxophone,
'''bass''' = electric bass guitar

===Run Times===

<csv>2012/mf0/est/runtimes_mf0_2011.csv</csv>

===Friedman tests for Multiple Fundamental Frequency Estimation (MF0E)===
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the performance (accuracy) on individual files.

====Tukey-Kramer HSD Multi-Comparison====

<csv>2012/mf0/est/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_Mean_Ranks.png|500px]]

==Task 2:Note Tracking (NT)==
===NT Mixed Set Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.

A total of 34 files were used in this subtask: 16 from woodwind recording, 8 from IAL quintet recording and 6 piano.

<csv>2012/mf0/nt/summary/task2.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary/task2.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary/task2.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.chroma.results.csv</csv>

====Run Times====

TBD

====Friedman Tests for Note Tracking====
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the F-measure on individual files.

=====Tukey-Kramer HSD Multi-Comparison for Task2=====

<csv>2012/mf0/nt/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2012Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_Mean_Ranks.png|500px]]

===NT Piano-Only Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.
6 piano recordings are evaluated separately for this subtask.

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.chroma.results.csv</csv>

===Individual Results Files for Task 2===
'''BD2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD2.tar.gz Emmanouil Benetos, Simon Dixon] 
'''BD3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD3.tar.gz Emmanouil Benetos, Simon Dixon] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel]

2012:Multiple Fundamental Frequency Estimation & Tracking Results

2012-10-03T01:24:22Z

Mertbay: /* General Legend */

==Introduction==
These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the [[2012:Multiple Fundamental Frequency Estimation & Tracking]] page.

==General Legend==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! BD1
| BenetosDixon MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD1.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD2
| BenetosDixon NoteTracking1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD2.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD3
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD3.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! KD1
| Karin Dressler || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/KD1.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]

|}

==Task 1: Multiple Fundamental Frequency Estimation (MF0E)==

===MF0E Overall Summary Results===
Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.

<csv>2012/mf0/est/summary/task1.overall.csv</csv>

====Detailed Results====

<csv>2012/mf0/est/summary/task1.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/est/summary/task1.chroma.results.csv</csv>

===Individual Results Files for Task 1===
'''BD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/BD1.tar.gz Emmanouil Benetos, Simon Dixon] 
'''KD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD1.tar.gz Karin Dressler ] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR2.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR4''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR4.tar.gz Chunghsin YEH,Axel Roebel] 

=====Info about the filenames=====
The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

'''bs''' = bassoon,
'''cl''' = clarinet,
'''fl''' = flute,
'''hn''' = horn,
'''ob''' = oboe,
'''vl''' = violin,
'''cel''' = cello,
'''gtr''' = guitar,
'''sax''' = saxophone,
'''bass''' = electric bass guitar

===Run Times===

<csv>2012/mf0/est/runtimes_mf0_2011.csv</csv>

===Friedman tests for Multiple Fundamental Frequency Estimation (MF0E)===
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the performance (accuracy) on individual files.

====Tukey-Kramer HSD Multi-Comparison====

<csv>2012/mf0/est/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_Mean_Ranks.png|500px]]

==Task 2:Note Tracking (NT)==
===NT Mixed Set Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.

A total of 34 files were used in this subtask: 16 from woodwind recording, 8 from IAL quintet recording and 6 piano.

<csv>2012/mf0/nt/summary/task2.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary/task2.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary/task2.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.chroma.results.csv</csv>

====Run Times====

TBD

====Friedman Tests for Note Tracking====
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the F-measure on individual files.

=====Tukey-Kramer HSD Multi-Comparison for Task2=====

<csv>2012/mf0/nt/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2012Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_Mean_Ranks.png|500px]]

===NT Piano-Only Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.
6 piano recordings are evaluated separately for this subtask.

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.chroma.results.csv</csv>

===Individual Results Files for Task 2===
'''BD2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD2.tar.gz Emmanouil Benetos, Simon Dixon] 
'''BD3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD3.tar.gz Emmanouil Benetos, Simon Dixon] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel]

2012:Multiple Fundamental Frequency Estimation & Tracking Results

2012-10-03T01:23:32Z

Mertbay: /* Introduction */

==Introduction==
These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the [[2012:Multiple Fundamental Frequency Estimation & Tracking]] page.

==General Legend==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! BD1
| BenetosDixon MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD1.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD2
| BenetosDixon NoteTracking1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD2.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD3
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD3.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! KD1
| Karin Dressler || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/KD1.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! LYC1
| LYC || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/LYC1.pdf PDF] || [http://mpac.ee.ntu.edu.tw/~ader888/ Cheng-Te Lee], [http://mpac.ee.ntu.edu.tw/~yihsuan/ Yi-Hsuan Yang],[http://mpac.ee.ntu.edu.tw/people.php Homer Chen]
|-
! RFF1
| AlgorithmUsingPianoSamples || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/RFF1.pdf PDF] || [http://www.estg.ipleiria.pt/~gustavo.reis/ Gustavo Reis],[http:///sites.google.com/site/fcofdezdevegaweb/ Francisco Fernandéz ],[http://http://paginas.fe.up.pt/~ajf/ Aníbal Ferreira ]
|-
! RFF2
| MultiTimbralInternalSamples || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/RFF2.pdf PDF] || [http://www.estg.ipleiria.pt/~gustavo.reis/ Gustavo Reis],[http:///sites.google.com/site/fcofdezdevegaweb/ Francisco Fernandéz ],[http://http://paginas.fe.up.pt/~ajf/ Aníbal Ferreira ]
|-
! YR1
| MultiF0_Yeh_IRCAM f0FrmFile || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]
|-
! YR2
| MultiF0_Yeh_IRCAM f0TrkFile || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]
|-
! YR3
| MultiF0_Yeh_IRCAM f0FrmFile -c || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]

|-
! YR4
| MultiF0_Yeh_IRCAM f0TrkFile -c || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]

|}

==Task 1: Multiple Fundamental Frequency Estimation (MF0E)==

===MF0E Overall Summary Results===
Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.

<csv>2012/mf0/est/summary/task1.overall.csv</csv>

====Detailed Results====

<csv>2012/mf0/est/summary/task1.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/est/summary/task1.chroma.results.csv</csv>

===Individual Results Files for Task 1===
'''BD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/BD1.tar.gz Emmanouil Benetos, Simon Dixon] 
'''KD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD1.tar.gz Karin Dressler ] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR2.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR4''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR4.tar.gz Chunghsin YEH,Axel Roebel] 

=====Info about the filenames=====
The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

'''bs''' = bassoon,
'''cl''' = clarinet,
'''fl''' = flute,
'''hn''' = horn,
'''ob''' = oboe,
'''vl''' = violin,
'''cel''' = cello,
'''gtr''' = guitar,
'''sax''' = saxophone,
'''bass''' = electric bass guitar

===Run Times===

<csv>2012/mf0/est/runtimes_mf0_2011.csv</csv>

===Friedman tests for Multiple Fundamental Frequency Estimation (MF0E)===
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the performance (accuracy) on individual files.

====Tukey-Kramer HSD Multi-Comparison====

<csv>2012/mf0/est/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_Mean_Ranks.png|500px]]

==Task 2:Note Tracking (NT)==
===NT Mixed Set Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.

A total of 34 files were used in this subtask: 16 from woodwind recording, 8 from IAL quintet recording and 6 piano.

<csv>2012/mf0/nt/summary/task2.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary/task2.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary/task2.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.chroma.results.csv</csv>

====Run Times====

TBD

====Friedman Tests for Note Tracking====
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the F-measure on individual files.

=====Tukey-Kramer HSD Multi-Comparison for Task2=====

<csv>2012/mf0/nt/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2012Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_Mean_Ranks.png|500px]]

===NT Piano-Only Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.
6 piano recordings are evaluated separately for this subtask.

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.chroma.results.csv</csv>

===Individual Results Files for Task 2===
'''BD2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD2.tar.gz Emmanouil Benetos, Simon Dixon] 
'''BD3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD3.tar.gz Emmanouil Benetos, Simon Dixon] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel]

File:2012Accuracy Per Song Friedman Mean Rankstask2.friedman.Friedman Mean Ranks.png

2012-10-03T00:35:36Z

Mertbay:

2012:Multiple Fundamental Frequency Estimation & Tracking Results

2012-10-03T00:35:02Z

Mertbay: /* Tukey-Kramer HSD Multi-Comparison for Task2 */

==Introduction==
These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the [[2011:Multiple Fundamental Frequency Estimation & Tracking]] page.

==General Legend==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! BD1
| BenetosDixon MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD1.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD2
| BenetosDixon NoteTracking1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD2.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD3
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD3.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! KD1
| Karin Dressler || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/KD1.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! LYC1
| LYC || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/LYC1.pdf PDF] || [http://mpac.ee.ntu.edu.tw/~ader888/ Cheng-Te Lee], [http://mpac.ee.ntu.edu.tw/~yihsuan/ Yi-Hsuan Yang],[http://mpac.ee.ntu.edu.tw/people.php Homer Chen]
|-
! RFF1
| AlgorithmUsingPianoSamples || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/RFF1.pdf PDF] || [http://www.estg.ipleiria.pt/~gustavo.reis/ Gustavo Reis],[http:///sites.google.com/site/fcofdezdevegaweb/ Francisco Fernandéz ],[http://http://paginas.fe.up.pt/~ajf/ Aníbal Ferreira ]
|-
! RFF2
| MultiTimbralInternalSamples || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/RFF2.pdf PDF] || [http://www.estg.ipleiria.pt/~gustavo.reis/ Gustavo Reis],[http:///sites.google.com/site/fcofdezdevegaweb/ Francisco Fernandéz ],[http://http://paginas.fe.up.pt/~ajf/ Aníbal Ferreira ]
|-
! YR1
| MultiF0_Yeh_IRCAM f0FrmFile || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]
|-
! YR2
| MultiF0_Yeh_IRCAM f0TrkFile || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]
|-
! YR3
| MultiF0_Yeh_IRCAM f0FrmFile -c || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]

|-
! YR4
| MultiF0_Yeh_IRCAM f0TrkFile -c || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]

|}

==Task 1: Multiple Fundamental Frequency Estimation (MF0E)==

===MF0E Overall Summary Results===
Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.

<csv>2012/mf0/est/summary/task1.overall.csv</csv>

====Detailed Results====

<csv>2012/mf0/est/summary/task1.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/est/summary/task1.chroma.results.csv</csv>

===Individual Results Files for Task 1===
'''BD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/BD1.tar.gz Emmanouil Benetos, Simon Dixon] 
'''KD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD1.tar.gz Karin Dressler ] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR2.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR4''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR4.tar.gz Chunghsin YEH,Axel Roebel] 

=====Info about the filenames=====
The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

'''bs''' = bassoon,
'''cl''' = clarinet,
'''fl''' = flute,
'''hn''' = horn,
'''ob''' = oboe,
'''vl''' = violin,
'''cel''' = cello,
'''gtr''' = guitar,
'''sax''' = saxophone,
'''bass''' = electric bass guitar

===Run Times===

<csv>2012/mf0/est/runtimes_mf0_2011.csv</csv>

===Friedman tests for Multiple Fundamental Frequency Estimation (MF0E)===
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the performance (accuracy) on individual files.

====Tukey-Kramer HSD Multi-Comparison====

<csv>2012/mf0/est/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_Mean_Ranks.png|500px]]

==Task 2:Note Tracking (NT)==
===NT Mixed Set Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.

A total of 34 files were used in this subtask: 16 from woodwind recording, 8 from IAL quintet recording and 6 piano.

<csv>2012/mf0/nt/summary/task2.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary/task2.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary/task2.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.chroma.results.csv</csv>

====Run Times====

TBD

====Friedman Tests for Note Tracking====
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the F-measure on individual files.

=====Tukey-Kramer HSD Multi-Comparison for Task2=====

<csv>2012/mf0/nt/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2012Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_Mean_Ranks.png|500px]]

===NT Piano-Only Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.
6 piano recordings are evaluated separately for this subtask.

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.chroma.results.csv</csv>

===Individual Results Files for Task 2===
'''BD2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD2.tar.gz Emmanouil Benetos, Simon Dixon] 
'''BD3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD3.tar.gz Emmanouil Benetos, Simon Dixon] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel]

2012:Multiple Fundamental Frequency Estimation & Tracking Results

2012-10-03T00:33:28Z

Mertbay: /* Tukey-Kramer HSD Multi-Comparison for Task2 */

==Introduction==
These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the [[2011:Multiple Fundamental Frequency Estimation & Tracking]] page.

==General Legend==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! BD1
| BenetosDixon MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD1.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD2
| BenetosDixon NoteTracking1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD2.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD3
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD3.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! KD1
| Karin Dressler || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/KD1.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! LYC1
| LYC || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/LYC1.pdf PDF] || [http://mpac.ee.ntu.edu.tw/~ader888/ Cheng-Te Lee], [http://mpac.ee.ntu.edu.tw/~yihsuan/ Yi-Hsuan Yang],[http://mpac.ee.ntu.edu.tw/people.php Homer Chen]
|-
! RFF1
| AlgorithmUsingPianoSamples || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/RFF1.pdf PDF] || [http://www.estg.ipleiria.pt/~gustavo.reis/ Gustavo Reis],[http:///sites.google.com/site/fcofdezdevegaweb/ Francisco Fernandéz ],[http://http://paginas.fe.up.pt/~ajf/ Aníbal Ferreira ]
|-
! RFF2
| MultiTimbralInternalSamples || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/RFF2.pdf PDF] || [http://www.estg.ipleiria.pt/~gustavo.reis/ Gustavo Reis],[http:///sites.google.com/site/fcofdezdevegaweb/ Francisco Fernandéz ],[http://http://paginas.fe.up.pt/~ajf/ Aníbal Ferreira ]
|-
! YR1
| MultiF0_Yeh_IRCAM f0FrmFile || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]
|-
! YR2
| MultiF0_Yeh_IRCAM f0TrkFile || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]
|-
! YR3
| MultiF0_Yeh_IRCAM f0FrmFile -c || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]

|-
! YR4
| MultiF0_Yeh_IRCAM f0TrkFile -c || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]

|}

==Task 1: Multiple Fundamental Frequency Estimation (MF0E)==

===MF0E Overall Summary Results===
Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.

<csv>2012/mf0/est/summary/task1.overall.csv</csv>

====Detailed Results====

<csv>2012/mf0/est/summary/task1.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/est/summary/task1.chroma.results.csv</csv>

===Individual Results Files for Task 1===
'''BD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/BD1.tar.gz Emmanouil Benetos, Simon Dixon] 
'''KD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD1.tar.gz Karin Dressler ] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR2.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR4''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR4.tar.gz Chunghsin YEH,Axel Roebel] 

=====Info about the filenames=====
The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

'''bs''' = bassoon,
'''cl''' = clarinet,
'''fl''' = flute,
'''hn''' = horn,
'''ob''' = oboe,
'''vl''' = violin,
'''cel''' = cello,
'''gtr''' = guitar,
'''sax''' = saxophone,
'''bass''' = electric bass guitar

===Run Times===

<csv>2012/mf0/est/runtimes_mf0_2011.csv</csv>

===Friedman tests for Multiple Fundamental Frequency Estimation (MF0E)===
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the performance (accuracy) on individual files.

====Tukey-Kramer HSD Multi-Comparison====

<csv>2012/mf0/est/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_Mean_Ranks.png|500px]]

==Task 2:Note Tracking (NT)==
===NT Mixed Set Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.

A total of 34 files were used in this subtask: 16 from woodwind recording, 8 from IAL quintet recording and 6 piano.

<csv>2012/mf0/nt/summary/task2.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary/task2.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary/task2.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.chroma.results.csv</csv>

====Run Times====

TBD

====Friedman Tests for Note Tracking====
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the F-measure on individual files.

=====Tukey-Kramer HSD Multi-Comparison for Task2=====

<csv>2012/mf0/nt/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2012Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv|500px]]

===NT Piano-Only Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.
6 piano recordings are evaluated separately for this subtask.

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.chroma.results.csv</csv>

===Individual Results Files for Task 2===
'''BD2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD2.tar.gz Emmanouil Benetos, Simon Dixon] 
'''BD3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD3.tar.gz Emmanouil Benetos, Simon Dixon] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel]

2012:Multiple Fundamental Frequency Estimation & Tracking Results

2012-10-03T00:31:40Z

Mertbay: /* Run Times */

==Introduction==
These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the [[2011:Multiple Fundamental Frequency Estimation & Tracking]] page.

==General Legend==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! BD1
| BenetosDixon MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD1.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD2
| BenetosDixon NoteTracking1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD2.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD3
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD3.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! KD1
| Karin Dressler || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/KD1.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! LYC1
| LYC || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/LYC1.pdf PDF] || [http://mpac.ee.ntu.edu.tw/~ader888/ Cheng-Te Lee], [http://mpac.ee.ntu.edu.tw/~yihsuan/ Yi-Hsuan Yang],[http://mpac.ee.ntu.edu.tw/people.php Homer Chen]
|-
! RFF1
| AlgorithmUsingPianoSamples || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/RFF1.pdf PDF] || [http://www.estg.ipleiria.pt/~gustavo.reis/ Gustavo Reis],[http:///sites.google.com/site/fcofdezdevegaweb/ Francisco Fernandéz ],[http://http://paginas.fe.up.pt/~ajf/ Aníbal Ferreira ]
|-
! RFF2
| MultiTimbralInternalSamples || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/RFF2.pdf PDF] || [http://www.estg.ipleiria.pt/~gustavo.reis/ Gustavo Reis],[http:///sites.google.com/site/fcofdezdevegaweb/ Francisco Fernandéz ],[http://http://paginas.fe.up.pt/~ajf/ Aníbal Ferreira ]
|-
! YR1
| MultiF0_Yeh_IRCAM f0FrmFile || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]
|-
! YR2
| MultiF0_Yeh_IRCAM f0TrkFile || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]
|-
! YR3
| MultiF0_Yeh_IRCAM f0FrmFile -c || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]

|-
! YR4
| MultiF0_Yeh_IRCAM f0TrkFile -c || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]

|}

==Task 1: Multiple Fundamental Frequency Estimation (MF0E)==

===MF0E Overall Summary Results===
Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.

<csv>2012/mf0/est/summary/task1.overall.csv</csv>

====Detailed Results====

<csv>2012/mf0/est/summary/task1.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/est/summary/task1.chroma.results.csv</csv>

===Individual Results Files for Task 1===
'''BD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/BD1.tar.gz Emmanouil Benetos, Simon Dixon] 
'''KD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD1.tar.gz Karin Dressler ] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR2.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR4''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR4.tar.gz Chunghsin YEH,Axel Roebel] 

=====Info about the filenames=====
The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

'''bs''' = bassoon,
'''cl''' = clarinet,
'''fl''' = flute,
'''hn''' = horn,
'''ob''' = oboe,
'''vl''' = violin,
'''cel''' = cello,
'''gtr''' = guitar,
'''sax''' = saxophone,
'''bass''' = electric bass guitar

===Run Times===

<csv>2012/mf0/est/runtimes_mf0_2011.csv</csv>

===Friedman tests for Multiple Fundamental Frequency Estimation (MF0E)===
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the performance (accuracy) on individual files.

====Tukey-Kramer HSD Multi-Comparison====

<csv>2012/mf0/est/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_Mean_Ranks.png|500px]]

==Task 2:Note Tracking (NT)==
===NT Mixed Set Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.

A total of 34 files were used in this subtask: 16 from woodwind recording, 8 from IAL quintet recording and 6 piano.

<csv>2012/mf0/nt/summary/task2.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary/task2.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary/task2.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.chroma.results.csv</csv>

====Run Times====

TBD

====Friedman Tests for Note Tracking====
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the F-measure on individual files.

=====Tukey-Kramer HSD Multi-Comparison for Task2=====

<csv>2012/mf0/nt/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2011MF0.Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_Mean_Ranks.png|500px]]

===NT Piano-Only Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.
6 piano recordings are evaluated separately for this subtask.

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.chroma.results.csv</csv>

===Individual Results Files for Task 2===
'''BD2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD2.tar.gz Emmanouil Benetos, Simon Dixon] 
'''BD3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD3.tar.gz Emmanouil Benetos, Simon Dixon] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel]

File:Accuracy Per Song Friedman Mean Rankstask1.friedman.Friedman Mean Ranks.png

2012-10-03T00:23:13Z

Mertbay:

2012:Multiple Fundamental Frequency Estimation & Tracking Results

2012-10-03T00:22:41Z

Mertbay: /* Tukey-Kramer HSD Multi-Comparison */

==Introduction==
These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the [[2011:Multiple Fundamental Frequency Estimation & Tracking]] page.

==General Legend==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! BD1
| BenetosDixon MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD1.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD2
| BenetosDixon NoteTracking1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD2.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD3
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD3.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! KD1
| Karin Dressler || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/KD1.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! LYC1
| LYC || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/LYC1.pdf PDF] || [http://mpac.ee.ntu.edu.tw/~ader888/ Cheng-Te Lee], [http://mpac.ee.ntu.edu.tw/~yihsuan/ Yi-Hsuan Yang],[http://mpac.ee.ntu.edu.tw/people.php Homer Chen]
|-
! RFF1
| AlgorithmUsingPianoSamples || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/RFF1.pdf PDF] || [http://www.estg.ipleiria.pt/~gustavo.reis/ Gustavo Reis],[http:///sites.google.com/site/fcofdezdevegaweb/ Francisco Fernandéz ],[http://http://paginas.fe.up.pt/~ajf/ Aníbal Ferreira ]
|-
! RFF2
| MultiTimbralInternalSamples || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/RFF2.pdf PDF] || [http://www.estg.ipleiria.pt/~gustavo.reis/ Gustavo Reis],[http:///sites.google.com/site/fcofdezdevegaweb/ Francisco Fernandéz ],[http://http://paginas.fe.up.pt/~ajf/ Aníbal Ferreira ]
|-
! YR1
| MultiF0_Yeh_IRCAM f0FrmFile || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]
|-
! YR2
| MultiF0_Yeh_IRCAM f0TrkFile || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]
|-
! YR3
| MultiF0_Yeh_IRCAM f0FrmFile -c || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]

|-
! YR4
| MultiF0_Yeh_IRCAM f0TrkFile -c || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]

|}

==Task 1: Multiple Fundamental Frequency Estimation (MF0E)==

===MF0E Overall Summary Results===
Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.

<csv>2012/mf0/est/summary/task1.overall.csv</csv>

====Detailed Results====

<csv>2012/mf0/est/summary/task1.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/est/summary/task1.chroma.results.csv</csv>

===Individual Results Files for Task 1===
'''BD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/BD1.tar.gz Emmanouil Benetos, Simon Dixon] 
'''KD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD1.tar.gz Karin Dressler ] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR2.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR4''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR4.tar.gz Chunghsin YEH,Axel Roebel] 

=====Info about the filenames=====
The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

'''bs''' = bassoon,
'''cl''' = clarinet,
'''fl''' = flute,
'''hn''' = horn,
'''ob''' = oboe,
'''vl''' = violin,
'''cel''' = cello,
'''gtr''' = guitar,
'''sax''' = saxophone,
'''bass''' = electric bass guitar

===Run Times===

<csv>2012/mf0/est/runtimes_mf0_2011.csv</csv>

===Friedman tests for Multiple Fundamental Frequency Estimation (MF0E)===
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the performance (accuracy) on individual files.

====Tukey-Kramer HSD Multi-Comparison====

<csv>2012/mf0/est/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_Mean_Ranks.png|500px]]

==Task 2:Note Tracking (NT)==
===NT Mixed Set Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.

A total of 34 files were used in this subtask: 16 from woodwind recording, 8 from IAL quintet recording and 6 piano.

<csv>2012/mf0/nt/summary/task2.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary/task2.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary/task2.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.chroma.results.csv</csv>

====Run Times====

<csv>2012/mf0/nt/runtimes_NT_2011.csv</csv>

====Friedman Tests for Note Tracking====
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the F-measure on individual files.

=====Tukey-Kramer HSD Multi-Comparison for Task2=====

<csv>2012/mf0/nt/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2011MF0.Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_Mean_Ranks.png|500px]]

===NT Piano-Only Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.
6 piano recordings are evaluated separately for this subtask.

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.chroma.results.csv</csv>

===Individual Results Files for Task 2===
'''BD2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD2.tar.gz Emmanouil Benetos, Simon Dixon] 
'''BD3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD3.tar.gz Emmanouil Benetos, Simon Dixon] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel]

2012:Multiple Fundamental Frequency Estimation & Tracking Results

2012-10-03T00:21:24Z

Mertbay: /* MF0E Overall Summary Results */

==Introduction==
These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the [[2011:Multiple Fundamental Frequency Estimation & Tracking]] page.

==General Legend==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! BD1
| BenetosDixon MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD1.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD2
| BenetosDixon NoteTracking1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD2.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD3
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD3.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! KD1
| Karin Dressler || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/KD1.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! LYC1
| LYC || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/LYC1.pdf PDF] || [http://mpac.ee.ntu.edu.tw/~ader888/ Cheng-Te Lee], [http://mpac.ee.ntu.edu.tw/~yihsuan/ Yi-Hsuan Yang],[http://mpac.ee.ntu.edu.tw/people.php Homer Chen]
|-
! RFF1
| AlgorithmUsingPianoSamples || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/RFF1.pdf PDF] || [http://www.estg.ipleiria.pt/~gustavo.reis/ Gustavo Reis],[http:///sites.google.com/site/fcofdezdevegaweb/ Francisco Fernandéz ],[http://http://paginas.fe.up.pt/~ajf/ Aníbal Ferreira ]
|-
! RFF2
| MultiTimbralInternalSamples || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/RFF2.pdf PDF] || [http://www.estg.ipleiria.pt/~gustavo.reis/ Gustavo Reis],[http:///sites.google.com/site/fcofdezdevegaweb/ Francisco Fernandéz ],[http://http://paginas.fe.up.pt/~ajf/ Aníbal Ferreira ]
|-
! YR1
| MultiF0_Yeh_IRCAM f0FrmFile || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]
|-
! YR2
| MultiF0_Yeh_IRCAM f0TrkFile || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]
|-
! YR3
| MultiF0_Yeh_IRCAM f0FrmFile -c || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]

|-
! YR4
| MultiF0_Yeh_IRCAM f0TrkFile -c || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]

|}

==Task 1: Multiple Fundamental Frequency Estimation (MF0E)==

===MF0E Overall Summary Results===
Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.

<csv>2012/mf0/est/summary/task1.overall.csv</csv>

====Detailed Results====

<csv>2012/mf0/est/summary/task1.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/est/summary/task1.chroma.results.csv</csv>

===Individual Results Files for Task 1===
'''BD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/BD1.tar.gz Emmanouil Benetos, Simon Dixon] 
'''KD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD1.tar.gz Karin Dressler ] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR2.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR4''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR4.tar.gz Chunghsin YEH,Axel Roebel] 

=====Info about the filenames=====
The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

'''bs''' = bassoon,
'''cl''' = clarinet,
'''fl''' = flute,
'''hn''' = horn,
'''ob''' = oboe,
'''vl''' = violin,
'''cel''' = cello,
'''gtr''' = guitar,
'''sax''' = saxophone,
'''bass''' = electric bass guitar

===Run Times===

<csv>2012/mf0/est/runtimes_mf0_2011.csv</csv>

===Friedman tests for Multiple Fundamental Frequency Estimation (MF0E)===
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the performance (accuracy) on individual files.

====Tukey-Kramer HSD Multi-Comparison====

<csv>2012/mf0/est/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2011MF0task1.friedman.Friedman Mean Ranks.png|500px]]

==Task 2:Note Tracking (NT)==
===NT Mixed Set Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.

A total of 34 files were used in this subtask: 16 from woodwind recording, 8 from IAL quintet recording and 6 piano.

<csv>2012/mf0/nt/summary/task2.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary/task2.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary/task2.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.chroma.results.csv</csv>

====Run Times====

<csv>2012/mf0/nt/runtimes_NT_2011.csv</csv>

====Friedman Tests for Note Tracking====
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the F-measure on individual files.

=====Tukey-Kramer HSD Multi-Comparison for Task2=====

<csv>2012/mf0/nt/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2011MF0.Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_Mean_Ranks.png|500px]]

===NT Piano-Only Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.
6 piano recordings are evaluated separately for this subtask.

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.chroma.results.csv</csv>

===Individual Results Files for Task 2===
'''BD2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD2.tar.gz Emmanouil Benetos, Simon Dixon] 
'''BD3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD3.tar.gz Emmanouil Benetos, Simon Dixon] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel]

2012:Multiple Fundamental Frequency Estimation & Tracking Results

2012-10-02T22:22:30Z

Mertbay:

==Introduction==
These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the [[2011:Multiple Fundamental Frequency Estimation & Tracking]] page.

==General Legend==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! BD1
| BenetosDixon MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD1.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD2
| BenetosDixon NoteTracking1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD2.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD3
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD3.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! KD1
| Karin Dressler || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/KD1.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! LYC1
| LYC || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/LYC1.pdf PDF] || [http://mpac.ee.ntu.edu.tw/~ader888/ Cheng-Te Lee], [http://mpac.ee.ntu.edu.tw/~yihsuan/ Yi-Hsuan Yang],[http://mpac.ee.ntu.edu.tw/people.php Homer Chen]
|-
! RFF1
| AlgorithmUsingPianoSamples || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/RFF1.pdf PDF] || [http://www.estg.ipleiria.pt/~gustavo.reis/ Gustavo Reis],[http:///sites.google.com/site/fcofdezdevegaweb/ Francisco Fernandéz ],[http://http://paginas.fe.up.pt/~ajf/ Aníbal Ferreira ]
|-
! RFF2
| MultiTimbralInternalSamples || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/RFF2.pdf PDF] || [http://www.estg.ipleiria.pt/~gustavo.reis/ Gustavo Reis],[http:///sites.google.com/site/fcofdezdevegaweb/ Francisco Fernandéz ],[http://http://paginas.fe.up.pt/~ajf/ Aníbal Ferreira ]
|-
! YR1
| MultiF0_Yeh_IRCAM f0FrmFile || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]
|-
! YR2
| MultiF0_Yeh_IRCAM f0TrkFile || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]
|-
! YR3
| MultiF0_Yeh_IRCAM f0FrmFile -c || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]

|-
! YR4
| MultiF0_Yeh_IRCAM f0TrkFile -c || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]

|}

==Task 1: Multiple Fundamental Frequency Estimation (MF0E)==

===MF0E Overall Summary Results===
Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.

<csv>2012/mf0/est/summary/task1.overall.csv</csv>

====Detailed Results====

<csv>2012/mf0/est/summary/task1.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/est/summary/task1.chroma.results.csv</csv>

===Individual Results Files for Task 1===
'''BD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/BD1.tar.gz Emmanouil Benetos, Simon Dixon] 
'''KD1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/KD1.tar.gz Karin Dressler ] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR2''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR2.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR4''' = [https://music-ir.org/mirex/results/2012/mf0/est/tars/YR4.tar.gz Chunghsin YEH,Axel Roebel] 

=====Info about the filenames=====
The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

'''bs''' = bassoon,
'''cl''' = clarinet,
'''fl''' = flute,
'''hn''' = horn,
'''ob''' = oboe,
'''vl''' = violin,
'''cel''' = cello,
'''gtr''' = guitar,
'''sax''' = saxophone,
'''bass''' = electric bass guitar

===Run Times===

<csv>2012/mf0/est/runtimes_mf0_2011.csv</csv>

===Friedman tests for Multiple Fundamental Frequency Estimation (MF0E)===
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the performance (accuracy) on individual files.

====Tukey-Kramer HSD Multi-Comparison====

<csv>2012/mf0/est/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2011MF0task1.friedman.Friedman Mean Ranks.png|500px]]

==Task 2:Note Tracking (NT)==
===NT Mixed Set Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.

A total of 34 files were used in this subtask: 16 from woodwind recording, 8 from IAL quintet recording and 6 piano.

<csv>2012/mf0/nt/summary/task2.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary/task2.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary/task2.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary/task2.onsetOnly.chroma.results.csv</csv>

====Run Times====

<csv>2012/mf0/nt/runtimes_NT_2011.csv</csv>

====Friedman Tests for Note Tracking====
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the F-measure on individual files.

=====Tukey-Kramer HSD Multi-Comparison for Task2=====

<csv>2012/mf0/nt/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2011MF0.Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_Mean_Ranks.png|500px]]

===NT Piano-Only Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.
6 piano recordings are evaluated separately for this subtask.

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.overall.results.csv</csv>

====Detailed Results====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2012/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.chroma.results.csv</csv>

===Individual Results Files for Task 2===
'''BD2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD2.tar.gz Emmanouil Benetos, Simon Dixon] 
'''BD3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/BD3.tar.gz Emmanouil Benetos, Simon Dixon] 
'''LYC1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2012/mf0/nt/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel]

2012:Multiple Fundamental Frequency Estimation & Tracking Results

2012-10-02T22:19:29Z

Mertbay: Created page with "==Introduction== These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set ple..."

==Introduction==
These are the results for the 2008 running of the Multiple Fundamental Frequency Estimation and Tracking task. For background information about this task set please refer to the [[2011:Multiple Fundamental Frequency Estimation & Tracking]] page.

==General Legend==
{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
|- style="background: yellow;"
! width="80" | Sub code
! width="200" | Submission name
! width="80" style="text-align: center;" | Abstract
! width="440" | Contributors
|-
! BD1
| BenetosDixon MultiF0 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD1.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD2
| BenetosDixon NoteTracking1 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD2.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! BD3
| BenetosDixon NoteTracking2 || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/BD3.pdf PDF] || [http://www.dcs.qmul.ac.uk/~emmanouilb Emmanouil Benetos], [http://www.eecs.qmul.ac.uk/~simond Simon Dixon]
|-
! KD1
| Karin Dressler || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/KD1.pdf PDF] || [http://www.idmt.fraunhofer.de/ Karin Dressler ]
|-
! LYC1
| LYC || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/LYC1.pdf PDF] || [http://mpac.ee.ntu.edu.tw/~ader888/ Cheng-Te Lee], [http://mpac.ee.ntu.edu.tw/~yihsuan/ Yi-Hsuan Yang],[http://mpac.ee.ntu.edu.tw/people.php Homer Chen]
|-
! RFF1
| AlgorithmUsingPianoSamples || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/RFF1.pdf PDF] || [http://www.estg.ipleiria.pt/~gustavo.reis/ Gustavo Reis],[http:///sites.google.com/site/fcofdezdevegaweb/ Francisco Fernandéz ],[http://http://paginas.fe.up.pt/~ajf/ Aníbal Ferreira ]
|-
! RFF2
| MultiTimbralInternalSamples || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/RFF2.pdf PDF] || [http://www.estg.ipleiria.pt/~gustavo.reis/ Gustavo Reis],[http:///sites.google.com/site/fcofdezdevegaweb/ Francisco Fernandéz ],[http://http://paginas.fe.up.pt/~ajf/ Aníbal Ferreira ]
|-
! YR1
| MultiF0_Yeh_IRCAM f0FrmFile || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]
|-
! YR2
| MultiF0_Yeh_IRCAM f0TrkFile || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]
|-
! YR3
| MultiF0_Yeh_IRCAM f0FrmFile -c || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]

|-
! YR4
| MultiF0_Yeh_IRCAM f0TrkFile -c || style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2011/YR1.pdf PDF] || [http://anasynth.ircam.fr/home/english/people/chung... Chunghsin YEH],[http://anasynth.ircam.fr/home/english/people/axelr... Axel Roebel ]

|}

==Task 1: Multiple Fundamental Frequency Estimation (MF0E)==

===MF0E Overall Summary Results===
Below are the average scores across 40 test files. These files come from 3 different sources: woodwind quintet recording of bassoon, clarinet, horn,flute and oboe (UIUC); Rendered MIDI using RWC database donated by IRCAM and a quartet recording of bassoon, clarinet, violin and sax donated by Dr. Bryan Pardo`s Interactive Audio Lab (IAL). 20 files coming from 5 sections of the woodwind recording where each section has 4 files ranging from 2 polyphony to 5 polyphony. 12 files from IAL, coming from 4 different songs ranging from 2 polyphony to 4 polyphony and 8 files from RWC synthesized midi ranging from 2 different songs ranging from 2 polphony to 5 polyphony.

<csv>2011/mf0/est/summary/task1.overall.csv</csv>

====Detailed Results====

<csv>2011/mf0/est/summary/task1.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2011/mf0/est/summary/task1.chroma.results.csv</csv>

===Individual Results Files for Task 1===
'''BD1''' = [https://music-ir.org/mirex/results/2011/mf0/est/tars/BD1.tar.gz Emmanouil Benetos, Simon Dixon] 
'''KD1''' = [https://music-ir.org/mirex/results/2011/mf0/est/tars/KD1.tar.gz Karin Dressler ] 
'''LYC1''' = [https://music-ir.org/mirex/results/2011/mf0/est/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2011/mf0/est/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2011/mf0/est/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2011/mf0/est/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR2''' = [https://music-ir.org/mirex/results/2011/mf0/est/tars/YR2.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2011/mf0/est/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR4''' = [https://music-ir.org/mirex/results/2011/mf0/est/tars/YR4.tar.gz Chunghsin YEH,Axel Roebel] 

=====Info about the filenames=====
The filenames starting with part* comes from acoustic woodwind recording, the ones starting with RWC are synthesized. The legend about the instruments are:

'''bs''' = bassoon,
'''cl''' = clarinet,
'''fl''' = flute,
'''hn''' = horn,
'''ob''' = oboe,
'''vl''' = violin,
'''cel''' = cello,
'''gtr''' = guitar,
'''sax''' = saxophone,
'''bass''' = electric bass guitar

===Run Times===

<csv>2011/mf0/est/runtimes_mf0_2011.csv</csv>

===Friedman tests for Multiple Fundamental Frequency Estimation (MF0E)===
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the performance (accuracy) on individual files.

====Tukey-Kramer HSD Multi-Comparison====

<csv>2011/mf0/est/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask1.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2011MF0task1.friedman.Friedman Mean Ranks.png|500px]]

==Task 2:Note Tracking (NT)==
===NT Mixed Set Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.

A total of 34 files were used in this subtask: 16 from woodwind recording, 8 from IAL quintet recording and 6 piano.

<csv>2011/mf0/nt/summary/task2.overall.results.csv</csv>

====Detailed Results====

<csv>2011/mf0/nt/summary/task2.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2011/mf0/nt/summary/task2.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2011/mf0/nt/summary/task2.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2011/mf0/nt/summary/task2.onsetOnly.chroma.results.csv</csv>

====Run Times====

<csv>2011/mf0/nt/runtimes_NT_2011.csv</csv>

====Friedman Tests for Note Tracking====
The Friedman test was run in MATLAB to test significant differences amongst systems with regard to the F-measure on individual files.

=====Tukey-Kramer HSD Multi-Comparison for Task2=====

<csv>2011/mf0/nt/summary/Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_TukeyKramerHSD.csv</csv>

[[File:2011MF0.Accuracy_Per_Song_Friedman_Mean_Rankstask2.friedman.Friedman_Mean_Ranks.png|500px]]

===NT Piano-Only Overall Summary Results===
This subtask is evaluated in two different ways. In the first setup , a returned note is assumed correct if its onset is within +-50ms of a ref note and its F0 is within +- quarter tone of the corresponding reference note, ignoring the returned offset values. In the second setup, on top of the above requirements, a correct returned note is required to have an offset value within 20% of the ref notes duration around the ref note`s offset, or within 50ms whichever is larger.
6 piano recordings are evaluated separately for this subtask.

<csv>2011/mf0/nt/summary_piano_subtask/task2_piano.overall.results.csv</csv>

====Detailed Results====

<csv>2011/mf0/nt/summary_piano_subtask/task2_piano.results.csv</csv>

====Detailed Chroma Results====
Here, accuracy is assessed on chroma results (i.e. all F0's are mapped to a single octave before evaluating)

<csv>2011/mf0/nt/summary_piano_subtask/task2_piano.chroma.results.csv</csv>

====Results Based on Onset Only====

<csv>2011/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.results.csv</csv>

====Chroma Results Based on Onset Only====

<csv>2011/mf0/nt/summary_piano_subtask/task2_piano.onsetOnly.chroma.results.csv</csv>

===Individual Results Files for Task 2===
'''BD2''' = [https://music-ir.org/mirex/results/2011/mf0/nt/tars/BD2.tar.gz Emmanouil Benetos, Simon Dixon] 
'''BD3''' = [https://music-ir.org/mirex/results/2011/mf0/nt/tars/BD3.tar.gz Emmanouil Benetos, Simon Dixon] 
'''LYC1''' = [https://music-ir.org/mirex/results/2011/mf0/nt/tars/LYC1.tar.gz Cheng-Te Lee, Yi-Hsuan Yang,Homer Chen ] 
'''RFF1''' = [https://music-ir.org/mirex/results/2011/mf0/nt/tars/RFF1.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''RFF2''' = [https://music-ir.org/mirex/results/2011/mf0/nt/tars/RFF2.tar.gz Gustavo Reis,Francisco Fernandéz ,Aníbal Ferreira ] 
'''YR1''' = [https://music-ir.org/mirex/results/2011/mf0/nt/tars/YR1.tar.gz Chunghsin YEH,Axel Roebel] 
'''YR3''' = [https://music-ir.org/mirex/results/2011/mf0/nt/tars/YR3.tar.gz Chunghsin YEH,Axel Roebel]