View source for 2013:Discovery of Repeated Themes & Sections Results

== Introduction ==

The task: algorithms take a piece of music as input, and output a list of patterns repeated within that piece. A pattern is defined as a '''set of ontime-pitch pairs''' that occurs at least twice (i.e., is repeated at least once) in a piece of music. The second, third, etc. occurrences of the pattern will likely be shifted in time and/or transposed, relative to the first occurrence. Ideally an algorithm will be able to discover all exact and inexact occurrences of a pattern within a piece, so in evaluating this task we are interested in both:
*(1) to what extent an algorithm can discover one occurrence, up to time shift and transposition, and;
*(2) to what extent it can find all occurrences.
The metrics '''establishment recall''', establishment precision and establishment F1 address (1), and the metrics '''occurrence recall''', occurrence precision, and occurrence F1 address (2).

== Contribution ==

Existing approaches to music structure analysis in MIR tend to focus on segmentation (e.g., Weiss & Bello, 2010). The contribution of this task is to afford access to the note content itself (please see the example in Fig. 1A), requiring algorithms to do more than label time windows (e.g., the segmentations in Figs. 1B-D). For instance, a discovery algorithm applied to the piece in Fig. 1A should return a pattern corresponding to the note content of <math>P_1</math> and <math>P_2</math>, as well as a pattern corresponding to the note content of <math>Q_1</math>. This is because <math>Q_1</math> occurs again independently of the accompaniment in bars 19-22 (not shown here). The ground truth also contains nested patterns, such as <math>P_1</math> in Fig. 1A being a subset of the sectional repetition <math>S_1</math>, reflecting the often-hierarchical nature of musical repetition. While we recognise the appealing simplicity of linear segmentation, in the ''Discovery of Repeated Themes & Sections'' task we are demanding analysis at a greater level of detail, and have built a ground truth that contains overlapping and nested patterns.


[[File:mozartK282Mvt2.png|500px]]

'''Figure 1.''' Pattern discovery v segmentation. (A) Bars 1-12 of Mozart’s Piano Sonata in E-flat major K282 mvt.2, showing some ground-truth themes and repeated sections; (B-D) Three linear segmentations. Numbers below the staff in Fig. 1A and below the segmentation in Fig. 1D indicate crotchet beats, from zero for bar 1 beat 1.


For a more detailed introduction to the task, please see [[2013:Discovery_of_Repeated_Themes_&_Sections]].

== Ground Truth and Algorithms ==

The ground truth, called the '''Johannes Kepler University Patterns Test Database''' (JKUPTD-Aug2013), is based on motifs and themes in Barlow and Morgenstern (1953), Schoenberg (1967), and Bruhn (1993). Repeated sections are based on those marked by the composer. These annotations are supplemented with some of our own where necessary. A Development Database (JKUPDD-Aug2013) released in March enabled participants to try out their algorithms. For each piece in the Development and Test Databases, symbolic and synthesised audio versions are crossed with monophonic and polyphonic versions, giving four versions of the task in total: symPoly, symMono, audPoly, and audMono. Algorithms submitted to the task are are shown in Table 1.


{| border="1" cellspacing="0" style="text-align: left; width: 800px;"
	|- style="background: yellow;"
	! width="80" | Sub code 
	! width="200" | Submission name 
	! width="80" style="text-align: center;" | Abstract 
	! width="440" | Contributors
	|-
        |- style="background: green;"
        ! Task Version
	! symPoly
        !
        !
	|-
	! NF2
	| motives_poly  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2013/NF2.pdf PDF] || [http://files.nyu.edu/onc202/public/ Oriol Nieto], [http://www.nyu.edu/projects/farbood/ Morwaread Farbood]
	|-
	! DM10
	| SIATECCompressSegment  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2013/DM10.pdf PDF] || [http://www.titanmusic.com/ David Meredith]
        |-
	! DM9
	| SIATECCompressRaw  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2013/DM9.pdf PDF] || [http://www.titanmusic.com/ David Meredith]
        |-
	! DM8
	| SIATECCompressBB  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2013/DM8.pdf PDF] || [http://www.titanmusic.com/ David Meredith]
        |-
	! DM7
	| COSIATECSegment  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2013/DM7.pdf PDF] || [http://www.titanmusic.com/ David Meredith]
        |-
	! DM6
	| COSIATECRaw  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2013/DM6.pdf PDF] || [http://www.titanmusic.com/ David Meredith]
        |-
	! DM5
	| COSSIATECBB  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2013/DM5.pdf PDF] || [http://www.titanmusic.com/ David Meredith]
        |- style="background: green;"
        ! Task Version
	! symMono
        !
        !
	|-
	! NF1
	| motives_mono  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2013/NF1.pdf PDF] || [http://files.nyu.edu/onc202/public/ Oriol Nieto], [http://www.nyu.edu/projects/farbood/ Morwaread Farbood]
	|-
	! DM10
	| SIATECCompressSegment  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2013/DM10.pdf PDF] || [http://www.titanmusic.com/ David Meredith]
        |-
	! DM9
	| SIATECCompressRaw  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2013/DM9.pdf PDF] || [http://www.titanmusic.com/ David Meredith]
        |-
	! DM8
	| SIATECCompressBB  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2013/DM8.pdf PDF] || [http://www.titanmusic.com/ David Meredith]
        |-
	! DM7
	| COSIATECSegment  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2013/DM7.pdf PDF] || [http://www.titanmusic.com/ David Meredith]
        |-
	! DM6
	| COSIATECRaw  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2013/DM6.pdf PDF] || [http://www.titanmusic.com/ David Meredith]
        |-
	! DM5
	| COSSIATECBB  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2013/DM5.pdf PDF] || [http://www.titanmusic.com/ David Meredith]
        |- style="background: green;"
        ! Task Version
	! audPoly
        !
        !
	|-
	! NF4
	| motives_audio_poly  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2013/NF4.pdf PDF] || [http://files.nyu.edu/onc202/public/ Oriol Nieto], [http://www.nyu.edu/projects/farbood/ Morwaread Farbood]
	|- style="background: green;"
        ! Task Version
	! audMono
        !
        !
	|-
	! NF3
	| motives_audio_mono  ||  style="text-align: center;" | [https://www.music-ir.org/mirex/abstracts/2013/NF3.pdf PDF] || [http://files.nyu.edu/onc202/public/ Oriol Nieto], [http://www.nyu.edu/projects/farbood/ Morwaread Farbood]
|}

'''Table 1.''' Algorithms submitted to DRTS.

== Results ==

For mathematical definitions of the various metrics, please see [[2013:Discovery_of_Repeated_Themes_&_Sections#Evaluation_Procedure]].

=== In Brief ===

To avoid a bias toward the more numerous submissions of Meredith (2013), DM10 was preselected for comparison with Nieto and Farbood's (2013) submissions, based on reported performance for the Development Database. Figure 2 shows establishment recall results on a per-pattern basis for the symbolic-polyphonic version of the task. DM10 outperforms NF2 according to Friedman's test (<math>\chi^2(1) = 12.7368,\ p < .001</math>), suggesting the former is preferable for discovering at least one occurrence of each ground truth pattern. This result addresses point (1) from the introduction.

Figure 3 shows occurrence recall results on a per-pattern basis for the symbolic-polyphonic version of the task. Again, DM10 outperforms NF2 according to Friedman's test (<math>\chi^2(1) = 11.2667,\ p < .001</math>), suggesting the former is preferable for retrieving all occurrences of a discovered ground truth pattern. This result addresses point (2) from the introduction.

It should be noted, however, that according to Friedman's test, algorithm NF2 is significantly faster than DM10 (<math>\chi^2(1) = 4.000,\ p < .05</math>), suggesting the former is preferable for rapid summarisation.

Results were similar but somewhat closer for the symbolic-monophonic version of the task. According to Friedman's test (<math>\chi^2(1) = 2.9512,\ p = .0858</math>, ns), NF1 and DM10 show no significant difference for establishment recall on a per-pattern basis (please see Figure 14). This result relates to point (1) from the introduction. Figure 15 shows occurrence recall results on a per-pattern basis for the symbolic-monophonic version of the task. DM10 outperforms NF1 according to Friedman's test (<math>\chi^2(1) = 11.6364,\ p < .001</math>), suggesting the former is preferable for retrieving all occurrences of a discovered ground truth pattern. This result relates to point (2) from the introduction.

For the audio versions of the task, algorithms NF3 (audMono) and NF4 (audPoly) were the only submissions. Nieto and Farbood (2013) are credited with being the first to define an algorithm for discovering repeated note content in a synthesised audio file that is time-locked to a symbolic representation. We include some results from these task versions, with future comparisons in mind (Figs. 26-49). Evidently the audio task was more challenging (cf. Figs. 2 and 26).

=== symPoly ===


[[File:01symPolyEstRecPerPatt.png|600px]]

'''Figure 2.''' Establishment recall on a per-pattern basis. Establishment recall answers the following question. On average, how similar is the most similar algorithm-output pattern to a ground-truth pattern prototype?


[[File:04symPolyOccRecPerPatt.png|600px]]

'''Figure 3.''' Occurrence recall on a per-pattern basis. Occurrence recall answers the following question. On average, how similar is the most similar set of algorithm-output pattern occurrences to a discovered ground-truth occurrence set?


[[File:01symPolyEstRec.png|400px]]

'''Figure 4.''' Establishment recall averaged over each piece/movement. Establishment recall answers the following question. On average, how similar is the most similar algorithm-output pattern to a ground-truth pattern prototype?


[[File:02symPolyEstPrec.png|400px]]

'''Figure 5.''' Establishment precision averaged over each piece/movement. Establishment precision answers the following question. On average, how similar is the most similar ground-truth pattern prototype to an algorithm-output pattern?


[[File:03symPolyEstF1.png|400px]]

'''Figure 6.''' Establishment F1 averaged over each piece/movement. Establishment F1 is an average of establishment precision and establishment recall.


[[File:04symPolyOccRecP75.png|400px]]

'''Figure 7.''' Occurrence recall (<math>c = .75</math>) averaged over each piece/movement. Occurrence recall answers the following question. On average, how similar is the most similar set of algorithm-output pattern occurrences to a discovered ground-truth occurrence set?


[[File:05symPolyOccPrecP75.png|400px]]

'''Figure 8.''' Occurrence precision (<math>c = .75</math>) averaged over each piece/movement. Occurrence precision answers the following question. On average, how similar is the most similar discovered ground-truth occurrence set to a set of algorithm-output pattern occurrences?


[[File:06symPolyOccF1P75.png|400px]]

'''Figure 9.''' Occurrence F1 (<math>c = .75</math>) averaged over each piece/movement. Occurrence F1 is an average of occurrence precision and occurrence recall.


[[File:07symPolyR3.png|400px]]

'''Figure 10.''' Three-layer recall averaged over each piece/movement. Rather than using <math>|P \cap Q|/\max\{|P|, |Q|\}</math> as a similarity measure (which is the default for establishment recall), three-layer recall uses <math>2|P \cap Q|/(|P| + |Q|)</math>, which is a kind of F1 measure.


[[File:08symPolyP3.png|400px]]

'''Figure 11.''' Three-layer precision averaged over each piece/movement. Rather than using <math>|P \cap Q|/\max\{|P|, |Q|\}</math> as a similarity measure (which is the default for establishment precision), three-layer precision uses <math>2|P \cap Q|/(|P| + |Q|)</math>, which is a kind of F1 measure.


[[File:09symPolyTLF.png|400px]]

'''Figure 12.''' Three-layer F1 (TLF) averaged over each piece/movement. TLF is an average of three-layer precision and three-layer recall.


[[File:10symPolyRuntime.png|400px]]

'''Figure 13.''' Log runtime of the algorithm for each piece/movement.

=== symMono ===

''(Poor performance here for algorithm NF1 on piece 2 is likely due to rounding errors in the discovery phase; not anything musically interesting. The task captain tried in vain to identify a workaround.)''

[[File:11symMonoEstRecPerPatt.png|600px]]

'''Figure 14.''' Establishment recall on a per-pattern basis. Establishment recall answers the following question. On average, how similar is the most similar algorithm-output pattern to a ground-truth pattern prototype?


[[File:14symMonoOccRecPerPatt.png|600px]]

'''Figure 15.''' Occurrence recall on a per-pattern basis. Occurrence recall answers the following question. On average, how similar is the most similar set of algorithm-output pattern occurrences to a discovered ground-truth occurrence set?


[[File:11symMonoEstRec.png|400px]]

'''Figure 16.''' Establishment recall averaged over each piece/movement. Establishment recall answers the following question. On average, how similar is the most similar algorithm-output pattern to a ground-truth pattern prototype?


[[File:12symMonoEstPrec.png|400px]]

'''Figure 17.''' Establishment precision averaged over each piece/movement. Establishment precision answers the following question. On average, how similar is the most similar ground-truth pattern prototype to an algorithm-output pattern?


[[File:13symMonoEstF1.png|400px]]

'''Figure 18.''' Establishment F1 averaged over each piece/movement. Establishment F1 is an average of establishment precision and establishment recall.


[[File:14symMonoOccRecP75.png|400px]]

'''Figure 19.''' Occurrence recall (<math>c = .75</math>) averaged over each piece/movement. Occurrence recall answers the following question. On average, how similar is the most similar set of algorithm-output pattern occurrences to a discovered ground-truth occurrence set?


[[File:15symMonoOccPrecP75.png|400px]]

'''Figure 20.''' Occurrence precision (<math>c = .75</math>) averaged over each piece/movement. Occurrence precision answers the following question. On average, how similar is the most similar discovered ground-truth occurrence set to a set of algorithm-output pattern occurrences?


[[File:16symMonoOccF1P75.png|400px]]

'''Figure 21.''' Occurrence F1 (<math>c = .75</math>) averaged over each piece/movement. Occurrence F1 is an average of occurrence precision and occurrence recall.


[[File:17symMonoR3.png|400px]]

'''Figure 22.''' Three-layer recall averaged over each piece/movement. Rather than using <math>|P \cap Q|/\max\{|P|, |Q|\}</math> as a similarity measure (which is the default for establishment recall), three-layer recall uses <math>2|P \cap Q|/(|P| + |Q|)</math>, which is a kind of F1 measure.


[[File:18symMonoP3.png|400px]]

'''Figure 23.''' Three-layer precision averaged over each piece/movement. Rather than using <math>|P \cap Q|/\max\{|P|, |Q|\}</math> as a similarity measure (which is the default for establishment precision), three-layer precision uses <math>2|P \cap Q|/(|P| + |Q|)</math>, which is a kind of F1 measure.


[[File:19symMonoTLF.png|400px]]

'''Figure 24.''' Three-layer F1 (TLF) averaged over each piece/movement. TLF is an average of three-layer precision and three-layer recall.


[[File:20symMonoRuntime.png|400px]]

'''Figure 25.''' Log runtime of the algorithm for each piece/movement.

=== audPoly ===


[[File:21audPolyEstRecPerPatt.png|600px]]

'''Figure 26.''' Establishment recall on a per-pattern basis. Establishment recall answers the following question. On average, how similar is the most similar algorithm-output pattern to a ground-truth pattern prototype?


[[File:24audPolyOccRecPerPatt.png|600px]]

'''Figure 27.''' Occurrence recall on a per-pattern basis. Occurrence recall answers the following question. On average, how similar is the most similar set of algorithm-output pattern occurrences to a discovered ground-truth occurrence set?


[[File:21audPolyEstRec.png|400px]]

'''Figure 28.''' Establishment recall averaged over each piece/movement. Establishment recall answers the following question. On average, how similar is the most similar algorithm-output pattern to a ground-truth pattern prototype?


[[File:22audPolyEstPrec.png|400px]]

'''Figure 29.''' Establishment precision averaged over each piece/movement. Establishment precision answers the following question. On average, how similar is the most similar ground-truth pattern prototype to an algorithm-output pattern?


[[File:23audPolyEstF1.png|400px]]

'''Figure 30.''' Establishment F1 averaged over each piece/movement. Establishment F1 is an average of establishment precision and establishment recall.


[[File:24audPolyOccRecP75.png|400px]]

'''Figure 31.''' Occurrence recall (<math>c = .75</math>) averaged over each piece/movement. Occurrence recall answers the following question. On average, how similar is the most similar set of algorithm-output pattern occurrences to a discovered ground-truth occurrence set?


[[File:25audPolyOccPrecP75.png|400px]]

'''Figure 32.''' Occurrence precision (<math>c = .75</math>) averaged over each piece/movement. Occurrence precision answers the following question. On average, how similar is the most similar discovered ground-truth occurrence set to a set of algorithm-output pattern occurrences?


[[File:26audPolyOccF1P75.png|400px]]

'''Figure 33.''' Occurrence F1 (<math>c = .75</math>) averaged over each piece/movement. Occurrence F1 is an average of occurrence precision and occurrence recall.


[[File:27audPolyR3.png|400px]]

'''Figure 34.''' Three-layer recall averaged over each piece/movement. Rather than using <math>|P \cap Q|/\max\{|P|, |Q|\}</math> as a similarity measure (which is the default for establishment recall), three-layer recall uses <math>2|P \cap Q|/(|P| + |Q|)</math>, which is a kind of F1 measure.


[[File:28audPolyP3.png|400px]]

'''Figure 35.''' Three-layer precision averaged over each piece/movement. Rather than using <math>|P \cap Q|/\max\{|P|, |Q|\}</math> as a similarity measure (which is the default for establishment precision), three-layer precision uses <math>2|P \cap Q|/(|P| + |Q|)</math>, which is a kind of F1 measure.


[[File:29audPolyTLF.png|400px]]

'''Figure 36.''' Three-layer F1 (TLF) averaged over each piece/movement. TLF is an average of three-layer precision and three-layer recall.


[[File:30audPolyRuntime.png|400px]]

'''Figure 37.''' Log runtime of the algorithm for each piece/movement.

=== audMono ===


[[File:31audMonoEstRecPerPatt.png|600px]]

'''Figure 38.''' Establishment recall on a per-pattern basis. Establishment recall answers the following question. On average, how similar is the most similar algorithm-output pattern to a ground-truth pattern prototype?


[[File:34audMonoOccRecPerPatt.png|600px]]

'''Figure 39.''' Occurrence recall on a per-pattern basis. Occurrence recall answers the following question. On average, how similar is the most similar set of algorithm-output pattern occurrences to a discovered ground-truth occurrence set?


[[File:31audMonoEstRec.png|400px]]

'''Figure 40.''' Establishment recall averaged over each piece/movement. Establishment recall answers the following question. On average, how similar is the most similar algorithm-output pattern to a ground-truth pattern prototype?


[[File:32audMonoEstPrec.png|400px]]

'''Figure 41.''' Establishment precision averaged over each piece/movement. Establishment precision answers the following question. On average, how similar is the most similar ground-truth pattern prototype to an algorithm-output pattern?


[[File:33audMonoEstF1.png|400px]]

'''Figure 42.''' Establishment F1 averaged over each piece/movement. Establishment F1 is an average of establishment precision and establishment recall.


[[File:34audMonoOccRecP75.png|400px]]

'''Figure 43.''' Occurrence recall (<math>c = .75</math>) averaged over each piece/movement. Occurrence recall answers the following question. On average, how similar is the most similar set of algorithm-output pattern occurrences to a discovered ground-truth occurrence set?


[[File:35audMonoOccPrecP75.png|400px]]

'''Figure 44.''' Occurrence precision (<math>c = .75</math>) averaged over each piece/movement. Occurrence precision answers the following question. On average, how similar is the most similar discovered ground-truth occurrence set to a set of algorithm-output pattern occurrences?


[[File:36audMonoOccF1P75.png|400px]]

'''Figure 45.''' Occurrence F1 (<math>c = .75</math>) averaged over each piece/movement. Occurrence F1 is an average of occurrence precision and occurrence recall.


[[File:37audMonoR3.png|400px]]

'''Figure 46.''' Three-layer recall averaged over each piece/movement. Rather than using <math>|P \cap Q|/\max\{|P|, |Q|\}</math> as a similarity measure (which is the default for establishment recall), three-layer recall uses <math>2|P \cap Q|/(|P| + |Q|)</math>, which is a kind of F1 measure.


[[File:38audMonoP3.png|400px]]

'''Figure 47.''' Three-layer precision averaged over each piece/movement. Rather than using <math>|P \cap Q|/\max\{|P|, |Q|\}</math> as a similarity measure (which is the default for establishment precision), three-layer precision uses <math>2|P \cap Q|/(|P| + |Q|)</math>, which is a kind of F1 measure.


[[File:39audMonoTLF.png|400px]]

'''Figure 48.''' Three-layer F1 (TLF) averaged over each piece/movement. TLF is an average of three-layer precision and three-layer recall.


[[File:40audMonoRuntime.png|400px]]

'''Figure 49.''' Log runtime of the algorithm for each piece/movement.

== Discussion ==

If an occurrence of a ground-truth pattern contains forty or more notes then, according to Fig. 2, it is likely that SIATECSegment (DM10, Meredith, 2013) and motives_poly (NF2, Nieto & Farbood, 2013) will return a pattern rated as at least 75% similar. When we restrict attention to these successful discoveries and ask to what extent can the algorithms retrieve all exact and inexact occurrences, we find that SIATECSegment performs relatively well (see nonzero entries for the black line in Fig. 3), with the exception of the first patterns in pieces 1 and 2. We conclude, therefore, that the discovery of repeated sections has been addressed well by the current submissions, but that the discovery of themes and motifs requires more attention in future iterations of this task.

When assembling the ground truth, it was remarkable that most often a motif occurs as a subset of a theme or repeated section, which is not surprising given Drabkin’s (2001) definition of a motif as ‘the shortest subdivision of a theme or phrase that still maintains its identity as an idea’. One suggestion for future work is to apply a discovery algorithm to find repeated sections, and then '''apply the algorithm again''' but to the '''output sections only''', in order to retrieve these nested and important musical motifs.

== Tabular Versions of Plots ==

=== symPoly ===

<csv p=3>2013/drts/symPolyResults.csv</csv>

'''Table 2.''' Tabular version of Figures 4-13.


<csv p=3>2013/drts/symPolyResultsPerPatt.csv</csv>

'''Table 3.''' Tabular version of Figures 2 and 3.

=== symMono ===

''(Poor performance here for algorithm NF1 on piece2 is likely due to rounding errors in the discovery phase; not anything musically interesting. The task captain tried in vain to identify a workaround.)''

<csv p=3>2013/drts/symMonoResults.csv</csv>

'''Table 4.''' Tabular version of Figures 16-25.


<csv p=3>2013/drts/symMonoResultsPerPatt.csv</csv>

'''Table 5.''' Tabular version of Figures 14 and 15.

=== audPoly ===

<csv p=3>2013/drts/audPolyResults.csv</csv>

'''Table 6.''' Tabular version of Figures 28-37.


<csv p=3>2013/drts/audPolyResultsPerPatt.csv</csv>

'''Table 7.''' Tabular version of Figures 26 and 27.

=== audMono ===

<csv p=3>2013/drts/audMonoResults.csv</csv>

'''Table 8.''' Taublar version of Figures 40-49.


<csv p=3>2013/drts/audMonoResultsPerPatt.csv</csv>

'''Table 9.''' Tabular version of Figures 38 and 39.

== References ==

*Harold Barlow and Sam Morgenstern. (1948). ''A dictionary of musical themes''. Crown Publishers, New York.
*Siglind Bruhn. (1993). ''J.S. Bach's Well-Tempered Clavier: in-depth analysis and interpretation''. Mainer International, Hong Kong.
*William Drabkin. Motif. (2001). In S. Sadie and J. Tyrrell (Eds), ''The new Grove dictionary of music and musicians''. Macmillan, London, UK, 2nd ed.
*David Meredith. (2013). COSIATEC and SIATECCompress: Pattern discovery by geometric compression. ''10th Annual Music Information Retrieval eXchange (MIREX'13)'', Curitiba, Brazil.
*Oriol Nieto and Morwaread Farbood. (2013). Discovering musical patterns using audio structural segmentation techniques. ''10th Annual Music Information Retrieval eXchange (MIREX'13)'', Curitiba, Brazil.
*Arnold Schoenberg. (1967). ''Fundamentals of Musical Composition''. Faber and Faber, London.
*Ron J. Weiss and Juan Pablo Bello. (2010). Identifying repeated patterns in music using sparse convolutive non-negative matrix factorization. In ''Proc. ISMIR'' (pp. 123-128), Utrecht, The Netherlands.