2025:Polyphonic Transcription - Revision history

Ojaschaturvedi at 06:33, 6 August 2025

2025-08-06T06:33:44Z

Ojaschaturvedi at 06:32, 6 August 2025

2025-08-06T06:32:47Z

Ojaschaturvedi at 06:26, 6 August 2025

2025-08-06T06:26:09Z

Ojaschaturvedi at 06:17, 6 August 2025

2025-08-06T06:17:28Z

Junyan at 03:57, 1 August 2025

2025-08-01T03:57:11Z

Junyan at 15:31, 28 July 2025

2025-07-28T15:31:36Z

Junyan: Created blank page

2025-05-18T15:09:16Z

Created blank page

New page

@@ Line 66: / Line 66: @@
 = Schedule =
-'''TBD'''
+* '''Challenge Deadline''': September 8, 2025
-Task deadline is 9/8
+* Submissions open: August 25, 2025
 = Prizes and Open Source Policy =
-'''TBD'''
+To be considered for awards and leaderboard placement:
-To be considered as a winner and receive the prize, the participating team must open-source their solution, showing both the GitHub repository as well as documentation detailing the changes they have made or the algorithms they have implemented.
 = Communication =

@@ Line 73: / Line 73: @@
 '''TBD'''
 To be considered as a winner and receive the prize, the participating team must open-source their solution, showing both the GitHub repository as well as documentation detailing the changes they have made or the algorithms they have implemented.
 = Task Captains =

@@ Line 76: / Line 76: @@
 = Task Captains =
-For any question: <TC: [mailto:ochaturv@purdue.edu Ojas Chaturvedi], [mailto:yunglu@purdue.edu Yung-Hsiang Lu], [mailto:yun98@purdue.edu Kristen Yeon-Ji Yun], [mailto:ziyu.wang@nyu.edu Ziyu Wang], [mailto:yujia.yan@rochester.edu Yujia Yan]>
+For inquiries, contact:
 = Bibliography =
 # TBA

← Older revision		Revision as of 06:17, 6 August 2025
Line 1:		Line 1:
−	The ~~task captain has not yet added anything~~ on this ~~page~~.	+	= Description =
		+
		+	The '''MIREX2025: Polyphonic Transcription Challenge''' invites participants to build systems that transcribe short synthesized classical music recordings into structured symbolic representations using the Musical Instrument Digital Interface (MIDI) format.
		+
		+	Given an input audio signal '''X''', the goal is to predict a set of musical events '''Ŷ''' consisting of pitch, onset time, offset time, velocity (dynamics), and optionally instrument class labels:
		+
		+	Ŷ = argmax<sub>Y</sub> P(Y \| X)
		+
		+	Each predicted note is represented by a tuple:
		+
		+	ŷ<sub>i</sub> = (pitch<sub>i</sub>, onset<sub>i</sub>, offset<sub>i</sub>, velocity<sub>i</sub>, instrument<sub>i</sub>)
		+
		+	The challenge targets expressive, polyphonic classical music played by small ensembles of up to three instruments. Audio clips are short (up to 20 seconds), but realistic, with expressive dynamics and articulation. Unlike past editions, all audio files will be in '''.wav''' format, with CD-quality specifications (PCM, 16-bit, 44.1 kHz).
		+
		+	To help participants leverage instrument information, filenames include MIDI instrument codes per the General MIDI specification. Use of this metadata is optional but incentivized through the scoring system.
		+
		+	= Evaluation =
		+
		+	Participants' submissions are scored on the following axes:
		+
		+	* '''Pitch Accuracy''': Precision, recall, and F1 of estimated pitches.
		+	* '''Onset Accuracy''': Deviation from ground-truth note onsets.
		+	* '''Offset Accuracy''': Deviation from ground-truth note offsets.
		+	* '''Velocity Accuracy''': Normalized difference from true note intensities.
		+	* '''Instrument Identification (Optional)''': Penalized if instruments are misclassified. Reduced penalty if mistakes occur within the same instrument family.
		+
		+	All evaluations are done using a hidden test set. A public leaderboard is maintained on sample data, but final rankings will be determined using holdout data to assess generalization.
		+
		+	= Submission Format =
		+
		+	Each participant must maintain a GitHub repository with the following structure:
		+
		+	=== Repository Requirements ===
		+
		+	* A branch named '''submission''' must contain the model code.
		+	* A top-level file '''main.py''' that takes the following arguments:
		+
		+	<code>python main.py -i <input.wav> -o <output.mid></code>
		+
		+	* A valid '''environment.yml''' for Conda environment creation.
		+	* All paths must be relative to the '''main.py''' file location.
		+
		+	=== Instrument Codes in File Names ===
		+
		+	Input files will be named as follows:
		+
		+	<code>1.0_40_70.wav</code>
		+
		+	Here, '''0''', '''40''', and '''70''' represent the MIDI program numbers of the instruments present (e.g., Piano, Violin, Bassoon). Participants may parse this information or ignore it. Misclassification penalties apply as described in the evaluation section.
		+
		+	= Dataset and Sample Materials =
		+
		+	Participants may use any public or private datasets for training. The organizers provide a set of '''20 public sample compositions''' with:
		+
		+	* '''Audio''': Synthesized '''.wav''' files (16-bit, 44.1 kHz)
		+	* '''Scores''': Corresponding MIDI, PDF, and MusicXML files
		+
		+	The instruments featured include: ''Piano, Violin, Cello, Flute, Bassoon, Trombone, Oboe, and Viola''. Certain combinations of these instruments will not appear due to the similarity of their timbres, such as violin and viola, or oboe and bassoon.
		+
		+	Reference implementations provided include:
		+
		+	* '''MT3 (Multi-Task Multitrack Transcription)''': Transformer-based model from Google Magenta
		+	* '''Basic Pitch''': Lightweight transcription model by Spotify
		+	* '''ReconVAT''': Semi-supervised VAE-based transcription system
		+
		+	= Schedule =
		+
		+	'''TBD'''
		+	Task deadline is 9/8
		+
		+	= Prizes and Open Source Policy =
		+
		+	'''TBD'''
		+	To be considered as a winner and receive the prize, the participating team must open-source their solution, showing both the GitHub repository as well as documentation detailing the changes they have made or the algorithms they have implemented.
		+
		+	= Task Captains =

	For any question: <TC: [mailto:ochaturv@purdue.edu Ojas Chaturvedi], [mailto:yunglu@purdue.edu Yung-Hsiang Lu], [mailto:yun98@purdue.edu Kristen Yeon-Ji Yun], [mailto:ziyu.wang@nyu.edu Ziyu Wang], [mailto:yujia.yan@rochester.edu Yujia Yan]>		For any question: <TC: [mailto:ochaturv@purdue.edu Ojas Chaturvedi], [mailto:yunglu@purdue.edu Yung-Hsiang Lu], [mailto:yun98@purdue.edu Kristen Yeon-Ji Yun], [mailto:ziyu.wang@nyu.edu Ziyu Wang], [mailto:yujia.yan@rochester.edu Yujia Yan]>
		+
		+	= Bibliography =
		+
		+	# TBA

← Older revision		Revision as of 03:57, 1 August 2025
Line 1:		Line 1:
	The task captain has not yet added anything on this page.		The task captain has not yet added anything on this page.

−	For any question: <TC: [mailto:yunglu@purdue.edu Yung-Hsiang Lu], [mailto:yun98@purdue.edu Kristen Yeon-Ji Yun], [mailto:ziyu.wang@nyu.edu Ziyu Wang], [mailto:yujia.yan@rochester.edu Yujia Yan]>	+	For any question: <TC: [mailto:ochaturv@purdue.edu Ojas Chaturvedi], [mailto:yunglu@purdue.edu Yung-Hsiang Lu], [mailto:yun98@purdue.edu Kristen Yeon-Ji Yun], [mailto:ziyu.wang@nyu.edu Ziyu Wang], [mailto:yujia.yan@rochester.edu Yujia Yan]>

← Older revision	Revision as of 15:31, 28 July 2025
Line 1:	Line 1:
	+	The task captain has not yet added anything on this page.

	+	For any question: <TC: [mailto:yunglu@purdue.edu Yung-Hsiang Lu], [mailto:yun98@purdue.edu Kristen Yeon-Ji Yun], [mailto:ziyu.wang@nyu.edu Ziyu Wang], [mailto:yujia.yan@rochester.edu Yujia Yan]>