MIDI Performance Data Collection

Design a website that collects synchronized audio and MIDI performances by users at home playing a MIDI-enabled instrument.  This website will need to interface with the MIDI interface of the user's OS. When a user presses “Record”, this site will collect synchronized recordings of audio (.wav) and MIDI (.mid). These performances will be later used to teach AI to automatically transcribe audio. 

Objectives

  1. Design a website that collects synchronized recordings audio and MIDI capturing a musical performance.
  2. Provide a user interface to enable the user to record information about the performance. 
    • e,g., title, composer, instrument, microphone, etc. 
  3. Maintain a cloud-based dataset of collected data.
  4. Validate product with a small and informal field study. 

Motivations

The task of automatically transcribing audio to musical notation is a task of great interest to the field of music information retrieval. Existing datasets center around the Yamaha Disklavier digital piano, because of the availability of data. We desire a crowd-sourced website to enable the collection of audio-MIDI synchronized data from any MIDI-enabled device, such as wind-controllers, guitars and keytars, and percussion. 

Qualifications

Minimum Qualifications:
  • CS 290 (web dev)
  • music lover

Preferred Qualifications:
  • experience with signal processing, audio, or music technology
  • ability to read music (minimal)
  • CS 492 (mobile) or CS 493 (cloud)


Details

Project Partner:

Patrick Donnelly

NDA/IPA:

No Agreement Required

Number Groups:

1

Project Status:

Accepting Applicants

Website:
https://soundbendor.org/
Card Image Capstone