VibroSonics: Haptic Audio Sensations: CS Team

As part of the VibroSonics team, you will work in a multidisciplinary design environment across Computer Science and Electrical Engineering teams to design and prove a device that translates musical and other sounds from the human spectrum of hearing into tactile-haptic vibrations for the human body. This will be the basis for an open source wearable device that enables Deaf and Hard of Hearing individuals, gamers, and workers in high-noise situations feel critical sonic cues and music through vibration.

Objectives

As part of the  VibroSonics Computer Science team, you will:

  • Use initial prototype from EE team to program and improve existing music-to-haptics audio encoder algorithm from Max to C/C++ to run on an ESP32 Arduino-programmable microprocessor.
  • Create firmware for the device to translate audio input into vibration
  • Create an ADSR (attack-decay-sustain-release) envelope manager for subwoofer signals
  • Create a “vocabulary” of vibrational signals using the ADSR manger
  • Create a smartphone web application to interact with user-input parameters: sensitivity, frequency response, TBD.

Motivations

One of the most exhilarating aspects of experiencing live music events is “feeling” the sound pump against your skin. What if you could experience this sensation from your own playlist anywhere you go? Vibrosonics translates audio from the spectrum of human hearing into the tactile sub-audio range to drive vibrations through the body. This is accomplished through a unique audio encoding process that you will help improve. 

What would be some of the benefits of this technology? Ludwig Van Beethoven was famous for being a deaf composer who overcame the condition of his ears by using touch on the piano. This technology could enable Deaf and Hard of Hearing individuals to dance with and experience music in new ways; gamers in VR-AR to feel and react to more aspects of their environment, and workers in high-noise situations feel critical sonic cues to help them avoid accidents.

Qualifications

Minimum Qualifications:

 

  • C/C++
  • Interest in programming for devices and hardware
  • Good organizational skills
  • Collaborative
  • A desire to learn listed Preferred Skills to accomplish goals
  • Eager to learn new skills and adapt in a dynamic product development environment

Preferred Qualifications:

Familiar with

  • ESP32
  • PCB Design
  • Arduino IDE and Arduino Libraries
  • Microphone, Speaker driver, and other Audio Circuits


Details

Project Partner:

Chet Udell

NDA/IPA:

No Agreement Required

Number Groups:

1

Project Status:

Rejected

Website:
https://subpac.com/what-is-the-subpac/
Card Image Capstone