VibroSonics: Haptic Audio Sensations: CS Team
As part of the VibroSonics team, you will work in a multidisciplinary design environment across Computer Science and Electrical Engineering teams to design and prove a device that translates musical and other sounds from the human spectrum of hearing into tactile-haptic vibrations for the human body. This will be the basis for an open source wearable device that enables Deaf and Hard of Hearing individuals, gamers, and workers in high-noise situations feel critical sonic cues and music through vibration.
Objectives
As part of the VibroSonics Computer Science team, you will:
- Use initial prototype from last year to program and improve existing music-to-haptics audio encoder algorithm from Max to C/C++ to run on an ESP32 Arduino-programmable microprocessor.
- Create firmware for the device to translate audio input into vibration
- Create an ADSR (attack-decay-sustain-release) envelope manager for shaping subwoofer vibrational signals over time
- Create a “vocabulary” of vibrational signals using the ADSR manger
- Produce an API that would let developers create their own audio-responsive haptic applications without needing to reprogram the embedded hardware.
Motivations
One of the most exhilarating aspects of experiencing live music events is “feeling” the sound pump against your skin. What if you could experience this sensation from your own playlist anywhere you go? Vibrosonics translates audio from the spectrum of human hearing into the tactile sub-audio range to drive vibrations through the body. This is accomplished through a unique audio encoding process that you will help improve.
What would be some of the benefits of this technology? Ludwig Van Beethoven was famous for being a deaf composer who overcame the condition of his ears by using touch on the piano. This technology could enable Deaf and Hard of Hearing individuals to dance with and experience music in new ways; gamers in VR-AR to feel and react to more aspects of their environment, and workers in high-noise situations feel critical sonic cues to help them avoid accidents.
Qualifications
Minimum Qualifications:
- C/C++
- Interest in programming for devices and hardware
- Good organizational skills
- Collaborative
- A desire to learn listed Preferred Skills to accomplish goals
- Eager to learn new skills and adapt in a dynamic product development environment
- ESP32
- Fast Fourier Analysis (FFT) and Digital Signal Processing
- Arduino IDE and Arduino Libraries
- Personal experience related to Deaf and Hard-of-Hearing topics
- Microphone, Speaker driver, and other Audio Circuits
Details
Project Partner:
Chet Udell
NDA/IPA:No Agreement Required
Number Groups:1
Project Status:Accepting Applicants
Website:https://subpac.com/what-is-the-subpac/
Video:
https://youtu.be/V33LFuFTfM0
Keywords:
HCI / UX / UIOpen SourceAudioMultidisciplinaryDSPDigital Signal Processing