# Title Team Members TA Documents Sponsor
64 Virtual Grand Piano
Hammad Khan
Jeongsub Lee
Zhi Lu
Mickey Zhang design_document0.pdf
We are proposing to build an electronic system that behaves just like a grand piano without there being any physical object to receive key presses. We are planning to build the entire piano with 88 keys with sustain and touch pedals to authentically reflect the characteristics of a grand piano.

[Idea Post:]

To isolate the location and motion characteristics of a key press we plan to use multiple camera modules facing the player’s fingers which would be equipped with reflective material at the fingertips and accelerometers attached to each finger to provide information about the touch force. The input from each of the camera modules would be processed in real time using an FPGA and relayed to an audio synthesizer that would play the note on a speaker with the appropriate note and amplitude. We are planning to build the audio synthesizer to control aspects of the produced sound but only when we are done implementing the controller module.

We believe this would be a challenging project for senior design due to the complexities involved in processing and isolating each of the user’s finger locations in three dimensions in real-time and incorporating readings from the wireless accelerometers and sustain pedals. We have not encountered a virtual piano implementation similar to ours that uses camera sensors and accelerometers to isolate the user’s hand movements.

VoxBox Robo-Drummer

Craig Bost, Nicholas Dulin, Drake Proffitt

VoxBox Robo-Drummer

Featured Project

Our group proposes to create robot drummer which would respond to human voice "beatboxing" input, via conventional dynamic microphone, and translate the input into the corresponding drum hit performance. For example, if the human user issues a bass-kick voice sound, the robot will recognize it and strike the bass drum; and likewise for the hi-hat/snare and clap. Our design will minimally cover 3 different drum hit types (bass hit, snare hit, clap hit), and respond with minimal latency.

This would involve amplifying the analog signal (as dynamic mics drive fairly low gain signals), which would be sampled by a dsPIC33F DSP/MCU (or comparable chipset), and processed for trigger event recognition. This entails applying Short-Time Fourier Transform analysis to provide spectral content data to our event detection algorithm (i.e. recognizing the "control" signal from the human user). The MCU functionality of the dsPIC33F would be used for relaying the trigger commands to the actuator circuits controlling the robot.

The robot in question would be small; about the size of ventriloquist dummy. The "drum set" would be scaled accordingly (think pots and pans, like a child would play with). Actuators would likely be based on solenoids, as opposed to motors.

Beyond these minimal capabilities, we would add analog prefiltering of the input audio signal, and amplification of the drum hits, as bonus features if the development and implementation process goes better than expected.

Project Videos