|64||Virtual Grand Piano
|We are proposing to build an electronic system that behaves just like a grand piano without there being any physical object to receive key presses. We are planning to build the entire piano with 88 keys with sustain and touch pedals to authentically reflect the characteristics of a grand piano.
[Idea Post: https://courses.engr.illinois.edu/ece445/pace/view-topic.asp?id=25719]
To isolate the location and motion characteristics of a key press we plan to use multiple camera modules facing the player’s fingers which would be equipped with reflective material at the fingertips and accelerometers attached to each finger to provide information about the touch force. The input from each of the camera modules would be processed in real time using an FPGA and relayed to an audio synthesizer that would play the note on a speaker with the appropriate note and amplitude. We are planning to build the audio synthesizer to control aspects of the produced sound but only when we are done implementing the controller module.
We believe this would be a challenging project for senior design due to the complexities involved in processing and isolating each of the user’s finger locations in three dimensions in real-time and incorporating readings from the wireless accelerometers and sustain pedals. We have not encountered a virtual piano implementation similar to ours that uses camera sensors and accelerometers to isolate the user’s hand movements.