Project

# Title Team Members TA Documents Sponsor
32 Maestro Mittens
Kushal Majmundar
Shayna Kapadia
Tulika Gupta
Chi Zhang design_document1.pdf
design_document4.pdf
design_document5.pdf
design_document6.pdf
design_document9.pdf
design_document10.pdf
design_document11.pdf
final_paper1.pdf
other1.docx
proposal1.pdf
Problem:
Not everyone knows how to play an instrument. And if they do, they might not know how to do it well and be able to stay in key. But they would like to be able to make some music!

Solution Overview:
We propose a hand gesture controlled instrument. Much like how a conductor waves their hands around, so would you. The gestures would translate into notes, and things like how quickly you move would make the music faster or slower as well. An accelerometer/gyroscope would be able to detect speeds and direction, while flex resistors on your fingers could control other musical aspects. These flex sensors will control how many notes you could play at a given time. For example, if you want to play a 3 note chord you could hold three fingers down.
The gesture control would be just for one instrument. We plan on making our own tones to use. For each note in a given range of notes, we will produce our own unique sound. In order to ensure that the sounds made by the user are pleasant to the ear, we will make the range of notes possible set to only notes in a specific key.

Solution Components
Power Subsystem
The gloves will be powered with the help of a lithium ion battery.

Sensor Subsystem
An Accelerometer/Gyroscope sensor placed at your wrist which can calculate the speed of your hands as well as the angle. The angle value will be used to distort the chord you play with your fingers.
Flex Sensors will be placed in each finger of the glove to detect the angle at which you bend your fingers and how many fingers are bent.

Processing Subsystem
An ESP8266 wifi board to accumulate and send out the data to a computer which will then realize the note to play and then play it.

Criterion for Success
Our gloves will allow the wearer to produce some sort of music in response to their hand/arm gestures and motions.

There’s a company called Stretchsense which has a hand gesture based glove. However, their product isn’t specialized as a musical instrument, as our project aims to be. Also, it appears that their gloves produce music based on their orientation with respect to a curved table, not just the gloves themselves. In addition, their product is very expensive and uses expensive sensors; while ours will aim to be more cost efficient.

Low Cost Myoelectric Prosthetic Hand

Michael Fatina, Jonathan Pan-Doh, Edward Wu

Low Cost Myoelectric Prosthetic Hand

Featured Project

According to the WHO, 80% of amputees are in developing nations, and less than 3% of that 80% have access to rehabilitative care. In a study by Heidi Witteveen, “the lack of sensory feedback was indicated as one of the major factors of prosthesis abandonment.” A low cost myoelectric prosthetic hand interfaced with a sensory substitution system returns functionality, increases the availability to amputees, and provides users with sensory feedback.

We will work with Aadeel Akhtar to develop a new iteration of his open source, low cost, myoelectric prosthetic hand. The current revision uses eight EMG channels, with sensors placed on the residual limb. A microcontroller communicates with an ADC, runs a classifier to determine the user’s type of grip, and controls motors in the hand achieving desired grips at predetermined velocities.

As requested by Aadeel, the socket and hand will operate independently using separate microcontrollers and interface with each other, providing modularity and customizability. The microcontroller in the socket will interface with the ADC and run the grip classifier, which will be expanded so finger velocities correspond to the amplitude of the user’s muscle activity. The hand microcontroller controls the motors and receives grip and velocity commands. Contact reflexes will be added via pressure sensors in fingertips, adjusting grip strength and velocity. The hand microcontroller will interface with existing sensory substitution systems using the pressure sensors. A PCB with a custom motor controller will fit inside the palm of the hand, and interface with the hand microcontroller.

Project Videos