Project :: ECE 445 - Senior Design Laboratory

#	Title	Team Members	TA	Documents	Sponsor
34	Virtual Band	Han Chen Lenny Liu Xuan Tang Zhanpeng Li		design_document1.pdf proposal2.pdf proposal3.pdf proposal1.pdf	Huan Hu
	The goal of the Virtual Band project is to provide a new musical instrument interface that provides users with an exclusive and engaging experience. The system's integration of pressure sensors enables precise measurement of the pressing pressure applied by the user, thereby influencing the instrument's output sound level. A camera is also used to follow the hand's movement, which makes instrument key detection easier and improves the user's intuitive interface interaction. The electrical impulses are converted into high-quality instrument sound outputs by utilizing cutting-edge audio processing techniques, giving consumers a smooth and genuine musical performance experience. In order to create a dynamic and captivating musical interface, the Virtual Band project combines motion tracking, audio processing, and sensor technologies—a new approach to music technology.

Featured Project

TEAM MEMBERS

Dalei Jiang (daleij2)

Zifei Han (zifeih2)

Chang Liu (changl12)

Kunle Li (kunleli2)

PROJECT TITLE

Robot for Gym Exercise Guidance

PROBLEM

In modern society, daily fitness is a necessary life choice for healthy people. When it comes to fitness, the standard of movement is very important. However, hiring a coach exclusively for instruction is sometimes not a convenient and economical option. We think robots are perfectly capable of determining whether a person's movements are in place. To this end, we need to propose a scheme to design a robot that can walk behind people and use certain technologies to identify human movements when people are moving, compare with the existing action models, and give an evaluation.

SOLUTION OVERVIEW

Our solution is to design a robot that included a chassis that drove the motion on the bottom and a computer operating system and camera on the top. With ultrasonic radar and cameras, the robot can follow the target. When the "motion assessment" module starts to operate, the camera will capture video information and begin motion analysis at the same time. The analysis of human motion will be completed as soon as possible and the standard evaluation of motion will be given. At the same time, we will design some multimedia files, such as sound and video, to interact with the user.

SOLUTION COMPONENTS

Based on the introduction above, several systems need to be implemented to realize the solution.

SUBSYSTEM 1: BOTTOM MOBILE PLATFORM PROGRAMMING

We plan to take use of the EAI SMART robot platform as the base movement platform of the robot. We will do the programming based on the ROS system to realize automatic navigation, path planning, and object tracking.

SUBSYSTEM 2: SKELETAL BINDING AND MOVEMENT ANALYSIS OF THE HUMAN BODY

The most important part of this program is that we will use the Mask R-CNN to do the skeletal binding to determine the human's movement. We will try to train an efficient model to help us realize fast analysis.

SUBSYSTEM 3: MAN-MACHINE INTERACTIVE SYSTEM

As a user-oriented product, we need to design a friendly human-computer interface to realize the free conversion of functions.

SUBSYSTEM 4: MOVEMENT STANDARD ALGORITHM

We need to devise an algorithm to assess the deviation between the gymnast's movements and the standard. This algorithm is very important for the final product performance feedback.

CRITERION FOR SUCCESS

The robot can self-navigate to find people in the gym.

The robot can monitor the person doing exercise and extract human poses.

The robot can check whether the person is doing correctly in the exercise.

DISTRIBUTION OF WORK

Dalei Jiang: Skeletal binding and movement analysis of the human body

Zifei Han: Bottom mobile platform programming

Chang Liu: Man-machine interactive system building

Kunle Li: Movement standard algorithm designing