Project
# | Title | Team Members | TA | Documents | Sponsor |
---|---|---|---|---|---|
67 | VR Hand Simulator |
Alex Brannick Daryl Drake |
Dongwei Shi | design_document5.pdf final_paper2.pdf presentation1.pdf proposal1.pdf |
|
Team Members: Alex Brannick (brannic2) Daryl Drake (dadrake3) Title: VR Hand Simulator Description: Our project idea consists of making a headset of cameras that can accurately track and segment your hands to be used in VR. Using some sort of reflective tape for our hands, we would train two CNNs to trace the location of our hands as well as segment the joints in our fingers to be able to recreate our hands in a virtual environment. From here, we would create a plug in for our device within the Unity game engine so that games for an Oculus Go could be created that use our device. We believe this project is appropriate for a senior design project because it solves a current problem in society and contains a definitive circuit portion. It provides a solution to the problem where games for the Oculus Go are not immersive enough when it comes to complex hand interactions. The circuit portion of our project consists of the headset, where we will need to create a pcb that links our cameras to a raspberry pi and TPU to do the image processing. Furthermore, our team has a lot of experience in almost all of the parts of this project. We have both worked with the Unity game engines to create games, and have even made VR games in the past for an Oculus Go. Our team has also done multiple projects both in and out of class with CNNs. One example being faceid software that locates and identifies our face to be used in unlocking our MacBooks. One project that has some correlation to ours was the drone hand controller. This project uses a hand to control a drone instead of a typical controller, similar to how ours would replace the oculus joysticks for certain games. However, our project differs from there's because while their project is controlling a drone, we our focused on recreating your exact hand movements and interactions to be used in gaming. |