Project

# Title Team Members TA Documents Sponsor
67 VR Hand Simulator
Alex Brannick
Daryl Drake
Dongwei Shi design_document5.pdf
final_paper2.pdf
presentation1.pdf
proposal1.pdf
Team Members:
Alex Brannick (brannic2)
Daryl Drake (dadrake3)

Title:
VR Hand Simulator

Description:
Our project idea consists of making a headset of cameras that can accurately track and segment your hands to be used in VR. Using some sort of reflective tape for our hands, we would train two CNNs to trace the location of our hands as well as segment the joints in our fingers to be able to recreate our hands in a virtual environment. From here, we would create a plug in for our device within the Unity game engine so that games for an Oculus Go could be created that use our device. We believe this project is appropriate for a senior design project because it solves a current problem in society and contains a definitive circuit portion. It provides a solution to the problem where games for the Oculus Go are not immersive enough when it comes to complex hand interactions. The circuit portion of our project consists of the headset, where we will need to create a pcb that links our cameras to a raspberry pi and TPU to do the image processing. Furthermore, our team has a lot of experience in almost all of the parts of this project. We have both worked with the Unity game engines to create games, and have even made VR games in the past for an Oculus Go. Our team has also done multiple projects both in and out of class with CNNs. One example being faceid software that locates and identifies our face to be used in unlocking our MacBooks.

One project that has some correlation to ours was the drone hand controller. This project uses a hand to control a drone instead of a typical controller, similar to how ours would replace the oculus joysticks for certain games. However, our project differs from there's because while their project is controlling a drone, we our focused on recreating your exact hand movements and interactions to be used in gaming.

Modularized Electronic Locker

Jack Davis, Joshua Nolan, Jake Pu

Modularized Electronic Locker

Featured Project

Group Member: Jianhao (Jake) Pu [jpu3], Joshua Nolan [jtnolan2], John (Jack) Davis [johnhd4]

Problem:

Students living off campus without a packaging station are affected by stolen packages all the time. As a result of privacy concerns and inconsistent deployment, public cameras in Champaign and around the world cannot always be relied upon. Therefore, it can be very difficult for victims to gather evidence for a police report. Most of the time, the value of stolen items is small and they are usually compensated by the sellers (Amazon and Apple are very understanding). However, not all deliveries are insured and many people are suffering from stolen food deliveries during the COVID-19 crisis. We need a low-cost solution that can protect deliveries from all vendors.

Solution Overview:

Our solution is similar to Amazon Hub Apartment Locker and Luxer One. Like these services, our product will securely enclose the package until the owners claim the contents inside. The owner of the contents can claim it using a phone number or a unique user identification code generated and managed by a cloud service.

The first difference we want to make from these competitors is cost. According to an article, the cost of a single locker is from $6000 - $20000. We want to minimize such costs so that we can replace the traditional mailbox. We talked to a Chinese manufacturer and got a hardware quote of $3000. We can squeeze this cost if we just design our own control module on ESP32 microcontrollers.

The second difference we want to make is modularity. We will have a sensor module, a control module, a power module and any number of storage units for hardware. We want to make standardized storage units that can be stacked into any configuration, and these storage units can be connected to a control module through a communication bus. The control module houses the hardware to open or close all of the individual lockers. A household can purchase a single locker and a control module just for one family while apartment buildings can stack them into the lockers we see at Amazon Hub. I think the hardware connection will be a challenge but it will be very effective at lowering the cost once we can massively manufacture these unit lockers.

Solution Components:

Storage Unit

Basic units that provide a locker feature. Each storage unit will have a cheap microcontroller to work as a slave on the communication bus and control its electronic lock (12V 36W). It has four connectors on top, bottom, left, and right sides for stackable configuration.

Control Unit

Should have the same dimension as one of the storage units so that it could be stacked with them. Houses ESP32 microcontroller to run control logics on all storage units and uses the built-in WiFi to upload data to a cloud server. If sensor units are detected, it should activate more security features accordingly.

Power Unit

Power from the wall or from a backup battery power supply and the associated controls to deliver power to the system. Able to sustain high current in a short time (36W for each electronic lock). It should also have protection against overvoltage and overcurrent.

Sensor Modules

Sensors such as cameras, motion sensors, and gyroscopes will parlay any scandalous activities to the control unit and will be able to capture a photo to report to authorities. Sensors will also have modularity for increased security capabilities.

Cloud Support

Runs a database that keeps user identification information and the security images. Pushes notification to end-users.

Criterion for Success:

Deliverers (Fedex, Amazon, Uber Eats, etc.) are able to open the locker using a touchscreen and a use- provided code to place their package inside. Once the package is inside of the locker, a message will be sent to the locker owner that their delivery has arrived. Locker owners are able to open the locker using a touchscreen interface. Owners are also able to change the passcode at any time for security reasons. The locker must be difficult to break into and offer theft protection after multiple incorrect password attempts.

Project Videos