Project

# Title Team Members TA Documents Sponsor
44 4D MEDIA/Video Game JACKET
Anushi Aggarwal
Hritik Raj
Saksham Gupta
Haoqing Zhu design_document1.pdf
design_document2.pdf
design_document3.pdf
final_paper1.pdf
final_paper2.pdf
4D MEDIA/Video Game JACKET

**TEAM MEMBERS**
Anushi Aggarwal (anushia2), Hritik Raj (hraj2), Saksham Gupta (saksham3)

**PROBLEM**

Amidst the pandemic we rely more than ever on media forms to keep us entertained. Movies, music, and video game technology sales are at a peak now and new innovations are needed to keep up with the amount that we have come to rely on these media forms. The status quo of these media forms rely on a very 2D experience which after about a year of quarantining has become boring, as well as the fact that this 2D experience is not indicative of the technological innovations of our time today.

**SOLUTION OVERVIEW**

We want to create a jacket that provides a 4D experience for various media forms. Specifically, we will be focusing on movies, music, and video games. Instead of just being able to hear sound and see visuals, we want to create a more engaging media experience by enabling users to actually feel these media forms through vibrations and shocks from our jacket. For example, in movies users can feel the vibrations of sitcom audience laughter or explosions, in music users can feel the vibrations of the beats, and in video games users can feel the shock of a gunshot and hits.

**SOLUTION COMPONENTS
SENSOR SUBSYSTEM**

The jacket will be composed of an array of different sensors to allow the user to feel the corresponding media that they want. We are currently thinking of using different types of sensors to provide the 4D feeling to the user. We will provide 3 specific applications: movies, music and video games. For the music aspect we will use vibrational motor and haptic feedback and pinpointed locations around the upper body that will provide the most pleasure biologically. It will be similar for movies. For the video game aspect, there are a few different things that we will use. We will use the same haptic feedback motor at a much higher rate, an electric shock motor, and possibly an airbag that could inflate and deflate on its own to mimic a gunshot. All of these would be controlled by a Raspberry Pi/ Arduino and hooked up to a portable power source. Additionally, we would incorporate a bluetooth module that would connect to the interfacing application on a mobile device.

**INTERACTIVE APP SUBSYSTEM**

We will design an interactive app that lets users interact with the jacket for demo purposes. This software will let users experience what the different types of haptic feedback feel like. It will also allow users to connect with song streaming services. Once users start listening to music on their headphones, they will be able to feel the jacket responding to the bass, rhythm and beat of the song. This will be achieved by converting sound signals into haptic feedback.

**CRITERION FOR SUCCESS**

The most important goal for us to reach in this project is to have a functioning jacket that can create physical vibrations based on different media - movies, music, and video games. We want to successfully create a more engaging media experience through this jacket by upgrading from a 2D experience to a 4D experience. One criterion is that in movies, the jacket is able to simulate certain actions from the movie onto the jacket. Another criterion is that when music is played, the jacket vibrates and the appropriate rate providing the user a 4D music experience. In video games, when the user specifies where to be shot, the user will feel a shock in that location. Currently, very few video games provide the data needed to connect to the jacket wirelessly, so we will provide the data for the jacket as a prototype.


Electronic Replacement for COVID-19 Building Monitors @ UIUC

Patrick McBrayer, Zewen Rao, Yijie Zhang

Featured Project

Team Members: Patrick McBrayer, Yijie Zhang, Zewen Rao

Problem Statement:

Students who volunteer to monitor buildings at UIUC are at increased risk of contracting COVID-19 itself, and passing it on to others before they are aware of the infection. Due to this, I propose a project that would create a technological solution to this issue using physical 2-factor authentication through the “airlock” style doorways we have at ECEB and across campus.

Solution Overview:

As we do not have access to the backend of the Safer Illinois application, or the ability to use campus buildings as a workspace for our project, we will be designing a proof of concept 2FA system for UIUC building access. Our solution would be composed of two main subsystems, one that allows initial entry into the “airlock” portion of the building using a scannable QR code, and the other that detects the number of people that entered the space, to determine whether or not the user will be granted access to the interior of the building.

Solution Components:

Subsystem #1: Initial Detection of Building Access

- QR/barcode scanner capable of reading the code presented by the user, that tells the system whether that person has been granted or denied building access. (An example of this type of sensor: (https://www.amazon.com/Barcode-Reading-Scanner-Electronic-Connector/dp/B082B8SVB2/ref=sr_1_11?dchild=1&keywords=gm65+scanner&qid=1595651995&sr=8-11)

- QR code generator using C++/Python to support the QR code scanner.

- Microcontroller to receive the information from the QR code reader and decode the information, then decide whether to unlock the door, or keep it shut. (The microcontroller would also need an internal timer, as we plan on encoding a lifespan into the QR code, therefore making them unusable after 4 days).

- LED Light to indicate to the user whether or not access was granted.

- Electronic locking mechanism to open both sets of doors.

Subsystem #2: Airlock Authentication of a Single User

- 2 aligned sensors ( one tx and other is rx) on the bottom of the door that counts the number of people crossing a certain line. (possibly considering two sets of these, so the person could not jump over, or move under the sensors. Most likely having the second set around the middle of the door frame.

- Microcontroller to decode the information provided by the door sensors, and then determine the number of people who have entered the space. Based on this information we can either grant or deny access to the interior building.

- LED Light to indicate to the user if they have been granted access.

- Possibly a speaker at this stage as well, to tell the user the reason they have not been granted access, and letting them know the

incident has been reported if they attempted to let someone into the building.

Criterion of Success:

- Our system generates valid QR codes that can be read by our scanner, and the data encoded such as lifespan of the code and building access is transmitted to the microcontroller.

- Our 2FA detection of multiple entries into the space works across a wide range of users. This includes users bound to wheelchairs, and a wide range of heights and body sizes.