Project

# Title Team Members TA Documents Sponsor
43 FPS Game Somatosensory Enhancement Gun Controller
 Beining Chen
Haochen Zhang
Peilin He
 Yixuan Wang design_document1.pdf
final_paper2.pdf
photo1.jpg
photo2.jpg
proposal1.pdf
video
# FPS Game Somatosensory Enhancement Gun Controller

## Team Members:
- Peilin He (peilinh2)
- Beining Chen (Beining4)
- Haochen Zhang (Hz39)

# Problem

The functions of video game controllers nowadays are very limited to the gaming machine, and are mostly in the form of joy-stick or controller. Playing shooting games on PC with a mouse or joystick can lower a gamer's gaming experience and make gaming a less realistic experience.. Especially when VR games slowly occupy the video game market,a non-traditional controller, or a somatosensory enhancement gun-shaped controller is necessary.

# Solution

The solution is to introduce the use of Somatosensory Enhancement accessories. A Somatosensory Enhancement shooting controller can make shooting video games more realistic and interactive. We plan to build a gun-shaped shooting controller that could simulate target aiming, gun recoil, reload bullets, and potentially flash bomb and smoke bomb.



# Solution Components

## Subsystem 1: Processor
We will use a PIC32 microcontroller to handle memory allocation for the cache. It can also communicate with the Wifi chip to transfer data.
https://www.mouser.com/new/microchip/microchip_pic32/

## Subsystem 2: Wireless connection
First of all, our design regarding a gun-model video game controller is not only limited to video games. It could also accomplish the function of a mouse which could control the cursor. Therefore, a wireless connection such as bluetooth is needed.

### Wireless Connection parts:
ESP32-PICO-D4 Espressif Systems ESP32 PICO module. https://www.gridconnect.com/products/esp32-pico-d4-espressif-systems-esp32-pico-module?variant=9740028510244&utm_term=&utm_campaign=Shopping+-+Desktop&utm_source=adwords&utm_medium=ppc&hsa_acc=7986939350&hsa_cam=18566303751&hsa_grp=147887861968&hsa_ad=627525968785&hsa_src=g&hsa_tgt=pla-2078855464952&hsa_kw=&hsa_mt=&hsa_net=adwords&hsa_ver=3&gclid=Cj0KCQiAw8OeBhCeARIsAGxWtUwmVoJj798qb5FMj6avdIXGO-ydMxWrTO9nwvRTR41JAaAWuykQRAQaAodcEALw_wcB

DROK 12V Audio Receiver Blue~Tooth Module DC 5V-12V Portable Wire~Less Electronics Stereo Music Receive Circuit Chip https://www.amazon.com/Bluetooth-DROK-Receiver-Electronics-Headphone/dp/B07P94Z9XR/ref=sr_1_5?crid=25GB25DVFXH3E&keywords=bluetooth%2Bchip&qid=1674762910&sprefix=bluetooth%2Bchip%2B%2Caps%2C365&sr=8-5&th=1




## Subsystem 3: Motion detection
Motion detector
Use gyroscope somatosensory to control the computer cursor.
HiLetgo GY-521 MPU-6050
https://www.amazon.com/HiLetgo-MPU-6050-Accelerometer-Gyroscope-Converter/dp/B01DK83ZYQ/ref=sr_1_3?keywords=Gyroscope%2BSensor&qid=1674763585&sr=8-3&th=1



## Subsystem 4: Vibration
Vibrator to simulate gun recoil. We can use a motor vibration part to achieve this. We will be using a 308-100 8mm vibration motor to mount on our PCB.
https://www.precisionmicrodrives.com/ab-006


## Subsystem 5: Power
This subsystem will supply power to the rest of the sub-system. It contains a battery and a USB charger. If available batteries can not provide enough power, we will choose to use external power supplies.

# Criterion For Success

Our solution should be easily accessible from any computer with bluetooth.
Our gun controller should function as a cursor that accurately reflects the aiming point on the screen.In FPS video games, physically turning the aiming point left and right will turn the player's angle of view left and right with according degree. During a game, pulling the trigger on the gun controller will give the player physical shaking action to simulate gun recoil. Also, pulling the bolt will complete a bullet reload in the game.


# Anticipated Difficulties
Our anticipated difficulties revolve around connecting bluetooth from our device to a PC which can accurately reflect real time cursor position and functions similar to a mouse. Precisely connecting the gun controller with motion detector and gravity sensor to calculate screen coordinate to reflect cursor position is expected to take a long time implementing and debugging.

Final Presentation slides:
https://docs.google.com/presentation/d/1qrRwniksCi8U4OrzGqL8e-9CaAXRSu2n/edit?usp=sharing&ouid=115941454030265620199&rtpof=true&sd=true

Cloud-controlled quadcopter

Anuraag Vankayala, Amrutha Vasili

Cloud-controlled quadcopter

Featured Project

Idea:

To build a GPS-assisted, cloud-controlled quadcopter, for consumer-friendly aerial photography.

Design/Build:

We will be building a quad from the frame up. The four motors will each have electronic speed controllers,to balance and handle control inputs received from an 8-bit microcontroller(AP),required for its flight. The firmware will be tweaked slightly to allow flight modes that our project specifically requires. A companion computer such as the Erle Brain will be connected to the AP and to the cloud(EC2). We will build a codebase for the flight controller to navigate the quad. This would involve sending messages as per the MAVLink spec for sUAS between the companion computer and the AP to poll sensor data , voltage information , etc. The companion computer will also talk to the cloud via a UDP port to receive requests and process them via our code. Users make requests for media capture via a phone app that talks to the cloud via an internet connection.

Why is it worth doing:

There is currently no consumer-friendly solution that provides or lets anyone capture aerial photographs of them/their family/a nearby event via a simple tap on a phone. In fact, present day off-the-shelf alternatives offer relatively expensive solutions that require owning and carrying bulky equipment such as the quads/remotes. Our idea allows for safe and responsible use of drones as our proposed solution is autonomous, has several safety features, is context aware(terrain information , no fly zones , NOTAMs , etc.) and integrates with the federal airspace seamlessly.

End Product:

Quads that are ready for the connected world and are capable to fly autonomously, from the user standpoint, and can perform maneuvers safely with a very simplistic UI for the common user. Specifically, quads which are deployed on user's demand, without the hassle of ownership.

Similar products and comparison:

Current solutions include RTF (ready to fly) quads such as the DJI Phantom and the Kickstarter project, Lily,that are heavily user-dependent or user-centric.The Phantom requires you to carry a bulky remote with multiple antennas. Moreover,the flight radius could be reduced by interference from nearby conditions.Lily requires the user to carry a tracking device on them. You can not have Lily shoot a subject that is not you. Lily can have a maximum altitude of 15 m above you and that is below the tree line,prone to crashes.

Our solution differs in several ways.Our solution intends to be location and/or event-centric. We propose that the users need not own quads and user can capture a moment with a phone.As long as any of the users are in the service area and the weather conditions are permissible, safety and knowledge of controlling the quad are all abstracted. The only question left to the user is what should be in the picture at a given time.

Project Videos