Project

# Title Team Members TA Documents Sponsor
64 Ѡand: GESTURE CONTROLLED SYSTEM FOR SMART HOME
Ahmed Farooqi
Samarth Makhija
Yashovardhan Arora
Shuai Tang final_paper4.pdf
**Problem statement:** The lack of gesture controlled devices calls for a niche in the market that hasn’t been tackled. Gestures and body language have the potential to serve as intuitive ways to interact with technology and we aim to tackle this problem by creating a feature gesture-controlled system for a smart home.

**Solution overview:** We are making a system of a hub and a smart band which specializes in detecting gestures to control various devices. Our band would send input data from inertial measurement unit sensors to the hub which will use our algorithm to detect the gesture. Upon detecting the gesture, it would signal the appropriate device to perform the action signaled by the gesture.

To avoid false positives, our system would have a signature gesture that would signal our hub to start looking for gestures.

**Solution Components:**

**Wrist Band:** The band will act as the detector of all gestures performed by the user. It will be designed using a flexible PCB with IMU sensors (Accelerometer, Gyroscope, and Magnetometer) that will send raw data to a hub. The wrist band would also contain an IR emitter to allow for detection when a device is pointed at.

**Hub:** The hub will serve as the center of our ecosystem by being able to recognize and interpret the incoming gestures from the bands and be able to control other devices.

**Device Connections:** Our device will need to connect with smart devices through wifi/ bluetooth and through Infrared sensors.

**Criterion for Success:** For this project to be an effective solution to controlling devices in a smart home, there are a few key abilities that we will need to have:

1. To control home devices with gesture control
2. Compute and recognize gestures by the band and interact with smart devices
3. Competitive pricing to Google Home/ Amazon echo

BusPlan

Aashish Kapur, Connor Lake, Scott Liu

BusPlan

Featured Project

# People

Scott Liu - sliu125

Connor Lake - crlake2

Aashish Kapur - askapur2

# Problem

Buses are scheduled inefficiently. Traditionally buses are scheduled in 10-30 minute intervals with no regard the the actual load of people at any given stop at a given time. This results in some buses being packed, and others empty.

# Solution Overview

Introducing the _BusPlan_: A network of smart detectors that actively survey the amount of people waiting at a bus stop to determine the ideal amount of buses at any given time and location.

To technically achieve this, the device will use a wifi chip to listen for probe requests from nearby wifi-devices (we assume to be closely correlated with the number of people). It will use a radio chip to mesh network with other nearby devices at other bus stops. For power the device will use a solar cell and Li-Ion battery.

With the existing mesh network, we also are considering hosting wifi at each deployed location. This might include media, advertisements, localized wifi (restricted to bus stops), weather forecasts, and much more.

# Solution Components

## Wifi Chip

- esp8266 to wake periodically and listen for wifi probe requests.

## Radio chip

- NRF24L01 chip to connect to nearby devices and send/receive data.

## Microcontroller

- Microcontroller (Atmel atmega328) to control the RF chip and the wifi chip. It also manages the caching and sending of data. After further research we may not need this microcontroller. We will attempt to use just the ens86606 chip and if we cannot successfully use the SPI interface, we will use the atmega as a middleman.

## Power Subsystem

- Solar panel that will convert solar power to electrical power

- Power regulator chip in charge of taking the power from the solar panel and charging a small battery with it

- Small Li-Ion battery to act as a buffer for shady moments and rainy days

## Software and Server

- Backend api to receive and store data in mongodb or mysql database

- Data visualization frontend

- Machine learning predictions (using LSTM model)

# Criteria for Success

- Successfully collect an accurate measurement of number of people at bus stops

- Use data to determine optimized bus deployment schedules.

- Use data to provide useful visualizations.

# Ethics and Safety

It is important to take into consideration the privacy aspect of users when collecting unique device tokens. We will make sure to follow the existing ethics guidelines established by IEEE and ACM.

There are several potential issues that might arise under very specific conditions: High temperature and harsh environment factors may make the Li-Ion batteries explode. Rainy or moist environments may lead to short-circuiting of the device.

We plan to address all these issues upon our project proposal.

# Competitors

https://www.accuware.com/products/locate-wifi-devices/

Accuware currently has a device that helps locate wifi devices. However our devices will be tailored for bus stops and the data will be formatted in a the most productive ways from the perspective of bus companies.