Project
# | Title | Team Members | TA | Documents | Sponsor |
---|---|---|---|---|---|
29 | Interactive Mirror Display |
Hiraal Doshi Milankumar Pamela Sanan Stephen Hurwit |
Nicholas Ratajczyk | design_document2.pdf final_paper2.pdf other1.pdf photo1.jpg presentation1.pptx proposal1.pdf |
|
We plan to create an interactive mirror display which provides context sensitive information and media access to the user through a discreet and unobtrusive device. We intend to integrate gesture recognition, through the use of OpenCV, and voice commands, through the use of Alexa integration, which will allow the user to interact with the device and access further information. All of the software will be run on a Raspberry Pi and we will integrate a camera, microphone, and speakers. Additionally, as a reach goal, we plan on incorporating machine learning to recognize specific facial features, such as blemishes and wrinkles, in order to make relevant recommendations to the user. An example of this would be to train a model to recognize unusual facial characteristics and then recommend products that are on the market to address those unusual characteristics. This would be a completely optional feature that the user can choose to turn on or off to address the controversy that this mirror is used as a “beautifier”. This mechanic could also extend beyond the realm of cosmetics to fashion and other appearance based products. For example, a model could be trained to suggest items to complement the clothes you are wearing as well as appropriate colors and patterns. This feature could also be used to improve the online retail experience by recommending products , as described above, and displaying retail websites directly. We believe that this project will allow us to employ the skills that we have gained in our undergraduate coursework including embedded system development, computer vision and speech recognition techniques, user interface design, as well as other artificial intelligence and machine learning algorithms. We also feel that the flexibility presented by this project makes it a good fit, as we can easily shuffle features and functionalities and set reach goals to ensure the project fits within the scope of this course. There are many examples of DIY projects for smart mirrors, however most of them are little more than informational displays. There are several similar products on the market, although none are well established and most of them are little more than large android tablets installed behind a two-way mirror. The biggest flaw in these products which we hope to address is the lack of unique functionality and intuitive controls that differentiate the mirror from any number of existing devices, such as TVs or tablets. By providing a unique interactive experience which recognizes and takes advantage of the mirror form factor we hope to make the mirror more than just a hidden display. See our idea post for more details and discussion. https://courses.engr.illinois.edu/ece445/pace/view-topic.asp?id=30595 |