CS414 Spring 2011

Multimedia System Design

MP3 Examination and Competition Rules


For MP3, all groups should demo and present their projects to the course instructor Prof. Nahrstedt and TA on Apr 29th (see Schedule below). Meanwhile, there is a MP design competition for all groups who select Option 1: Mobile Video Chat as their MP projects. The competition is organized by Prof. Nahrstedt and sponsored by Google. Please check the following instructions for detailed information on schedules, competition rules, and evaluation criteria.

 

Competition Eligibility

-       You should join this MP design competition together with the group members you have been working with since the first MP.

-       Your group must select Option 1: Mobile Video Chat as your MP3 project to be eligible for competition.

-       The group working on Option 2: Multi-Party Video Conferencing should follow the examination rules below. The group with the highest grade will have a chance to present their work in the final presentation together with other finalist groups.

 

Preliminary Competition Selection

-       There is a preliminary selection for the MP design competition on the evening of Apr 27th in the lab SC216.

-       Prof. Nahrstedt and TA will examine the project progress of all the groups eligible for MP design competition, and select the finalists.

-       For preliminary selection, each group has 10 minutes to introduce your project plan, current status, and demonstrate the already implemented features. For demo, you can use any EWS machine in the lab or your own computer. Please have the demo set up before your time slot.

-       The finalists are determined based on the project features and progresses. Whether the group can complete all proposed features is one important factor in making decisions.

-       No more than 6 groups will be selected as finalists.

 

Final Presentation

-       The final presentation is on Apr 29th in the lab SC216. The non-finalist groups and the groups taking Option 2 will present first, followed by the finalist groups.

-       All group members are expected to show up in the final presentation.

-       Each group has 20 minutes for the final presentation. You should prepare a 5 minute slides to introduce your project features and some design issues, demonstrate all the features you have implemented, and leave 5 minutes for Q&A.

-       Please set up your demo in advance. You can use any EWS machine in the lab or your own computer to demo. However, if you fail to demo your work within your 20 minute time slot, you will either be graded based on your failed demonstration or lose 20 points as penalty for setting up any demonstration later.

-       During the Q&A, the judges will ask questions to every group member about what they have contributed in the project and some implementation issues.

-       The final presentation will be evaluated based on the criteria below. The evaluation score will be your MP3 grade if you submit all documents and source codes as required.

-       The non-finalists and Option 2 groups are judged by Prof. Nahrsted and TA. The finalists are judged by Prof. Nahrstedt, Google guest, and TA. Three winning teams will be selected based on the evaluation criteria listed below. The winning teams are awarded with certificates and the gifts sponsored by Google.

 

Schedule

-       Preliminary Competition Selection: 7 – 9 pm, Apr 27th, in Lab SC216. There will be a sign up sheet for all groups to choose the time slot for examination.

-       Final Presentation for non-finalists and Option 2 groups: 2 – 4 pm, Apr 29th in Lab SC216. The presentation time for each group will be assigned and notified on Thursday.

-       Final Presentation for finalists and Option 2 winning group: 5 – 7 pm, Apr 29th, in Lab SC216. The presentation time for each group will be assigned and notified on Thursday.

-       Pizza Events: 7 – 9 pm, Apr 29th, in SC3403. We will announce the winning teams while you enjoy the pizza. 

 

Evaluation Criteria

-       The basic evaluation score is calculated based on how features (required and optional) are implemented. For each feature, you get 100% points if you fully implement this feature and it runs perfectly (no error, no crash). You lose up to 20% points if you fully implement this feature but running this feature leads to occasional crash or error. You lose up to 40% points if you do not fully implement the feature as required in the MP description, but the partially implemented feature should run perfectly (no error, no crash). You lose up to 60% points if you do not fully implement the feature and running the partially implemented feature leads to occasional crash or error. You lose up to 80% points if you implement the feature but can hardly demo it. You get 0 point if you do not implement this feature at all.  

-       You lose 2 points for Robustness feature every time when you need to re-start your demo due to crash, error, or exception, until you lose all 10 points.   

-       There is a penalty if any group member is found not contributing to the project at all during the Q&A. This penalty will only be applied to the student who fails to answer questions and will not affect the grades of other group members.

 

Extra Evaluation Criteria

-       For finalists, there are three more evaluation criteria (10 points each) for your projects. The extra evaluation score will not affect your MP grade but will be added to your basic score for winner selection.

-       Design: Is your project design easy to implement and debug? Scalable? Efficient? Beautiful?

-       Performance: Is your video quality/audio quality/network bandwidth usage/latency better or worse compared to other groups?

-       User Friendly: Is your program easy to use? Does user need to input IP address every time? Can user use gestures instead of clicking buttons?

 

Submission

-       You are required to submit your documentation and source codes to Compass before 11:59pm Apr 29th (Compass time).

-       You lose 20% of your MP3 grade if you fail to submit your documentation and source codes. You lose up to 20% of your MP3 grade if you write only a few words in your documentation.

-       Please note that the due is Compass time, not your own computer time. No late submission through email will be taken this time. You lose 20% of your MP3 grade if your compass status is missed.