CS 598KN Fall 2017 - Advanced Multimedia Systems 

Location: 1131 Siebel Center

Class Time: Tuesdays and Thursdays 2:00-3:15pm

Office Hours: Tuesdays and Thursdays: 3:15-4pm

Instructor: Prof. Klara Nahrstedt (klara@illinois.edu)

Reading List: CS598KN-ReadingList

Course Details: Slides-About-Course-Details

Course Overview: 

Goal: Multimedia data and underlying systems and networks that service multimedia (multi-modal sensory) data are becoming ubiquitous. In the "Advanced Multimedia Systems" class we will explore major advances that have been made in multimedia data, systems and networks over the last 5-10 years to enable next generation multimedia applications such as Skype, YouTube, Flickr, View 360 systems and others. We will take the end-to-end approach and explore an integrated view of multimedia systems ranging from 2D and 3D video and audio, advanced compression techniques H.264, MPEG4 and MPEG-7, new multimedia transport protocols, Quality of Service (QoS) preservation for mobile multimedia, HDTV broadcasting systems, Content Distribution and Peer-to-Peer networks to multi-modal synchronization, storage, services such as Voice-over-IP, Video Conferencing, Video-on-Demand, and subjective and objective Quality of Experience (QoE) evaluation methods for next generation multimedia applications.

New this semester: We will learn about new advances, metrics, protocols and algorithms regarding mobile multimedia, View 360 systems, and Quality of Experience evaluation methodology in multi-modal distributed systems, networks, and applications.

Expected Workload: The students will present 3 research papers, work on a take-home midterm exam, review 3 papers, and peer-review each-other presentations and paper reviews. Furthermore, students will work on a semester-long project and present their results in a research paper and final presentation. Students can define their own project. Sample projects: design and development of multi-view video distribution algorithms, design and validation of QoE evaluation methodology for diverse mobile multimedia applications; development of QoS analytics algorithms and tool(s) for multimedia systems.

Topics: Basic Concepts of audio and video, MPEG, HEVC, and H.265 compression algorithms, QoS and resource management algorithms, streaming protocols, feedback control and adaptation algorithms for A/V streaming, peer-to-peer streaming and content-distribution networks, DASH, SIP, WebRTC, multi-modal synchronization algorithms, multimedia storage frameworks, QoE evaluation methods, and design and integration principles for multimedia systems such as mobile multimedia, Video 360, Teleimmersion, Voice-over-IP, Video Conferencing, and Video-on-Demand.  

Lecture Slides, Paper Reviews and Class Discussion are available at https://piazza.com/illinois/fall2017/cs598kn/home