CS 598KN Fall 2018 - Advanced Multimedia Systems 

Location: 1131 Siebel Center

Class Time: Tuesdays and Thursdays 2:00-3:15pm

Office Hours: Tuesdays and Thursdays: 3:15-4pm

Instructor: Prof. Klara Nahrstedt (klara@illinois.edu)

Reading List: CS598KN-ReadingList

Course Details: Slides-About-Course-Details

Course Overview: 

Goal: Multimedia data and underlying systems and networks that service multimedia (multi-modal sensory) data are becoming ubiquitous. In the "Advanced Multimedia Systems" class we will explore major advances that have been made in multimedia data, systems and networks over the last 5-10 years to enable next generation multimedia applications such as Skype, YouTube, View 360, AR/VR systems and others. We will take the end-to-end approach and explore an integrated view of multimedia systems ranging from 2D and 3D video and audio, advanced compression techniques H.264/H.265, MPEG4 and MPEG-7, new multimedia transport protocols, Quality of Service (QoS) preservation for mobile multimedia, HDTV broadcasting systems, Content Distribution and Peer-to-Peer networks to multi-modal synchronization, storage, services such as Voice-over-IP, Video Conferencing, Video-on-Demand, and subjective and objective Quality of Experience (QoE) evaluation methods for next generation multimedia applications.

New this semester: We will learn about new advances, metrics, protocols and algorithms regarding Video 360/AR/VR systems, Machine Learning in Multimedia Systems, and Quality of Experience evaluation methodology in multi-modal distributed systems, networks, and applications, as well as new developments in video/audio compression, multimedia communication, distribution and adaptive streaming.

Expected Workload: The students will present and review 2 research papers, work on a take-home midterm exam, and participate in discussion of student-presented papers. Furthermore, students will work on a semester-long project and present their results in a research paper and final presentation. Students can define their own project. Sample projects: design and development of multi-view video distribution algorithms, design and validation of QoE evaluation methodology for diverse mobile multimedia applications; development of QoS analytics algorithms and tool(s) for multimedia systems.

Topics: Basic Concepts of audio and video, MPEG, HEVC, and H.265 compression algorithms, QoS and resource management algorithms, streaming protocols, feedback control and adaptation algorithms for A/V streaming, peer-to-peer streaming and content-distribution networks, DASH, SIP, WebRTC, multi-modal synchronization algorithms, multimedia storage frameworks, machine learning and analytics in multimedia systems, QoE evaluation methods, and design and integration principles for multimedia systems such as mobile multimedia, Video 360, Teleimmersion, Voice-over-IP, Video Conferencing, and Video-on-Demand.  

Lecture Slides, Paper Reviews and Class Discussion are available at https://piazza.com/illinois/fall2018/cs598kn/home