CS420/CSE402/ECE492 Introduction to Parallel Programming for Scientists and Engineers

Lectures: Monday, Wednesday & Friday 11:00-11:50 a.m., 1310 Digital Computer Laboratory


Links

Announcements
Lectures
Assignments

Instructor

David Padua
Email: padua@illinois.edu
Office: 4227 SC
Office Hours: TuTh 11-12 or by appointment
     

Teaching Assistant

Osman Sarood
Email: sarood1@illinois.edu
Office : 0207 SC
Office Hours: Wed. 9-11

Newsgroup

Newsgroup

Textbook

Introduction to High Performance Computing for Scientists and Engineers by Georg Hager and Gerhard Wellein. CRC Press

Lectures

Date Topic Foils Reading Assignment
Aug 27 Introduction Introduction (pptx)
Aug 29 Machine Organization Machine Organization (pdf) Hager and Wellein Chapter 1
Sep 5 Locality Locality (pdf) Slides
Sep 10 Vectorizationn Vectorization (pdf) Slides
Sep 14 Basic Optimization Basic Optimization (pdf) Hager and Wellein Chapter 2
Sep 17 Compiler Optimizations Compiler Optimizations (pdf) Slides
Sep 17 Chapter 3: Data Access Optimization Chapter 3 (pdf) additional slides 1 additional slides 2 Hager and Wellein Chapter 3
Oct 1 Chapter 4: Parallel Computers Chapter 4 (pdf) Hager and Wellein Chapter 4
Oct 5 OpenMP Part 1 (pdf)
Part 2 (pdf)
Additional Material (pdf)
Slides + Hager and Wellein Chapter 6
Oct 15 Parallelization Part 1 (pdf) Slides + Hager and Wellein Chapter 5
Oct 24 Parallel Efficiency Parallel Efficiency (pptx) Slides + Hager and Wellein Chapter 5
Nov 2 Programming Models
MPI
Programming Models (pdf) MPI (pdf)
Nov 5 Parallel Algorithm design Chapter 3 from Michael Quinn's book
Nov 9 The Sieve of Eratosthenes Chapter 5 from Michael Quinn's book
Nov 14 Floyd's algorithm Chapter 6 from Michael Quinn's book
Nov 26 GPU programming Slides
Nov 28 Matrix vector product Chapter 8 from Michael Quinn's book
Dec 3 Dependence analysis Dependence analysis (pdf)