Computational Photography (CS 498) – Fall 2013

Instructor: Derek Hoiem (dhoiem at illinois ; Siebel Center 3312)

TA: Kevin Karsch (karsch1 at illinois ; Siebel Center 3238A)

Office Hours: Derek, Mon 11-12; Kevin, Thurs 12:15-1:15

Class Time and Place: Tues and Thurs 11-12:15pm at Siebel Center 1214

Syllabus

Take-home problems

Online Resources

Online Discussion: piazza

Textbook: Computer Vision: Algorithms and Applications by Rick Szeliski

Matlab: Helpful Tutorials and References ; Writing Fast Code

Projects

Project 1: Hybrid Images Results Favorite project: Ben S Favorite result: Sida L (woman/tiger)	Project 2: Image Quilting Results Favorite project: Joe D, Justin T Favorite result: Justin T (train filling)	Project 3: Gradient Domain Fusion Results Favorite project: Michael S Favorite result: too many
Project 4: Image-based Lighting Results Favorite: Justin T (Pokeman)	Project 5: Photo Stitching Results	Final Project

Class Schedule (subject to change)

Date	Topic	Link	Reading/Notes
Aug 27 (Tues)	Introduction	ppt ; pdf	Derek in Oxford, Kevin teaching
	Basics of Working with Images
Aug 29 (Thurs)	Pixels and image filters	ppt ; pdf	S3.2 (linear filtering) S3.3 (non-linear filtering) Derek in Oxford, Kevin teaching
Sept 3 (Tues)	Thinking in frequency	ppt ; pdf	S3.4 (fourier transforms) S2.3.3 (compression) FFT Demo
Sept 5 (Thurs)	Templates and image pyramids	ppt ; pdf	S3.5.2 (image pyramids) S8.1.1 (pyramid alignment) Other reading: Burt Adelson 1983 – The Laplacian Pyramid
Sept 6 (Fri)	Matlab Tutorial, Linear Algebra Tutorial SC 3405	refsheet examples	Linear algebra review
Sept 10 (Tues)	Light and color	ppt ; pdf	S2.2 (light), S2.3.2 (color) or Forsyth and Ponce Ch 3
Sept 12 (Thurs)	Histograms and color adjustment	ppt ; pdf	S3.1 (histograms and color adjustment) Matlab demo
Sept 16 (Mon)	Project 1 (Hybrid images) due
	The Digital Canvas: Coloring, Blending, Cutting, Synthesizing, and Warping Images
Sept 17 (Tues)	Growing: Texture synthesis and hole filling	ppt ; pdf	Texture Synthesis – Efros Leung (1999) Image Quilting – Efros Freeman (2001) Image Analogies – Hertzmann et al. (2001)
Sept 19 (Thurs)	Cutting: Intelligent Scissors and Graph Cuts	ppt ; pdf	Intelligent Scissors – Mortenson Barret (1995) GrabCut – Rother et al. (2004)
Sept 24 (Tues)	Pasting: Compositing and blending	ppt ; pdf	GradientShop Poisson Image Editing – Perez et al. (2003) Burt and Adelson, A multiresolution spline with application to image mosaics, ACM ToG (1983)
Sept 26 (Thurs)	Image warping (translation, rotation, scale, etc.)	ppt ; pdf	S3.6 (warping) Alignment demo Project 3 released
Sept 30 (Mon)	Project 2 (Image quilting) due
Oct 1 (Tues)	Image morphing	ppt ; pdf
	Modeling the Physical World
Oct 3 (Thurs)	The Pinhole Camera	ppt ; pdf	S2.1.5 (3D to 2D projection)
Oct 8 (Tues)	Single-view Metrology	ppt ; pdf	HoiemSavarese-SVG Chapter
Oct 10 (Thurs)	Single-view 3D Reconstruction	ppt ; pdf	Tour into the picture (Horry et al. 1997)
Oct 15 (Tues)	Project 3 (Gradient domain fusion) due
Oct 15 (Tues)	Image-based Lighting: ray tracing, environment maps, light probes	ppt ; pdf	Reading (do read this): Debevec, Image-based Lighting Tutorial (2005) Kevin teaching 10/15-10/22
Oct 17 (Thurs)	Image-based Lighting cont.: HDR light probes, relighting	ppt ; pdf	Optional Reading: Debevec & Malik, “Recovering High Dynamic Range Radiance Maps from Photographs”, SIGGRAPH 1997 Debevec, Rendering Synthetic Objects in Real Scenes, 1998
Oct 22 (Tues)	The image as a virtual stage	ppt ; pdf	Rendering Synthetic Objects (Karsch et al. 2011)
	Correspondence and Recognition
Oct 24 (Thurs)	Matching and alignment with interest points	ppt ; pdf	Grauman/Leibe Draft Chapter on Local Features Optional: Lowe - SIFT paper
Oct 28 (Mon)	Project 4 (Image-based lighting) due
Oct 29 (Tues)	Automatic Photo Stitching and RANSAC	ppt ; pdf	Brown Lowe 2007 ; S9 (stitching); slides ; Szeliski Tutorial Draft
Oct 31 (Thurs)	Object recognition, retrieval, and augmented reality	ppt ; pdf	Grauman/Leibe Draft Visual Vocabularies; S14.3
Nov 5 (Tues)	Opportunities of scale: texture synthesis, multi-view reconstruction, im2gps, tiny images, etc.	ppt ; pdf	Reading: Hays & Efros, Scene Completion Using Millions of Photographs
	More Topics of Interest
Nov 7 (Thurs)	How the Kinect works	ppt ; pdf
Nov 11 (Mon)	Project 5 (Image stitching) due
Nov 12 (Tues)	Detecting fakes	ppt ; pdf
Nov 14 (Thurs)	Computational approaches to cameras	ppt ; pdf
Nov 18 (Mon)	Final Project Proposal due		Final Project Instructions
Nov 19 (Tues)	Exam Review	pdf	Sample Questions
Nov 21 (Thurs)	Exam, normal class time/place
Nov 26, 28	NO CLASS - Thanksgiving Break!
Dec 3 (Tues)	PCA and Fun with Faces	ppt ; pdf	Derek in Australia: Nov 30-Dec 9 (Kevin teaching)
Dec 5 (Thurs)	No class
Dec 10 (Tues)	Last day – wrap up	ppt ; pdf
Dec 18 (Wed)	Final Project Presentations, 1:30-4:30, SC1214

Similar Courses in Other Universities

Computational Photography (Efros, CMU)

Computational Photography (Hays, Brown)

Computational Photography SIGGRAPH Course (Raskar & Tumblin)

Computational Camera and Photography (Raskar, MIT Media Lab)

Digital and Computational Photography (Durand & Freeman, MIT)

Computational Photography (Essa, Georgia Tech)

Computational Photography (Levoy, Adams, Pulli, Stanford)

Computational Photography (Lazebnik, UNC)

Computational Photography (Fergus, NYU)

Internet Vision (T.Berg, SUNY)

Computer Vision (Seitz & Szeliski, UWashington)

Introduction to Visual Computing and Visual Modeling (Kutulakos, UToronto)

Symposium on Computational Photography and Video (May 2005, MIT)

Credits and Course Notes

I am grateful for the many preceding efforts to design excellent courses and course notes for this topic. I am particularly indebted to Alyosha Efros for borrowing much of his course and project design, to Rick Szeliski for making his book available, to James Hays for course suggestions and materials, and to Steve Seitz, Lana Lazebnik, Silvio Savarese, among others for their slides (as credited within). Anyone who would like to use my slides is more than welcome; please do credit the original sources where appropriate.