Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: <i>The Key to the Fields</i> (Magritte 1936)  Computational Photography (CS 445) – Fall 2017

 

 

  Instructor:  Derek Hoiem (dhoiem)

 

  TAs: Joseph DeGol (degol2)

          Aditya Deshpande (ardeshp2)

          Zhizhong Li (zli115)

 

  Office Hours:

            Derek              Mon     10:00 – 11:00              SC 3312

            Joe                   Tues     11:00 – 12:30              near SC 3407

            Zhizhong          Wed     11:00 – 12:00              near SC 3407

            Aditya              Fri          2:30 –   4:00              near SC 3407

 

  Class Time and Place: Tues and Thurs 9:30-10:45 at DCL 1310

 

  Syllabus

  Take-home questions

  Lecture Recordings

  Homework Submission (Compass)

  Piazza Discussion Board

 

 

  Textbook: Computer Vision: Algorithms and Applications by Rick Szeliski

  Matlab Info: Video Tutorials; Writing Fast Code

                                                                                                           

  

   Projects

Project 1: Hybrid Images

Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: leopard elephant

Results

Project 2: Image Quilting

    Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: C:\Users\Hoiem\Documents\Classes\ComputationalPhotography - Fall 2012\projects\quilting\face_toast_cropped.png

   

Project 3: Gradient Domain Fusion

Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: cloning_teaser

 

Project 4: Image-based Lighting

https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcQJ6tcY1JugjgyMMpZMj9BgU6OaGyIv8jL4T8J-Qsgnn0UOrHT2tw

 

 

Project 5: Video Stitching

 

 

 

Final Project

Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: http://t2.gstatic.com/images?q=tbn:ANd9GcSEXEDpOJHSX2MOS0mvolJmNhoGKiQZ6t4ky5dyEio1mph1-L1x

 

 

 

  

  Class Schedule   (subject to change)

Date

Topic

Link

Reading/Notes

Aug 29 (Tues)

Introduction

ppt ; pdf

 

Basics of Working with Images

 

 

Aug 31 (Thurs)

Pixels and image filters

ppt ; pdf

S3.2 (linear filtering)

S3.3 (non-linear filtering)

Sept 5 (Tues)

Thinking in frequency

ppt ; pdf

S3.4 (fourier transforms)

S2.3.3 (compression)

FFT Demo

Sept 6 (Wed)

Matlab Tutorial, Linear Algebra Tutorial

refsheet

examples

Linear algebra review

 

Sept 7 (Thurs)

Templates and image pyramids

ppt ; pdf

S3.5.2 (image pyramids)

S8.1.1 (pyramid alignment)

Other reading:

   Burt Adelson 1983 – The Laplacian Pyramid

Sept 12 (Tues)

Light and color

ppt ; pdf

S2.2 (light), S2.3.2 (color)

or Forsyth and Ponce Ch 3

Sept 14 (Thurs)

Histograms and color adjustment

ppt ; pdf

S3.1 (histograms and color adjustment)

Color balance demo

Sept 18 (Mon)

Project 1 (Hybrid images) due

 

 

The Digital Canvas: Coloring, Blending, Cutting, Synthesizing, and Warping Images

 

 

Sept 19 (Tues)

Growing: Texture synthesis and hole filling

ppt ; pdf

Texture Synthesis – Efros Leung (1999)

Image Quilting – Efros Freeman (2001)

Image Analogies – Hertzmann et al. (2001)

Patch Match – Barnes et al. (2009)

Sept 21 (Thurs)

Cutting: Intelligent Scissors and Graph Cuts

ppt ; pdf

Intelligent Scissors – Mortenson Barret (1995)

GrabCutRother et al. (2004)

Sept 26 (Tues)

Pasting: Compositing and blending

 

GradientShop

Poisson Image Editing – Perez et al. (2003)

Burt and Adelson, A multiresolution spline with application to image mosaics, ACM ToG (1983) 

Sept 28 (Thurs)

Image warping (translation, rotation, scale, etc.)

 

S3.6 (warping)

Alignment demo

Oct 2 (Mon)

Project 2 (Image quilting) due

 

 

Oct 3 (Tues)

Image morphing

 

 

Modeling the Physical World

 

 

Oct 5 (Thurs)

The Pinhole Camera

 

S2.1.5 (3D to 2D projection)

Oct 10 (Tues)

Single-view Metrology

 

HoiemSavarese-SVG Chapter

Oct 12 (Thurs)

Single-view 3D Reconstruction

 

Tour into the picture (Horry et al. 1997)

Oct 16 (Mon)

Project 3 (Gradient domain fusion) due

 

 

Oct  17 (Tues)

Image-based Lighting: ray tracing, environment maps, light probes

 

Reading (do read this):

Debevec, Image-based Lighting Tutorial (2005)

Oct  19 (Thurs)

Image-based Lighting cont.: HDR light probes, relighting

 

Optional Reading:

Debevec & Malik, “Recovering High Dynamic Range Radiance Maps from Photographs”, SIGGRAPH 1997

Debevec, Rendering Synthetic Objects in Real Scenes, 1998

Oct  24 (Tues)

The image as a virtual stage

 

Rendering Synthetic Objects (Karsch et al. 2011)

Correspondence and Recognition

 

 

Oct  26  (Thurs)

Matching and alignment with interest points

 

Grauman/Leibe Draft Chapter on Local Features Optional: Lowe - SIFT paper

Oct 30 (Mon)

Project 4 (Image-based lighting) due

 

 

Oct 31  (Tues)

Automatic Photo Stitching and RANSAC

 

Brown Lowe 2007 ; S9 (stitching);  slides ;

Szeliski Tutorial Draft

Nov 2 (Thurs)

Object recognition, retrieval, and augmented reality

 

Grauman/Leibe Draft Visual Vocabularies; S14.3

Nov 7 (Tues)

Opportunities of scale: texture synthesis, multi-view reconstruction, im2gps, tiny images, etc.

 

Reading: Hays & Efros, Scene Completion Using Millions of Photographs

 

More Topics of Interest

 

 

Nov 9 (Thurs)

How the Kinect works

 

Nov 13 (Mon)

Project 5 (Video stitching) due

 

 

Nov 14 (Tues)

Detecting fakes 

 

Nov 16 (Thurs)

Computational approaches to cameras

 

Adelson & Bergen, The Plenoptic Function and the Elements of Early Vision (1991)

Ng et al., Light Field Photography with a Hand-held Plenoptic Camera (2005)

Levin et al., Image and Depth with a Coded Aperture (2007)

Nov 21, 23

NO CLASS - Thanksgiving Break!

 

 

Nov 27 (Mon)

Final Project Proposal due

 

 

Nov 28 (Tues)

Exam Review 

 

Example questions

Nov 30 (Thurs)

Exam, normal class time/place

 

 

Dec 5 (Tues)

Understanding Faces

 

Dec  7 (Thurs)

Video Magnification

 

 

Dec 12 (Tues)

Last day – wrap up

 

TBA

Final Poster Presentations

 


 

 

 

 

Credits and Course Notes

I am grateful for the many preceding efforts to design excellent courses and course notes for this topic.  I am particularly indebted to Alyosha Efros for borrowing much of his course and project design, to Rick Szeliski for making his book available, to James Hays for course suggestions and materials, and to Steve Seitz, Lana Lazebnik, Silvio Savarese, among others for their slides (as credited within).  Anyone who would like to use my slides is more than welcome; please do credit the original sources where appropriate.


Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: GoStats.com