Computer Vision (CS 543 / ECE 549) – Spring 2017  

 

 

Class Time and Place: Tues, Thurs 11:00-12:15 at 1310 DCL                                                                          The False Mirror, Magritte 1928

Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Magritte_Key_To_The_Fields.jpg 

Instructors

Email

Office

Office Hours

Derek Hoiem

dhoiem

Siebel 3312

Monday 10-11

Tanmay Gupta (TA)

tgupta6

Siebel 0207

Thursday 5-6

  Bryan Plummer (TA)

bplumme2

Siebel 0207

Monday 2-3

  Chuhang Zou (TA)

czou4

Siebel 0207

Wed 5-6


                                                                                                                             

                                                                                                               

Syllabus                                                                                                                                                     

Lecture Recordings for 2017

Lecture Recordings from 2012: first 9, remaining

 

Bulletin Board 

https://piazza.com/class/ixtvap01jd0674

 

Homeworks

HW 1: due Feb 13     hw1 ; hw1.zip ; leaderboard submit / results ; solutions

HW 2: due Feb 27     hw2 ; hw2.zip ; solutions

HW 3: due Mar 20   hw3 ; hw3.zip ; hw3_vp.zip ; solutions

HW 4: due Apr 10    hw4 ; hw4.zip ; leaderboard submit / results ; solutions

HW 5: due Apr 24    hw5 ; hw5.zip

Final Project Proposal: due Mar 31

Homework submission on Compass

 

Resources

Recommended Textbook: 

Computer Vision: A Modern Approach (2nd edition), Forsyth and Ponce 2011

 

Other Useful Books:

Multiple View Geometry in Computer Vision by Hartley and Zisserman 2004

Computer Vision: Algorithms and Applications by Rick Szeliski 2010 (online, or can be purchased in hardcover)

Computer Vision by Linda Shapiro and George Stockman 2001

 

Matlab: Useful Functions List; Reference Guide; Writing Fast Code

Computer vision resource page

 

Schedule (subject to change)

Note: FP 5 is short for Forsyth and Ponce chapter 5; HZ 6 for Hartley and Zisserman chapter 6. 

Date

Topic

Slides

Reading / Notes

Jan 17 (Tues)

Intro: Logistics and Overview

ppt ; pdf

 

 

Interpreting Intensity

 

 

Jan 19 (Thurs)

Light, Shading, and Color

ppt ; pdf

FP 2 (light and shading)

FP 3 (color)

Jan 24 (Tues)

Linear Filters, Spatial Domain

ppt ; pdf

FP 4.1-4.2 (linear filters)

Jan 26 (Thurs)

Linear Filters, Frequency Domain

ppt ; pdf

FP 4.3-4.4 (spatial frequency, fft, sampling)

FFT demo

Jan 31 (Tues)

Templates and Image Pyramids

ppt ; pdf

FP 4.5-4.7 (template matching, pyramids)

Burt Adelson 1983 – The Laplacian Pyramid

Feb 2 (Thurs)

Edge Detection

ppt ; pdf

FP 5.1-5.2 (edge detection)

Berkeley Pb Detector

Detection with Mutual Information

 

Correspondence and Alignment

 

 

Feb 7 (Tues)

Interest points

ppt ; pdf 

FP 5.3-5.5 (interest points)

Grauman/Leibe Draft Chapter on Local Features

Important paper: Lowe - SIFT paper

Feb 9 (Thurs)

Feature tracking, optical flow

ppt ; pdf

FP 11.1 (feature tracking)

Seminal paper: Lucas Kanade 1981

KLT Tracker

Feb 14 (Tues)

Fitting and alignment

ppt ; pdf

HW 1 due Mon

FP 10.1-10.4 (robust fitting)

Line fitting demo

Feb 16 (Thurs)

Alignment and object instance recognition

ppt ; pdf 

FP 12.1-12.2 (object alignment)

Seminal Paper: Lowe-Object Recognition

 

Perspective and 3D Geometry

 

 

Feb 21 (Tues)

Camera models

ppt ; pdf 

FP 1 (image formation)

HZ6-7 (camera models, calibration)

Feb 23 (Thurs)

Single-view geometry and calibration

ppt ; pdf 

Perspective Ch Draft - Hoiem, Savarese

http://ksimek.github.io/2012/08/14/decompose/

Feb 28 (Tues)

Image stitching

ppt ; pdf 

HW 2 due Mon

Brown Lowe 2007 ; (panoramic stitching)

HZ4.1, HZ4.7 (direct linear transform, RANSAC)

Mar 2 (Thurs)

Epipolar geometry, stereo

ppt ; pdf

HZ9: Epipolar Geometry

Mar 7 (Tues)

Structure from motion

ppt ; pdf

Snaveley Thesis (Chpt 3)

Visual SfM (Wu  2013)

Seminal paper: Tomasi Kanade 1992

 

Grouping and Segmentation

 

 

Mar 9 (Thurs)

Clustering, K-means

ppt ; pdf

http://en.wikipedia.org/wiki/Cluster_analysis

Mar 14 (Tues)

Gestalt Cues and Image Segmentation

ppt ; pdf 

FP 9.3-9.5 (segmentation)

Intro to Mean-Shift -- Thirumuruganathan

Boundaries and Watershed – Arbelaez et al. 2009

Mar 16 (Thurs)

EM Algorithm, Mixture of Gaussians

ppt ; pdf 

EM Tutorial by Bilmes

EM Demos

Mar 21, 23

No Class -- Spring Break!

 

 HW 3 due Mon

Mar 28 (Tues)

MRFs and Graph Cut Segmentation

ppt ; pdf

What Energy Functions can be Minimized via Graph Cuts? - Kolmogorov and Zabih

GrabcutRother et al. 2004

 

Categorization and Object Recognition

 

 

Mar 30 (Thurs)

Face recognition

ppt ; pdf

Project Proposals due Mar 31

Eigenfaces

Fisherfaces

Optional: Face recognition: A Literature Survey (pp 1-26)

Apr 4 (Tues)

Categorization and Classifiers

ppt ; pdf

Hoiem/Savarese draft categorization

Grauman/Leibe Draft Visual Vocabularies

Beyond Bags of Features – Lazebnik et al. 2006 

Apr 6 (Thurs)

Deep Convolutional Neural Nets

ppt ; pdf

Culurciello’s blog

Karpathy’s ImageNet blog

Tanmay’s deep net blog

Apr 11 (Tues)

Object Detection

ppt ; pdf 

 HW 4 due Mon

Viola-Jones 2001

R-CNN

Apr 13 (Thurs)

Part and Pixel Labeling

ppt ; pdf 

 

Apr 18 (Tues)

Object tracking

ppt ; pdf 

FP 11 (tracking)

 

Advanced Topics

 

 

Apr 20 (Thurs)

Action Recognition

ppt ; pdf

 

Apr 25 (Tues)

3D Scenes and Context

ppt ; pdf

HW 5 due Mon

Hoiem and Savarese: Chapters 1, 4, 6

Hoiem et al. IJCV 2007

Hedau et al. ICCV 2009

Apr 27 (Thurs)

Vision and Language

ppt ; pdf

May 2 (Tues)

Class Summary, Important Open Problems, and Feedback

 

 

May 11, 7-10pm

Final Project Poster Session

 

 

May 12

Final Project Paper is due

 

 

 

 



Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: GoStats.com