Computer Vision (CS 543 / ECE 549) – Spring 2017  

 

 

Class Time and Place: Tues, Thurs 11:00-12:15 at 1310 DCL                                                                          The False Mirror, Magritte 1928

Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Magritte_Key_To_The_Fields.jpg 

Instructors

Email

Office

Office Hours

Derek Hoiem

dhoiem

Siebel 3312

Monday 10-11

Tanmay Gupta (TA)

tgupta6

Siebel 0207

Thursday 5-6

  Bryan Plummer (TA)

bplumme2

Siebel 0207

Monday 2-3

  Chuhang Zou (TA)

czou4

Siebel 0207

Wed 5-6


                                                                                                                             

                                                                                                               

Syllabus                                                                                                                                                     

Lecture Recordings for 2017

Lecture Recordings from 2012: first 9, remaining

 

Bulletin Board 

https://piazza.com/class/ixtvap01jd0674

 

Homeworks

HW 1: due Feb 13     hw1 ; hw1.zip ; leaderboard submit / results ; solutions

HW 2: due Feb 27     hw2 ; hw2.zip ; solutions

HW 3: due Mar 20   hw3 ; hw3.zip ; hw3_vp.zip ; solutions

HW 4: due Apr 10    hw4 ; hw4.zip ; leaderboard submit / results

HW 5: due Apr 24   

Final Project Proposal: due Mar 31

Homework submission on Compass

 

Resources

Recommended Textbook: 

Computer Vision: A Modern Approach (2nd edition), Forsyth and Ponce 2011

 

Other Useful Books:

Multiple View Geometry in Computer Vision by Hartley and Zisserman 2004

Computer Vision: Algorithms and Applications by Rick Szeliski 2010 (online, or can be purchased in hardcover)

Computer Vision by Linda Shapiro and George Stockman 2001

 

Matlab: Useful Functions List; Reference Guide; Writing Fast Code

Computer vision resource page

 

Schedule (subject to change)

Note: FP 5 is short for Forsyth and Ponce chapter 5; HZ 6 for Hartley and Zisserman chapter 6. 

Date

Topic

Slides

Reading / Notes

Jan 17 (Tues)

Intro: Logistics and Overview

ppt ; pdf

 

 

Interpreting Intensity

 

 

Jan 19 (Thurs)

Light, Shading, and Color

ppt ; pdf

FP 2 (light and shading)

FP 3 (color)

Jan 24 (Tues)

Linear Filters, Spatial Domain

ppt ; pdf

FP 4.1-4.2 (linear filters)

Jan 26 (Thurs)

Linear Filters, Frequency Domain

ppt ; pdf

FP 4.3-4.4 (spatial frequency, fft, sampling)

FFT demo

Jan 31 (Tues)

Templates and Image Pyramids

ppt ; pdf

FP 4.5-4.7 (template matching, pyramids)

Burt Adelson 1983 – The Laplacian Pyramid

Feb 2 (Thurs)

Edge Detection

ppt ; pdf

FP 5.1-5.2 (edge detection)

Berkeley Pb Detector

Detection with Mutual Information

 

Correspondence and Alignment

 

 

Feb 7 (Tues)

Interest points

ppt ; pdf 

FP 5.3-5.5 (interest points)

Grauman/Leibe Draft Chapter on Local Features

Important paper: Lowe - SIFT paper

Feb 9 (Thurs)

Feature tracking, optical flow

 ppt ; pdf

FP 11.1 (feature tracking)

Seminal paper: Lucas Kanade 1981

KLT Tracker

Feb 14 (Tues)

Fitting and alignment

ppt ; pdf

HW 1 due Mon

FP 10.1-10.4 (robust fitting)

Line fitting demo

Feb 16 (Thurs)

Alignment and object instance recognition

ppt ; pdf 

FP 12.1-12.2 (object alignment)

Seminal Paper: Lowe-Object Recognition

 

Perspective and 3D Geometry

 

 

Feb 21 (Tues)

Camera models

ppt ; pdf 

FP 1 (image formation)

HZ6-7 (camera models, calibration)

Feb 23 (Thurs)

Single-view geometry and calibration

ppt ; pdf 

Perspective Ch Draft - Hoiem, Savarese

http://ksimek.github.io/2012/08/14/decompose/

Feb 28 (Tues)

Image stitching

ppt ; pdf 

HW 2 due Mon

Brown Lowe 2007 ; (panoramic stitching)

HZ4.1, HZ4.7 (direct linear transform, RANSAC)

Mar 2 (Thurs)

Epipolar geometry, stereo

ppt ; pdf

HZ9: Epipolar Geometry

Mar 7 (Tues)

Structure from motion

ppt ; pdf

Snaveley Thesis (Chpt 3)

Visual SfM (Wu  2013)

Seminal paper: Tomasi Kanade 1992

 

Grouping and Segmentation

 

 

Mar 9 (Thurs)

Clustering, K-means

ppt ; pdf

http://en.wikipedia.org/wiki/Cluster_analysis

Mar 14 (Tues)

Gestalt Cues and Image Segmentation

ppt ; pdf 

FP 9.3-9.5 (segmentation)

Intro to Mean-Shift -- Thirumuruganathan

Boundaries and Watershed – Arbelaez et al. 2009

Mar 16 (Thurs)

EM Algorithm, Mixture of Gaussians

ppt ; pdf 

EM Tutorial by Bilmes

EM Demos

Mar 21, 23

No Class -- Spring Break!

 

 HW 3 due Mon

Mar 28 (Tues)

MRFs and Graph Cut Segmentation

 

What Energy Functions can be Minimized via Graph Cuts? - Kolmogorov and Zabih

 

Categorization and Object Recognition

 

 

Mar 30 (Thurs)

Face recognition

 

Project Proposals due Mar 31

Eigenfaces

Fisherfaces

Optional: Face recognition: A Literature Survey (pp 1-26)

Apr 4 (Tues)

Categorization and Classifiers

 

Hoiem/Savarese draft categorization

Grauman/Leibe Draft Visual Vocabularies 

Apr 6 (Thurs)

Features and Deep Convolutional Neural Nets

 

 

Apr 11 (Tues)

Object Recognition with CNNs

 

 HW 4 due Mon

Apr 13 (Thurs)

Fully Convolutional CNNs

 

 

Apr 18 (Tues)

Object tracking with Kalman filters

 

FP 11 (tracking)

 

Advanced Topics

 

 

Apr 20 (Thurs)

Action Recognition

 

 

Apr 25 (Tues)

3D Scenes and Context

 

HW 5 due Mon

Hoiem and Savarese: Chapters 1, 4, 6

Hoiem et al. IJCV 2007

Hedau et al. ICCV 2009

Apr 27 (Thurs)

Visual Question Answering

 

 

May 2 (Tues)

Class Summary, Important Open Problems, and Feedback

 

 

May 11, 7-10pm

Final Project Poster Session

 

 

May 12

Final Project Paper is due

 

 

 

 



Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: GoStats.com