Computer Vision (CS 543 / ECE 549) – Spring 2015

                                                                                                                                         The False Mirror, Magritte, 1928

Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Magritte_Key_To_The_Fields.jpg

Class Time and Place: Tues, Thurs 11:00-12:15 at 1015 ECE Building

 

Instructors

Email

Office

Office Hours

Derek Hoiem

dhoiem

Siebel 3312

Monday 10-11

Jia-bin Huang (TA)

jbhuang1

ECE 3034

ECE 2036

Friday 11-12

Mon 2:30-3:30

  Kevin Shih (TA)

kjshih2

Siebel 0207

Wednesday 5-6

                                                                                                                             

                                                                                                                                                      

Syllabus                                                                                                                                                     

 

Lecture Recordings from 2012, Links to early lectures

 

Bulletin Board 

https://piazza.com/class/i4ohqjpy49s6ga

 

Homeworks

HW 1: due Feb 16     hw1 ; hw1.zip ; leaderboard submit/results ; hw1_solutions

HW 2: due Mar 02    hw2 ; hw2.zip ; shape matching evaluation (optional) submit/results ; hw2 solutions (p2)

HW 3: due Mar 16   hw3 ; hw3.zip ; vp code/data/evaluation (optional) submit/results ; hw3_solutions

HW 4: due Apr 06    hw4 ; hw4.zip ; leaderboard submit/results ; hw4_solutions

HW 5: due Apr 20    hw5 ; hw5.zip ; leaderboard submit/results ; hw5_solutions

Final Project Proposal: due Apr 3

Homework submission on Compass

 

Resources

Recommended Textbook: 

Computer Vision: A Modern Approach (2nd edition), Forsyth and Ponce 2011

 

Other Useful Books:

Multiple View Geometry in Computer Vision by Hartley and Zisserman 2004

Computer Vision: Algorithms and Applications by Rick Szeliski 2010 (online, or can be purchased in hardcover)

Computer Vision by Linda Shapiro and George Stockman 2001

 

Matlab: Useful Functions List; Reference Guide; Writing Fast Code

Computer vision resource page

 

Schedule (subject to change)

Note: FP 5 is short for Forsyth and Ponce chapter 5; HZ 6 for Hartley and Zisserman chapter 6. 

Date

Topic

Slides

Reading / Notes

Jan 20 (Tues)

Intro: Logistics and Overview

ppt ; pdf

 

 

Interpreting Intensity

 

Jan 22 (Thurs)

Light, Shading, and Color

ppt ; pdf

FP 2 (light and shading)

FP 3 (color)

Jan 27 (Tues)

Linear Filters, Spatial Domain

ppt ; pdf

FP 4.1-4.2 (linear filters)

Jan 29 (Thurs)

Linear Filters, Frequency Domain

ppt ; pdf

FP 4.3-4.4 (spatial frequency, fft, sampling)

FFT demo

Feb 3 (Tues)

Templates and Image Pyramids

ppt ; pdf

FP 4.5-4.7 (template matching, pyramids)

Burt Adelson 1983 – The Laplacian Pyramid

Feb 5 (Thurs)

Edge Detection

ppt ; pdf

FP 5.1-5.2 (edge detection)

Berkeley Pb Detector

Detection with Mutual Information

 

Correspondence and Alignment

 

 

Feb 10 (Tues)

Interest points

ppt ; pdf

 

FP 5.3-5.5 (interest points)

Grauman/Leibe Draft Chapter on Local Features

Important paper: Lowe - SIFT paper

Feb 12 (Thurs)

Feature tracking, optical flow

ppt ; pdf

FP 11.1 (feature tracking)

Seminal paper: Lucas Kanade 1981

KLT Tracker

Feb 17 (Tues)

Fitting and alignment

ppt ; pdf

HW 1 due Mon

FP 10.1-10.4 (robust fitting)

Line fitting demo

Feb 19 (Thurs)

Alignment and object instance recognition

ppt ; pdf

FP 12.1-12.2 (object alignment)

Seminal Paper: Lowe-Object Recognition

 

Perspective and 3D Geometry

 

 

Feb 24 (Tues)

Camera models

ppt ; pdf

FP 1 (image formation)

HZ6-7 (camera models, calibration)

Feb 26 (Thurs)

Single-view geometry and calibration

ppt ; pdf

Perspective Ch Draft - Hoiem, Savarese

Mar 3 (Tues)

Image stitching

ppt ; pdf

HW 2 due Mon

Brown Lowe 2007 ; (panoramic stitching)

HZ4.1, HZ4.7 (direct linear transform, RANSAC)

Mar 5 (Thurs)

Epipolar geometry, stereo

ppt ; pdf

HZ9: Epipolar Geometry

Mar 10 (Tues)

Structure from motion

ppt ; pdf

Seminal paper: Tomasi Kanade 1992

 

Grouping and Segmentation

 

 

Mar 12 (Thurs)

Clustering, K-means

ppt ; pdf

http://en.wikipedia.org/wiki/Cluster_analysis

Mar 17 (Tues)

Gestalt Cues and Image Segmentation

ppt ; pdf

HW 3 due Mon

FP 9.3-9.5 (segmentation)

Intro to Mean-Shift -- Thirumuruganathan

Boundaries and Watershed – Arbelaez et al. 2009

Mar 19 (Thurs)

EM Algorithm, Mixture of Gaussians

ppt ; pdf ; notes

EM Tutorial by Bilmes

EM Demos

Mar 24, 26

No Class -- Spring Break!

 

 

Mar 31 (Tues)

MRFs and Graph Cut Segmentation

ppt ; pdf

What Energy Functions can be Minimized via Graph Cuts? - Kolmogorov and Zabih

 

Categorization and Object Recognition

 

 

Apr 2 (Thurs)

Face recognition

ppt ; pdf

Project Proposals due April 3

Eigenfaces

Fisherfaces

Optional: Face recognition: A Literature Survey (pp 1-26)

Apr 7 (Tues)

Image features and categorization

ppt ; pdf

HW 4 due Mon

Hoiem/Savarese draft categorization

Grauman/Leibe Draft Visual Vocabularies 

Apr 9 (Thurs)

Classification

ppt ; pdf

 

Apr 14 (Tues)

Object detection with statistical templates

ppt ; pdf

Viola-Jones CVPR 2001

Dalal-Triggs CVPR 2005

Apr 16 (Thurs)

Part-based models and pose estimation

ppt ; pdf

Grauman/Leibe Draft Parts-based Models ;

Pictorial Structures (Felz.&Hutt 2005)

 

Apr 21 (Tues)

Object tracking with Kalman filters

ppt ; pdf

HW 5 due Mon

FP 11 (tracking)

Advanced Topics

 

 

Apr 23 (Thurs)

Action Recognition

ppt ; pdf

 

Apr 28 (Tues)

3D Scenes and Context

ppt ; pdf

Hoiem and Savarese: Chapters 1, 4, 6

Hoiem et al. IJCV 2007

Hedau et al. ICCV 2009

Apr 30 (Thurs)

Class Summary, Important Open Problems, and Feedback

ppt ; pdf

May 5 (Tues)

Convolutional Neural Networks

ppt ; pdf

Derek away, Jia-bin lectures

May 8 (Fri) 7-10pm

Final Project Poster Session in Siebel 2405

 

 

May 11 (Mon)

Final Project Paper is due

 

 

 

 



Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: GoStats.com