16-822: Geometry-based Methods in Vision

Fall 2022


[ Home | Schedule | Assignments | Piazza | Canvas | Office Hour ]

Tuesday and Thursday, 10:10-11:30AM, GHC 6115


This schedule is preliminary and subject to change as the term evolves.
A great (but optional) reference is the second edition of the "Multi-view Geometry" book by Hartley and Zisserman (H&Z).

Lecture Date Topic Additional Reading Assignments
WEEK 1
1 Tue 08/30/2022 Introduction (slides)
2 Thu 09/01/2022 Projective Geometry (slides) H&Z Chapter 2.1-2.4
WEEK 2
3 Tue 09/06/2022 (more) Projective Geometry (slides) H&Z Chapter 2.7 PS1 released
4 Thu 09/08/2022 3D Projective Geometry (slides) H&Z Chapter 3.1, 3.2, 3.4, 3.5
WEEK 3
5 Tue 09/13/2022 Homography from Correspondences (slides) H&Z Chapter 4.1-4.5 PS1 Due
6 Thu 09/15/2022 Camera Models (slides) H&Z Chapter 6 A1 released
WEEK 4
7 Tue 09/20/2022 Single-view Geometry (slides) H&Z Chapter 7, 8.4, 8.6 PS2 released
8 Thu 09/22/2022 Single-view Calibration and Reconstruction (slides) H&Z Chapter 3.6, 8.5, 8.8, 8.1, 8.9
WEEK 5
9 Tue 09/27/2022 Epipolar Geometry (slides) H&Z Chapter 9.1-9.3, 9.6 PS2 Due
10 Thu 09/29/2022 Two-view Reconstruction (slides) H&Z Chapter 9.5, 10.1-10.4, 12.1-12.2 A1 Due; A2 Released
WEEK 6
11 Tue 10/04/2022 Two-view Calibration (slides) H&Z Chapter 11.1-11.3, 11.6, 11.7, 11.9

Five-Point Motion Estimation Made Easy
PS3 Released
12 Thu 10/06/2022 Two-view Rectification (slides) + Project Proposals (slides - CMU only) H&Z Chapter 10.4, 10.5, 11.4
WEEK 7
13 Tue 10/11/2022 Auto-calibration (slides) H&Z Chapter 19.1-19.3 PS3 Due; PS4 Released
14 Thu 10/13/2022 Non-linear Least Squares (slides) + Three-view Geometry (slides) Levenberg-Marquardt Algorithm

H&Z Chapter 15.1
A2 Due; A3 Released
WEEK 8 - Fall Break
WEEK 9
15 Tue 10/25/2022 N-view Geometry + Affine SfM (slides) H&Z Chapter 18.1, 18.2
16 Thu 10/27/2022 SfM in Practice (slides) Structure-From-Motion Revisited

Bundle Adjustment in the Large
PS4 Due
WEEK 10
17 Tue 11/01/2022 Dense Reconstruction from Multi-view (slides) Multi-View Stereo: A Tutorial Project Proposals Due
18 Thu 11/03/2022 Parametrizing Rotations (slides) Least-squares estimation of transformation parameters between two point patterns

On the Continuity of Rotation Representations in Neural Networks
A3 Due;
WEEK 11
19 Tue 11/08/2022 Learning-based SfM (slides) SuperPoint: Self-Supervised Interest Point Detection and Description

SuperGlue: Learning Feature Matching with Graph Neural Networks

Pixel-Perfect Structure-from-Motion with Featuremetric Refinement
A4 Released; PS5 Released
20 Thu 11/10/2022 Geometry-based 3D Prediction (slides) Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstruction

Generalizable Patch-Based Neural Rendering
WEEK 12
21 Tue 11/15/2022 Non-rigid SfM (by Mosam Dabhi) (slides) PS5 Due; PS6 Released
22 Thu 11/17/2022 Guest Lecture by David Fouhey (slides - CMU access only) The 8-Point Algorithm as an Inductive Bias for Relative Pose Prediction by ViTs

PlaneFormers: From Sparse View Planes to 3D Reconstruction
WEEK 13
23 Tue 11/22/2022 Guest Lecture by Adithya Pediredla (slides - pdf, pptx) Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging

Recent Advances in Imaging Around Corners
A4 Due
Thu 11/24/2022 No Class (Thanksgiving Break) PS6 Due
WEEK 14
24 Tue 11/29/2022 Conclusion (slides)
25 Thu 12/01/2022 Project Presentations: I
WEEK 15
26 Tue 12/06/2022 Project Presentations: II
27 Thu 12/08/2022 Project Presentations: III
WEEK 16
26 Wed 12/14/2022 Project Reports Due