A geometric approach to shape from defocus.

Favaro, Paolo; Soatto, Stefano (2005). A geometric approach to shape from defocus. IEEE transactions on pattern analysis and machine intelligence, 27(3), pp. 406-417. IEEE Computer Society 10.1109/TPAMI.2005.43

[img] Text
01388266.pdf - Published Version
Restricted to registered users only
Available under License Publisher holds Copyright.

Download (1MB)

We introduce a novel approach to shape from defocus, i.e., the problem of inferring the three-dimensional (3D) geometry of a scene from a collection of defocused images. Typically, in shape from defocus, the task of extracting geometry also requires deblurring the given images. A common approach to bypass this task relies on approximating the scene locally by a plane parallel to the image (the so-called equifocal assumption). We show that this approximation is indeed not necessary, as one can estimate 3D geometry while avoiding deblurring without strong assumptions on the scene. Solving the problem of shape from defocus requires modeling how light interacts with the optics before reaching the imaging surface. This interaction is described by the so-called point spread function (PSF). When the form of the PSF is known, we propose an optimal method to infer 3D geometry from defocused images that involves computing orthogonal operators which are regularized via functional singular value decomposition. When the form of the PSF is unknown, we propose a simple and efficient method that first learns a set of projection operators from blurred images and then uses these operators to estimate the 3D geometry of the scene from novel blurred images. Our experiments on both real and synthetic images show that the performance of the algorithm is relatively insensitive to the form of the PSF. Our general approach is to minimize the Euclidean norm of the difference between the estimated images and the observed images. The method is geometric in that we reduce the minimization to performing projections onto linear subspaces, by using inner product structures on both infinite and finite-dimensional Hilbert spaces. Both proposed algorithms involve only simple matrix-vector multiplications which can be implemented in real-time.

Item Type:

Journal Article (Original Article)

Division/Institute:

08 Faculty of Science > Institute of Computer Science (INF) > Computer Vision Group (CVG)
08 Faculty of Science > Institute of Computer Science (INF)

UniBE Contributor:

Favaro, Paolo

Subjects:

000 Computer science, knowledge & systems
500 Science > 510 Mathematics

ISSN:

0162-8828

Publisher:

IEEE Computer Society

Language:

English

Submitter:

Anja Ebeling

Date Deposited:

13 Sep 2017 09:49

Last Modified:

11 Apr 2024 16:11

Publisher DOI:

10.1109/TPAMI.2005.43

PubMed ID:

15747795

BORIS DOI:

10.7892/boris.105375

URI:

https://boris.unibe.ch/id/eprint/105375

Actions (login required)

Edit item Edit item
Provide Feedback