Space-Variant Approaches to Recovery of Depth from Defocused Images

The recovery of depth from defocused images involves calculating the depth of various points in a scene by modeling the effect that the focal parameters of the camera have on images acquired with a small depth of field. In the approach to depth from defocus (DFD), previous methods assume the depth to be constant over fairly large local regions and estimate the depth through inverse filtering by considering the system to be shift-invariant over those local regions. But a subimage when analyzed in isolation introduces errors in the estimate of the depth. In this paper, we propose two new approaches for estimating the depth from defocused images. The first approach proposed here models the DFD system as a block shift-variant one and incorporates the interaction of blur among neighboring subimages in an attempt to improve the estimate of the depth. The second approach looks at the depth from defocus problem in the space-frequency representation framework. In particular, the complex spectrogram and the Wigner distribution are shown to be likely candidates for recovering the depth from defocused images. The performances of the proposed methods are tested on both synthetic and real images. The proposed methods yield good results and the quality of the estimates obtained using these methods is compared with the existing method.

[1]  F. Hlawatsch,et al.  Linear and quadratic time-frequency signal representations , 1992, IEEE Signal Processing Magazine.

[2]  Alex Pentland,et al.  Simple range cameras based on focal error , 1994 .

[3]  Alan L. Yuille,et al.  A depth recovery algorithm using defocus information , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  V. Bove.  Entropy-based depth from focus , 1993 .

[5]  Murali Subbarao.  Parallel Depth Recovery By Changing Camera Parameters , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[6]  Bahaa E. A. Saleh,et al.  Time-variant filtering of signals in the mixed time frequency domain , 1985, IEEE Trans. Acoust. Speech Signal Process..

[7]  William F. Schreiber,et al.  Fundamentals of Electronic Imaging Systems , 1986 .

[8]  C Gonzalo,et al.  Space-variant filtering through the Wigner distribution function. , 1989, Applied optics.

[9]  Ray A. Jarvis,et al.  A Perspective on Range Finding Techniques for Computer Vision , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Herbert Freeman,et al.  Machine Vision for Inspection and Measurement , 1989 .

[11]  Emil Wolf,et al.  Principles of Optics: Contents , 1999 .

[12]  Eric Paul Krotkov,et al.  Active Computer Vision by Cooperative Focus and Stereo , 1989, Springer Series in Perception Engineering.

[13]  J. Besag,et al.  On the estimation and testing of spatial interaction in Gaussian lattice processes , 1975 .

[14]  Berthold K. P. Horn.  Robot vision , 1986, MIT electrical engineering and computer science series.

[15]  M. Turk,et al.  A simple, real-time range camera , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Murali Subbarao,et al.  Depth from defocus by changing camera aperture: a spatial domain approach , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Muralidhara Subbarao.  Efficient Depth Recovery through Inverse Optics , 1989 .

[18]  Alex Pentland,et al.  A New Sense for Depth of Field , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Peter Lawrence,et al.  An Investigation of Methods for Determining Depth from Focus , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Subhasis Chaudhuri,et al.  A block shift-variant blur model for recovering depth from defocused images , 1995, Proceedings., International Conference on Image Processing.

[21]  J. Goodman.  Introduction to Fourier optics , 1969 .

[22]  Murali Subbarao,et al.  Depth from defocus and rapid autofocusing: a practical approach , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.