A New Approach for Estimating Depth by Fusing Stereo and Defocus Information

Several algorithms are common for estimating depth from stereo series, but many of them have difficulties when determining depth of objects having periodical structure. This contribution proposes a method to overcome the impediments by using defocus as additional information. The algorithm fuses depth from stereo and depth from defocused edges by analyzing and evaluating image series with simultaneously varied camera and focus positions. The problem is formulated by a comprehensive notation using energy functionals, which can be solved e. g. by applying graph cuts minimization.

[1]  Franz Mesch.  Systemtheoretische Beschreibung optisch-elektrischer Meßsysteme/ Description of optical-electrical measurement systems by system theory methods , 1977 .

[2]  Jim R. Parker,et al.  Algorithms for image processing and computer vision , 1996 .

[3]  Vladimir Kolmogorov,et al.  Multi-camera Scene Reconstruction via Graph Cuts , 2002, ECCV.

[4]  Christian Frese,et al.  Robust Depth Estimation by Fusion of Stereo and Focus Series Acquired with a Camera Array , 2006, 2006 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[5]  Michael Heizmann,et al.  Fusion of Combined Stereo and Focus Series for Depth Estimation , 2006, GI Jahrestagung.

[6]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[7]  O. Faugeras,et al.  The Geometry of Multiple Images , 1999 .

[8]  Manfred H. Hueckel.  A Local Visual Operator Which Recognizes Edges and Lines , 1973, JACM.

[9]  Owen Robert Mitchell,et al.  Precision Edge Contrast and Orientation Estimation , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[11]  Muralidhara Subbarao,et al.  Depth recovery from blurred edges , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Shang-Hong Lai,et al.  A Generalized Depth Estimation Algorithm with a Single Image , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Alex Pentland,et al.  A New Sense for Depth of Field , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.