Bayesian fusion of multivariate image to obtain depth information

This contribution presents a fusion method for multivariate stereo and spectral series with the purpose of obtaining 3D information. The image series are gained using a camera array with spectral filters. In order to register them, features that are invariant with respect to the intensity values in the images are extracted. The fusion approach is region based and uses characteristics like their size, position and form for registration. Regions are identified using the watershed transformation. The fusion problem is modeled by means of energy functionals and solved by applying a standard minimization algorithm. A generalization of the fusion problem is obtained by connecting it to the Bayesian fusion framework. An example of a reconstructed scene is given, showing the potential of the implemented algorithm.

[1]  George J. Klir,et al.  Fuzzy sets and fuzzy logic - theory and applications , 1995 .

[2]  Jürgen Beyerer,et al.  A New Approach for Estimating Depth by Fusing Stereo and Defocus Information , 2007, GI Jahrestagung.

[3]  Pedro M. Domingos,et al.  Beyond Independence: Conditions for the Optimality of the Simple Bayesian Classifier , 1996, ICML.

[4]  Vladimir Kolmogorov,et al.  Multi-camera Scene Reconstruction via Graph Cuts , 2002, ECCV.

[5]  Jürgen Beyerer,et al.  7 – Bayesian methods for image fusion , 2008 .

[6]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[7]  Christian Frese,et al.  Robust Depth Estimation by Fusion of Stereo and Focus Series Acquired with a Camera Array , 2006, 2006 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[8]  Michael Heizmann,et al.  Fusion of Combined Stereo and Focus Series for Depth Estimation , 2006, GI Jahrestagung.

[9]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[10]  O. Faugeras,et al.  The Geometry of Multiple Images , 1999 .

[11]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[13]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, SIGGRAPH 2005.

[14]  Paul R. Cohen,et al.  Camera Calibration with Distortion Models and Accuracy Evaluation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Jan Modersitzki,et al.  Numerical Methods for Image Registration , 2004 .