Human visual system and segment-based disparity estimation

Abstract In this paper, an efficient segment-based disparity estimation algorithm is proposed, based on wavelet transform and human visual system. The core idea is to estimate disparity not only from the left and right images but also from their decomposed sub-bands up to a certain level. The stereo image pair is divided into the segments of homogeneous color. Instead of assigning a disparity value to each pixel inside a segment, a disparity plane is assigned to each segment and the stereo matching problem is formulated as an energy minimization problem in the segmented domain. The optimal disparity plane labeling is approximated by applying belief propagation, which assigns the corresponding disparity plane to each segment. The obtained disparity maps are merged into a single disparity map using the human visual system model. Experiments with stereo image pairs show the validity of the proposed method.

[1]  Takashi Matsuyama,et al.  Generation, visualization, and editing of 3D video , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[2]  Balasubramanian Raman,et al.  A chaotic system based fragile watermarking scheme for image tamper detection , 2011 .

[3]  Sing Bing Kang,et al.  Stereo for Image-Based Rendering using Image Over-Segmentation , 2007, International Journal of Computer Vision.

[4]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[5]  Ingrid Daubechies,et al.  The wavelet transform, time-frequency localization and signal analysis , 1990, IEEE Trans. Inf. Theory.

[6]  E. A. Hendriks,et al.  Converting 2D to 3D: A Survey , 2005 .

[7]  Roberto Manduchi,et al.  Stereo Matching as a Nearest-Neighbor Problem , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Andreas Klaus,et al.  Segment-Based Stereo Matching Using Belief Propagation and a Self-Adapting Dissimilarity Measure , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[9]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Olga Veksler,et al.  Stereo correspondence by dynamic programming on a tree , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Jian Sun,et al.  Symmetric stereo matching for occlusion handling , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  D. Nistér,et al.  Stereo Matching with Color-Weighted Correlation, Hierarchical Belief Propagation, and Occlusion Handling , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Margrit Gelautz,et al.  Graph-cut-based stereo matching using image segmentation with symmetrical treatment of occlusions , 2007, Signal Process. Image Commun..

[15]  Edwin D. El-Mahassni.  New Robust Matching Cost Functions for Stereo Vision , 2007, 9th Biennial Conference of the Australian Pattern Recognition Society on Digital Image Computing Techniques and Applications (DICTA 2007).

[16]  Baris Baykant Alagöz.  Obtaining Depth Maps From Color Images By Region Based Stereo Matching Algorithms , 2008, ArXiv.

[17]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  L. Hong,et al.  Segment-based stereo matching using graph cuts , 2004, CVPR 2004.

[19]  Pedro F. Felzenszwalb,et al.  Efficient belief propagation for early vision , 2004, CVPR 2004.

[20]  An Ping,et al.  Stereo video coding based on frame estimation and interpolation , 2003 .

[21]  Thierry Pun,et al.  A Stochastic Approach to Content Adaptive Digital Image Watermarking , 1999, Information Hiding.

[22]  Margrit Gelautz,et al.  A layered stereo matching algorithm using image segmentation and global visibility constraints , 2005 .

[23]  Zhi-Gang Zheng,et al.  A region based stereo matching algorithm using cooperative optimization , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Daolei Wang,et al.  Obtaining depth map from segment-based stereo matching using graph cuts , 2011, J. Vis. Commun. Image Represent..

[25]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Kwanghoon Sohn,et al.  3D reconstruction from stereo images for interactions between real and virtual objects , 2005, Signal Process. Image Commun..

[27]  Darius Burschka,et al.  Advances in Computational Stereo , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Ralf Buschmann.  Stereoscopic and 3D visual communications for the future , 1999, Electronic Imaging.

[29]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[30]  G. Bhatnagar.  A new facet in robust digital watermarking framework , 2012 .

[31]  Alexander Toet,et al.  Merging thermal and visual images by a contrast pyramid , 1989 .

[32]  C.-C. Jay Kuo,et al.  Robust stereo matching with improved graph and surface models and occlusion handling , 2010, J. Vis. Commun. Image Represent..