Disparity Refinement based on Depth Image Layers Separation for Stereo Matching Algorithms

This paper presents a method to improve the raw disparity maps in the disparity refinement stage for stereo matching algorithm. The proposed algorithm will use the disparity depth map from the stereo matching algorithm as initial disparity depth output with a basic similarity metric of SAD. The similarity metric finds the pixel points between the left and right under the fixed window (FW) searching process. With this approach, the raw disparity depth map obtained is not smooth and contained errors particularly with the depth discontinuities and unable to detect the uniform areas and repetitive patterns. The initial disparity depth will be used to identify the layers of disparity depth map by adapting the Depth Image Layers Separation (DILS) algorithm that separate the layers of depth based on disparity range. Each particular disparity depth map distributed along the disparity range and can be divided into several layers. The layer will be mapped to segmented reference image to refine the disparity depth map. This method will be known as the Depth Layer Refinement (DLR) that using the disparity depth layers to refine the disparity map.

[1]  Nam Ik Cho,et al.  Stereo Matching Using Multi-directional Dynamic Programming , 2006, 2006 International Symposium on Intelligent Signal Processing and Communications.

[2]  Vladimir Kolmogorov,et al.  Graph Based Algorithms for Scene Reconstruction from Two or More Views , 2004 .

[3]  Olga Veksler,et al.  Fast variable window for stereo correspondence using integral images , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[4]  Carlo Tomasi,et al.  Depth Discontinuities by Pixel-to-Pixel Stereo , 1999, International Journal of Computer Vision.

[5]  Olga Veksler,et al.  Graph Cuts in Vision and Graphics: Theories and Applications , 2006, Handbook of Mathematical Models in Computer Vision.

[6]  Luigi di Stefano,et al.  Real-Time Stereo within the VIDET Project , 2002, Real Time Imaging.

[7]  M. Marchionni,et al.  A PC-based real-time stereo vision system , 2004 .

[8]  Nikolaos Grammalidis,et al.  Disparity field and depth map coding for multiview 3D image generation , 1998, Signal Process. Image Commun..

[9]  Emanuele Trucco,et al.  Experiments with a New Area-Based Stereo Algorithm , 1997, ICIAP.

[10]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[11]  Stefan Gehrig,et al.  Stereo matching in the presence of sub-pixel calibration errors , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Federico Tombari,et al.  Classification and evaluation of cost aggregation methods for stereo correspondence , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Emanuele Trucco,et al.  Efficient stereo with multiple windowing , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Daniel Scharstein,et al.  Stereo vision for view synthesis , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Margrit Gelautz,et al.  A layered stereo matching algorithm using image segmentation and global visibility constraints , 2005 .

[16]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Pascal Fua,et al.  Combining Stereo and Monocular Information to Compute Dense Depth Maps that Preserve Depth Discontinuities , 1991, IJCAI.

[18]  Harry Shum,et al.  Image completion with structure propagation , 2005, ACM Trans. Graph..

[19]  Nikolaos Grammalidis,et al.  Disparity and occlusion estimation in multiocular systems and their coding for the communication of multiview image sequences , 1998, IEEE Trans. Circuits Syst. Video Technol..

[20]  Takeo Kanade,et al.  A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Sungchul Kang,et al.  Fast correlation-based stereo matching with the reduction of systematic errors , 2005, Pattern Recognit. Lett..

[22]  Luigi di Stefano,et al.  Fast stereo matching for the VIDET system using a general purpose processor with multimedia extensions , 2000, Proceedings Fifth IEEE International Workshop on Computer Architectures for Machine Perception.

[23]  성민철,et al.  Stereo matching using multi-directional dynamic programming , 2007 .