Dependable dense stereo matching by both two-layer recurrent process and chaining search

Disparity computation in occluded or texture-less regions is considered to be a fundamental issue in dense stereo matching, but there is another practical issue that must be resolved before it can be used effectively in various robotics applications. This issue is the problem of intensity difference between corresponding pixels of an image pair. To tackle such problems, we present a dependable stereo matching algorithm using two-layer recurrent process and chaining search. Two-layer process integrates pixel and region-levels information through recurrent interaction. To estimate the precise disparities in occluded regions, reliable disparities in non-occluded region are propagated to occluded regions by the proposed chaining search. To test our algorithm, it was compared with two outstanding algorithms in Middlebury benchmark using Gaussian noisy images. The results validated the effectiveness of our approach.

[1]  D. Nistér,et al.  Stereo Matching with Color-Weighted Correlation, Hierarchical Belief Propagation, and Occlusion Handling , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Vladimir Kolmogorov,et al.  Computing visual correspondence with occlusions using graph cuts , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[3]  Margrit Gelautz,et al.  Graph-cut-based stereo matching using image segmentation with symmetrical treatment of occlusions , 2007, Signal Process. Image Commun..

[4]  Carsten Rother,et al.  Fast cost-volume filtering for visual correspondence and beyond , 2011, CVPR 2011.

[5]  Ruigang Yang,et al.  Stereo Matching with Color-Weighted Correlation, Hierarchical Belief Propagation and Occlusion Handling , 2006, CVPR.

[6]  KweonIn So,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006 .

[7]  Ignazio Gallo,et al.  Neural disparity computation for dense two-frame stereo correspondence , 2008, Pattern Recognit. Lett..

[8]  HirschmullerHeiko Stereo Processing by Semiglobal Matching and Mutual Information , 2008 .

[9]  Sang Uk Lee,et al.  Robust Stereo Matching Using Adaptive Normalized Cross-Correlation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Sing Bing Kang,et al.  Stereo for Image-Based Rendering using Image Over-Segmentation , 2007, International Journal of Computer Vision.

[13]  Tae-Sun Choi,et al.  Depth Map and 3D Imaging Applications: Algorithms and Technologies , 2011 .

[14]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[16]  Heiko Neumann,et al.  A Fast Biologically Inspired Algorithm for Recurrent Motion Estimation , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Andreas Klaus,et al.  Segment-Based Stereo Matching Using Belief Propagation and a Self-Adapting Dissimilarity Measure , 2006, 18th International Conference on Pattern Recognition (ICPR'06).