An asymmetric post-processing for correspondence problem

This paper presents a novel approach that performs post-processing for stereo matching. We improve the performance of stereo matching by performing consistency check and adaptive filtering in an iterative filtering scheme. The consistency check is only done with asymmetric information so that very few additional computational loads are necessary. The information in the valid pixels is propagated into invalid pixels through the adaptive filtering. The proposed post-filtering method can be used in various methods for stereo matching. We demonstrate the validity of the proposed method by applying it to hierarchical belief propagation and semi-global matching. The performance of the post-processing method for hierarchical belief propagation is comparable to state-of-the-art methods in the Middlebury stereo datasets. In order to verify the performance of asymmetric consistency check, we compare it with other reliability estimation methods in the proposed post-processing scheme. Moreover, in order to verify the performance of post-filtering method in noisy environment, the proposed post-filtering method is applied to the stereo images denoised by NL-means algorithm. We find that the iterative filtering scheme reduce an error which may be caused in stereo matching for the denoised images and improve the performance of stereo matching.

[1]  In-So Kweon,et al.  Stereo Matching with the Distinctive Similarity Measure , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[2]  Sang Uk Lee,et al.  Simultaneous Depth Reconstruction and Restoration of Noisy Stereo Images using Non-local Pixel Distribution , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Jean-Michel Morel,et al.  Nonlocal Image and Movie Denoising , 2008, International Journal of Computer Vision.

[4]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[5]  Sang Uk Lee,et al.  Stereo matching using iterative reliable disparity map expansion in the color-spatial-disparity space , 2007, Pattern Recognit..

[6]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[7]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Margrit Gelautz,et al.  A layered stereo algorithm using image segmentation and global visibility constraints , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[9]  Kwanghoon Sohn,et al.  Asymmetric post-processing for stereo correspondence , 2008, 2008 19th International Conference on Pattern Recognition.

[10]  Pedro F. Felzenszwalb,et al.  Efficient belief propagation for early vision , 2004, CVPR 2004.

[11]  Heiko Hirschmüller,et al.  Stereo Vision in Structured Environments by Consistent Semi-Global Matching , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  Sing Bing Kang,et al.  Stereo for Image-Based Rendering using Image Over-Segmentation , 2007, International Journal of Computer Vision.

[13]  Ruigang Yang,et al.  Stereo Matching with Color-Weighted Correlation, Hierarchical Belief Propagation and Occlusion Handling , 2006, CVPR.

[14]  H. Hirschmüller Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Stereo Processing by Semi-global Matching and Mutual Information , 2022 .

[15]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Richard Szeliski,et al.  Handling occlusions in dense multi-view stereo , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  Ruigang Yang,et al.  Spatial-Depth Super Resolution for Range Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Kwanghoon Sohn,et al.  Cost Aggregation and Occlusion Handling With WLS in Stereo Matching , 2008, IEEE Transactions on Image Processing.

[20]  Jan-Michael Frahm,et al.  Real-Time Visibility-Based Fusion of Depth Maps , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[21]  Reinhard Männer,et al.  Calculating Dense Disparity Maps from Color Stereo Images, an Efficient Implementation , 2004, International Journal of Computer Vision.

[22]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[24]  Federico Tombari,et al.  Stereo Vision Enabling Precise Border Localization Within a Scanline Optimization Framework , 2007, ACCV.

[25]  Dani Lischinski,et al.  Joint bilateral upsampling , 2007, SIGGRAPH 2007.

[26]  J. Hesser,et al.  Calculating Dense Disparity Maps from Color Stereo Images, an Efficient Implementation , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[27]  Vladimir Kolmogorov,et al.  Computing visual correspondence with occlusions using graph cuts , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[28]  Yuichi Taguchi,et al.  Stereo reconstruction with mixed pixels using adaptive over-segmentation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Marc Pollefeys,et al.  Temporally Consistent Reconstruction from Multiple Video Streams Using Enhanced Belief Propagation , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[30]  Andreas Klaus,et al.  Segment-Based Stereo Matching Using Belief Propagation and a Self-Adapting Dissimilarity Measure , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[31]  Jian Sun,et al.  Symmetric stereo matching for occlusion handling , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).