Cross-scale cost aggregation integrating intrascale smoothness constraint with weighted least squares in stereo matching.

Cross-scale cost aggregation (CSCA) allows pixel-wise multiscale interaction in the aggregated cost computation. This kind of multiscale constraint strengthens the consistency of interscale cost volume and behaves well in a textureless region, compared with single-scale cost aggregation. However, the relationship between neighbors' cost is ignored. Based on the prior knowledge that costs should vary smoothly, except at object boundaries, the smoothness constraint on cost in a neighborhood system is integrated into the CSCA model with weighted least squares for reliable matching in this paper. Our improved algorithm not only has the advantage of CSCA in computational efficiency, but also performs better than CSCA, especially on the KITTI data sets. Experimental evidence demonstrates that the proposed algorithm outperforms CSCA in textureless and discontinuous regions. Quantitative evaluations demonstrate the effectiveness and efficiency of the proposed method for improving disparity estimation accuracy.

[1]  T. Poggio,et al.  A computational theory of human stereo vision , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[2]  Kwanghoon Sohn,et al.  Cost Aggregation and Occlusion Handling With WLS in Stereo Matching , 2008, IEEE Transactions on Image Processing.

[3]  Jitendra Malik,et al.  Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Eric Psota,et al.  Real-Time Stereo Matching on CUDA Using an Iterative Refinement Method for Adaptive Support-Weight Correspondences , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Carsten Rother,et al.  Fast Cost-Volume Filtering for Visual Correspondence and Beyond , 2013, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Hanspeter A. Mallot,et al.  Is correspondence search in human stereo vision a coarse-to-fine process? , 1996, Biological Cybernetics.

[7]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  R. Freeman,et al.  Stereoscopic depth processing in the visual cortex: a coarse-to-fine mechanism , 2003, Nature Neuroscience.

[9]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.