Stereo matching by using the global edge constraint

Stereo matching, the key problem in the field of computer vision has long been researched for decades. However, constructing an accurate dense disparity map is still very challenging for both local and global algorithms, especially when dealing with the occlusions and disparity discontinuities. In this paper, by exploring the characteristics of the color edges, a novel constraint named the global edge constraint (GEC) is proposed to discriminate the locations of potential occlusions and disparity discontinuities. The initial disparity map is estimated by using a local algorithm, in which the GEC could guarantee that the optimal support windows would not cross the occlusions. Then a global optimization framework is adopted to improve the accuracy of the disparity map. The data term of the energy function is constructed by using the reliable correspondences selected from the initial disparity map; and the smooth term incorporates the GEC as a soft constraint to handle the disparity discontinuities. Optimal solution can be approximated via existing energy minimization approaches such as Graph cuts used in this paper. Experimental results using the Middlebury Stereo test bed demonstrate the superior performance of the proposed approach.

[1]  Narendra Ahuja,et al.  A constant-space belief propagation algorithm for stereo matching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Neil A. Dodgson,et al.  Real-Time Spatiotemporal Stereo Matching Using the Dual-Cross-Bilateral Grid , 2010, ECCV.

[3]  Luigi di Stefano,et al.  A fast area-based stereo matching algorithm , 2004, Image Vis. Comput..

[4]  Federico Tombari,et al.  Classification and evaluation of cost aggregation methods for stereo correspondence , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Margrit Gelautz,et al.  Secrets of adaptive support weight techniques for local stereo matching , 2013, Comput. Vis. Image Underst..

[6]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[7]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[8]  Pushmeet Kohli,et al.  Object stereo — Joint stereo matching and object segmentation , 2011, CVPR 2011.

[9]  D. Nistér,et al.  Stereo Matching with Color-Weighted Correlation, Hierarchical Belief Propagation, and Occlusion Handling , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Long Quan,et al.  Match Propagation for Image-Based Modeling and Rendering , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  S. Birchfiled A Pixel Dissimilarity Measure That Is Insensitive to Image Sampling , 1998 .

[12]  Olga Veksler,et al.  Fast variable window for stereo correspondence using integral images , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[13]  Kun Wang Adaptive stereo matching algorithm based on edge detection , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[14]  Takeo Kanade,et al.  A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Yuichi Taguchi,et al.  Stereo reconstruction with mixed pixels using adaptive over-segmentation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Heiko Hirschmüller,et al.  Evaluation of Stereo Matching Costs on Images with Radiometric Differences , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Andreas Klaus,et al.  Segment-Based Stereo Matching Using Belief Propagation and a Self-Adapting Dissimilarity Measure , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[20]  Emanuele Trucco,et al.  Efficient stereo with multiple windowing , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Harry Shum,et al.  Cooperative segmentation and stereo using perspective space search , 2004 .

[22]  Margrit Gelautz,et al.  Local stereo matching using geodesic support weights , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[23]  Ding Yuan,et al.  Stereo matching with Global Edge Constraint and Graph Cuts , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[24]  Jae Wook Jeon,et al.  Efficient spatio-temporal local stereo matching using information permeability filtering , 2012, 2012 19th IEEE International Conference on Image Processing.

[25]  Olga Veksler,et al.  Stereo Correspondence with Compact Windows via Minimum Ratio Cycle , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Ruigang Yang,et al.  A Performance Study on Different Cost Aggregation Approaches Used in Real-Time Stereo Matching , 2007, International Journal of Computer Vision.

[27]  Ding Yuan,et al.  Dense stereo matching based on edge constraint and variable windows , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[28]  Carsten Rother,et al.  Fast cost-volume filtering for visual correspondence and beyond , 2011, CVPR 2011.

[29]  Margrit Gelautz,et al.  Accuracy-Efficiency Evaluation of Adaptive Support Weight Techniques for Local Stereo Matching , 2012, DAGM/OAGM Symposium.

[30]  Stefano Mattoccia,et al.  Linear stereo matching , 2011, 2011 International Conference on Computer Vision.

[31]  Hai Tao,et al.  A global matching framework for stereo computation , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[32]  Zhigeng Pan,et al.  Real-time stereo matching based on fast belief propagation , 2011, Machine Vision and Applications.

[33]  Ding Yuan,et al.  Stereo Matching with Global Edge Constraint and Occlusion Handling , 2012, 2012 International Conference on Digital Image Computing Techniques and Applications (DICTA).

[34]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Ruigang Yang,et al.  Global stereo matching leveraged by sparse ground control points , 2011, CVPR 2011.