Real Time Stereo Matching Using Two Step Zero-Mean SAD and Dynamic Programing

Dense depth map extraction is a dynamic research field in a computer vision that tries to recover three-dimensional information from a stereo image pair. A large variety of algorithms has been developed. The local methods based on block matching that are prevalent due to the linear computational complexity and easy implementation. This local cost is used on global methods as graph cut and dynamic programming in order to reduce sensitivity to local to occlusion and uniform texture. This paper proposes a new method for matching images based on a two-stage of block matching as local cost function and dynamic programming as energy optimization approach. In our work introduce the two stage of the zero-mean sum of absolute differences (ZSAD) combined with dynamic programming: the smoothness and ordering constraints are used to optimize correspondences. Stereo matching accuracy and runtime are the fundamental metrics to evaluate the stereo matching methods. The real-time has become a reality through the complexity reduction of the calculation and the use of parallel high-performance graphics hardware. In this paper we evaluate the developed method on using Middlebury stereo benchmark and, we propose a GPU CUDA implementation in order to accelerate our algorithm and reach the real time.

[1]  Julian Eggert,et al.  A Two-Stage Correlation Method for Stereoscopic Depth Estimation , 2010, 2010 International Conference on Digital Image Computing: Techniques and Applications.

[2]  Lifeng Sun,et al.  Binary stereo matching , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[3]  Xiang Li,et al.  Accurate Dense Stereo Matching Based on Image Segmentation Using an Adaptive Multi-Cost Approach , 2016, Symmetry.

[4]  Vamshhi Pavan Kumar Varma Vegeshna,et al.  Stereo Matching with Color-Weighted Correlation, Hierachical Belief Propagation and Occlusion Handling , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[5]  Miao Liao,et al.  High-Quality Real-Time Stereo Using Adaptive Cost Aggregation and Dynamic Programming , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[6]  Miao Liao,et al.  Real-time Global Stereo Matching Using Hierarchical Belief Propagation , 2006, BMVC.

[7]  S. Sabihuddin,et al.  Dynamic programming approach to high frame-rate stereo correspondence: A pipelined architecture implemented on a field programmable gate array , 2008, 2008 Canadian Conference on Electrical and Computer Engineering.

[8]  Minglun Gong,et al.  Near real-time reliable stereo matching using programmable graphics hardware , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Jaime A. Martins,et al.  Luminance, Colour, Viewpoint and Border Enhanced Disparity Energy Model , 2015, PloS one.

[10]  Vladimir Kolmogorov,et al.  Computing visual correspondence with occlusions using graph cuts , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[11]  Mohd Fauzi Othman,et al.  A new fast and robust stereo matching algorithm for robotic systems , 2013 .

[12]  Takeo Kanade,et al.  Stereo by Intra- and Inter-Scanline Search Using Dynamic Programming , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Stefan Lüke,et al.  Real-Time Stereo Vision: Making More Out of Dynamic Programming , 2009, CAIP.

[14]  Darius Burschka,et al.  Advances in Computational Stereo , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Lifeng Sun,et al.  Cross-Scale Cost Aggregation for Stereo Matching , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Olga Veksler,et al.  Stereo correspondence by dynamic programming on a tree , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Ji Ma,et al.  A Modified Census Transform Based on the Neighborhood Information for Stereo Matching Algorithm , 2013, 2013 Seventh International Conference on Image and Graphics.

[18]  Richard Szeliski,et al.  Efficient High-Resolution Stereo Matching Using Local Plane Sweeps , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[20]  Andreas Zell,et al.  LS-ELAS: Line segment based efficient large scale stereo matching , 2017, ICRA 2017.

[21]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Georgios D. Evangelidis,et al.  An enhanced correlation-based method for stereo correspondence with subpixel accuracy , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[23]  Neil A. Dodgson,et al.  Real-Time Spatiotemporal Stereo Matching Using the Dual-Cross-Bilateral Grid , 2010, ECCV.

[24]  Eric Psota,et al.  Real-Time Stereo Matching on CUDA Using an Iterative Refinement Method for Adaptive Support-Weight Correspondences , 2013, IEEE Transactions on Circuits and Systems for Video Technology.