Edge-preserving efficient dense stereo matching

Edge accurate dense disparity estimation is of great importance to applications, such as augmented reality where the geometry relationships among objects in a scene need to be presented precisely. Binocular stereo is a promising approach to get 3D depth information of a real scene from 2D images, but faces the issue of difficult to achieve high accurate disparity edges with reasonable computation complexity. A depth edge preserving dense stereo matching method is presented in this paper aiming to alleviate this problem. By taking a sparse-to-dense route for disparity estimation, depth edges corresponding to object boundaries are distinguished from the texture edges based on sparse disparities which can be obtained efficiently. With a designed disparity filling strategy, these extracted edges are used to refine the dense disparities and align the depth discontinuity edges with corresponding object boundaries. Disparities obtained by this work can faithfully conform to the scene geometry recorded in the input images only with a relative small increase about 13% in computational complexity. The effectiveness of the proposed method is verified through experiments and contrastive analysis.

[1]  Philip J. Hatcher,et al.  Binary adaptive semi-global matching based on image edges , 2015, Digital Image Processing.

[2]  Haitao Wei,et al.  Confidence-based iterative efficient large-scale stereo matching , 2018 .

[3]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Shiqiang Zhu,et al.  Edge-preserving guided filtering based cost aggregation for stereo matching , 2016, J. Vis. Commun. Image Represent..

[5]  Cheng Han,et al.  Adaptive Weight Based Sparse Block Aggregation Algorithm for Stereo Matching , 2019, 2019 9th International Conference on Information Science and Technology (ICIST).

[6]  Robert B. Fisher,et al.  3D Plane Labeling Stereo Matching with Content Aware Adaptive Windows , 2017, VISIGRAPP.

[7]  Jen-Jer Jaw,et al.  Dense Stereo Matching With Edge-Constrained Penalty Tuning , 2018, IEEE Geoscience and Remote Sensing Letters.

[8]  Jianhua Zou,et al.  Image Edge Based Efficient Stereo Matching , 2019, 2019 IEEE 8th Joint International Information Technology and Artificial Intelligence Conference (ITAIC).

[9]  Andreas Zell,et al.  LS-ELAS: Line segment based efficient large scale stereo matching , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Yo-Sung Ho,et al.  Adaptive Pixel-wise and Block-wise Stereo Matching in Lighting Condition Changes , 2019, J. Signal Process. Syst..

[11]  Xinyu Hu,et al.  Research on Improvement of Stereo Matching Algorithm Based on ELAS , 2018 .

[12]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[13]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Madaín Pérez Patricio,et al.  FPGA implementation of an efficient similarity-based adaptive window algorithm for real-time stereo matching , 2015, Journal of Real-Time Image Processing.

[15]  Andreas Geiger,et al.  Efficient Large-Scale Stereo Matching , 2010, ACCV.