Stereo matching algorithm based on per pixel difference adjustment, iterative guided filter and graph segmentation

Stereo matching process is a difficult and challenging task due to many uncontrollable factors that affect the results. These factors include the radiometric variations and illumination inconsistence. The absolute differences (AD) algorithms work fast, but they are too sensitive to noise and low textured areas. Therefore, this paper proposes an improved algorithm to overcome these limitations. First, the proposed algorithm utilizes per-pixel difference adjustment for AD and gradient matching to reduce the radiometric distortions. Then, both differences are combined with census transform to reduce the effect of illumination variations. Second, a new approach of iterative guided filter is introduced at cost aggregation to preserve and improve the object boundaries. The undirected graph segmentation is used at the last stage in order to smoothen the low textured areas. The experimental results on the standard indoor and outdoor datasets show that the proposed algorithm produces smooth disparity maps and accurate results.

[1]  Yuan Zhou,et al.  Stereo matching based on guided filter and segmentation , 2015 .

[2]  Jonathan M. Garibaldi,et al.  Real-Time Correlation-Based Stereo Vision with Reduced Border Errors , 2002, International Journal of Computer Vision.

[3]  Weiming Dong,et al.  Segment-tree based cost aggregation for stereo matching with enhanced segmentation advantage , 2013, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  C. Stentoumis,et al.  On accurate dense stereo-matching using a local adaptive multi-cost approach , 2014 .

[5]  Truong Q. Nguyen,et al.  Local Disparity Estimation With Three-Moded Cross Census and Advanced Support Weight , 2013, IEEE Transactions on Multimedia.

[6]  Petros Daras,et al.  Enhanced disparity estimation in stereo images , 2015, Image Vis. Comput..

[7]  Yann LeCun,et al.  Computing the stereo matching cost with a convolutional neural network , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Xiu Hua Jiang,et al.  A Fast Stereo Matching Algorithm Based on Fixed-Window , 2013 .

[9]  Joost van de Weijer,et al.  Accurate Stereo Matching by Two-Step Energy Minimization , 2015, IEEE Transactions on Image Processing.

[10]  Xing Mei,et al.  On building an accurate stereo matching system on graphics hardware , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[11]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Petros Daras,et al.  Content-Based Guided Image Filtering, Weighted Semi-Global Optimization, and Efficient Disparity Refinement for Fast and Accurate Disparity Estimation , 2016, IEEE Transactions on Multimedia.

[13]  Changming Sun,et al.  Stereo matching using cost volume watershed and region merging , 2014, Signal Process. Image Commun..

[14]  Antonios Gasteratos,et al.  A stereo matching approach based on particle filters and scattered control landmarks , 2015, Image Vis. Comput..

[15]  Qingxiong Yang,et al.  A non-local cost aggregation method for stereo matching , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Rafael Grompone von Gioi,et al.  LSD: a Line Segment Detector , 2012, Image Process. Line.

[17]  Cheng Zhang,et al.  Accurate Image-Guided Stereo Matching With Efficient Matching Cost and Disparity Refinement , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Lei Zhang,et al.  Effective stereo matching using reliable points based graph cut , 2013, 2013 Visual Communications and Image Processing (VCIP).

[20]  Rudy Lauwereins,et al.  Real-Time and Accurate Stereo: A Scalable Approach With Bitwise Fast Voting on CUDA , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Minh N. Do,et al.  Depth Video Enhancement Based on Weighted Mode Filtering , 2012, IEEE Transactions on Image Processing.

[22]  Julian Eggert,et al.  Anisotropic Median Filtering for Stereo Disparity Map Refinement , 2018, VISAPP.

[23]  Sheng Liu,et al.  Superpixel-Based Global Optimization Method for Stereo Disparity Estimation , 2014, CCPR.

[24]  Chen Yang,et al.  Real-time hardware stereo matching using guided image filter , 2016, 2016 International Great Lakes Symposium on VLSI (GLSVLSI).

[25]  Jean-François Nezan,et al.  Real-time GPU-based local stereo matching method , 2013, 2013 Conference on Design and Architectures for Signal and Image Processing.

[26]  Enhua Wu,et al.  Constant Time Weighted Median Filtering for Stereo Matching and Beyond , 2013, 2013 IEEE International Conference on Computer Vision.

[27]  Andreas Geiger,et al.  Efficient Large-Scale Stereo Matching , 2010, ACCV.

[28]  Lifeng Sun,et al.  Binary stereo matching , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[29]  Xi Wang,et al.  High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth , 2014, GCPR.

[30]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Dieter Fritsch,et al.  IMAGE ACQUISITION AND MODEL SELECTION FOR MULTI-VIEW STEREO , 2013 .

[32]  Shiqiang Zhu,et al.  Edge-preserving guided filtering based cost aggregation for stereo matching , 2016, J. Vis. Commun. Image Represent..

[33]  Il Hong Suh,et al.  Robust stereo matching using adaptive random walk with restart algorithm , 2015, Image Vis. Comput..

[34]  Andreas Geiger,et al.  Object scene flow for autonomous vehicles , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Liming Chen,et al.  A Fast Trilateral Filter-Based Adaptive Support Weight Method for Stereo Matching , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[36]  Federico Tombari,et al.  Stereo Vision Enabling Precise Border Localization Within a Scanline Optimization Framework , 2007, ACCV.

[37]  Zheng Li,et al.  Local Stereo Matching Using Combined Matching Cost and Adaptive Cost Aggregation , 2015, KSII Trans. Internet Inf. Syst..

[38]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[40]  Qunsheng Peng,et al.  Depth map enhancement based on color and depth consistency , 2013, The Visual Computer.

[41]  Wang Xiaofeng,et al.  Accurate Belief Propagation with parametric and non-parametric measure for stereo matching , 2015 .

[42]  Richard Szeliski,et al.  Efficient High-Resolution Stereo Matching Using Local Plane Sweeps , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[43]  Pascal Monasse,et al.  Stereo Disparity through Cost Aggregation with Guided Filter , 2014, Image Process. Line.

[44]  Zheng Li,et al.  Stereo matching algorithm with guided filter and modified dynamic programming , 2015, Multimedia Tools and Applications.

[45]  F. Bethmann,et al.  Semi-Global Matching in Object Space , 2015 .

[46]  Carsten Rother,et al.  REal-time local stereo matching using guided image filtering , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[47]  Dongxiao Li,et al.  Fast stereo matching using adaptive guided filtering , 2014, Image Vis. Comput..

[48]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[49]  Martin Humenberger,et al.  A census-based stereo vision algorithm using modified Semi-Global Matching and plane fitting to improve matching quality , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[50]  Haidi Ibrahim,et al.  Literature Survey on Stereo Vision Disparity Map Algorithms , 2016, J. Sensors.

[51]  Ronggang Wang,et al.  Stereo matching with space-constrained cost aggregation and segmentation-based disparity refinement , 2015, Electronic Imaging.