Disparity Map Enhancement based Stereo Matching Method Using Optical Flow

Estimating disparity from stereo images is a core subject in computer vision. However, the poorly-textured and ambiguous surfaces cannot be matched consistently using the conventional stereo matching method, in other words, the disparity values exist many errors produced by these noises. To solve these problems, based on the characteristics that the optical flow has good robustness to low texture and deep discontinuity, we propose a novel stereo disparity map enhancement approach to improve the accuracy of disparity values in the low texture as well as deep discontinuity regions, meanwhile generate a high-quality disparity map, through performing efficient fusions between the ELAS disparity map and the optical flow image. Experimental results show that the enhanced disparity map obtained by the proposed approach can decrease the bad pixel rate by 2.6% on average compared with the ELAS method, and display accurate and consistent structures robustly.

[1]  Darius Burschka,et al.  Advances in Computational Stereo , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Jian Chen,et al.  Drivable Road Reconstruction for Intelligent Vehicles Based on Two-View Geometry , 2017, IEEE Transactions on Industrial Electronics.

[3]  Vladimir Kolmogorov,et al.  Computing visual correspondence with occlusions using graph cuts , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[4]  Junmin Wang,et al.  A Driver Steering Model With Personalized Desired Path Generation , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[5]  Stefania Perri,et al.  SAD-Based Stereo Matching Circuit for FPGAs , 2006, 2006 13th IEEE International Conference on Electronics, Circuits and Systems.

[6]  Michael Goesele,et al.  Multi-View Stereo for Community Photo Collections , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[7]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Andrew W. Fitzgibbon,et al.  Global stereo reconstruction under second order smoothness priors , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Fangmin Shi,et al.  SSD Matching Using Shift-Invariant Wavelet Transform , 2001, BMVC.

[10]  Yo-Sung Ho,et al.  Disparity map enhancement in pixel based stereo matching method using distance transform , 2016, J. Vis. Commun. Image Represent..

[11]  Julian Eggert,et al.  Stereo image warping for improved depth estimation of road surfaces , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[12]  Pedro F. Felzenszwalb,et al.  Efficient belief propagation for early vision , 2004, CVPR 2004.

[13]  Hui Liu,et al.  Two-way point cloud denoising method based on three-dimensional reconstruction data: Two-way point cloud denoising method based on three-dimensional reconstruction data , 2013 .

[14]  Vladlen Koltun,et al.  Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials , 2011, NIPS.

[15]  Narendra Ahuja,et al.  Stereo Matching Using Epipolar Distance Transform , 2012, IEEE Transactions on Image Processing.

[16]  Andreas Geiger,et al.  Efficient Large-Scale Stereo Matching , 2010, ACCV.

[17]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[18]  J. Andrew Bangham,et al.  Improving Stereo Performance in Regions of Low Texture , 1998, BMVC.

[19]  Richard Szeliski,et al.  Low-cost 360 stereo photography and video capture , 2017, ACM Trans. Graph..

[20]  Martin Humenberger,et al.  A very fast census-based stereo matching implementation on a graphics processing unit , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[21]  Didier Stricker,et al.  Combining Stereo Disparity and Optical Flow for Basic Scene Flow , 2018, ArXiv.

[22]  Wei Xiong,et al.  Fractional Stereo Matching Using Expectation-Maximization , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.