Stereo Matching Based Estimation of Depth Map from Stereo Image Pair

Stereo vision is a technique of depth perception, in which the information about the depth is inferred from the two (or more) images captured from different perspectives of a scene. These images is known as stereo image pair. Practical applications where stereo vision technology plays a role may include autonomous vehicle guidance, aerial photogrammetry, robotics vision, object tracking and industrial automation. Many automated vision systems could benefit substantially from depth maps. A depth map is a grayscale image that contains depth information for each pixel in an image. Traditionally depth maps were extracted using stereo camera approach. Depth estimation from stereo involves finding disparities along the same scanline, also called as epipolar lines. Such a search process typically requires a prior adjustment of the images known as rectification step to ensure that epipolar lines are well aligned. Still, the approaches for estimation of depth map suffer from either limited reliability and robustness when tested on stereo image pair or large time of computation. A novel approach for depth estimation that integrates the image filtering into a stereo matching framework is introduced. Experiment helps verifying the sustenance of high quality in depth maps, while reducing the average percent of bad pixels to 3.58%.

[1]  Margrit Gelautz,et al.  Secrets of adaptive support weight techniques for local stereo matching , 2013, Comput. Vis. Image Underst..

[2]  Qingxiong Yang,et al.  Stereo Matching Using Tree Filtering , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Mongi A. Abidi,et al.  Occlusion filling in stereo: Theory and experiments , 2013, Comput. Vis. Image Underst..

[5]  Jae Wook Jeon,et al.  Local Density Encoding for Robust Stereo Matching , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Zhengguo Li,et al.  Gradient Domain Guided Image Filtering , 2015, IEEE Transactions on Image Processing.

[7]  Tien-Tsin Wong,et al.  A Markov Random Field Approach for Dense Photometric Stereo , 2005, CVPR.

[8]  Guijin Wang,et al.  High-Accuracy Stereo Matching Based on Adaptive Ground Control Points , 2015, IEEE Transactions on Image Processing.

[9]  Dongxiao Li,et al.  Full-Image Guided Filtering for Fast Stereo Matching , 2013, IEEE Signal Processing Letters.

[10]  Xiaoyan Hu,et al.  A Quantitative Evaluation of Confidence Measures for Stereo Vision , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Andreas Geiger,et al.  Efficient Large-Scale Stereo Matching , 2010, ACCV.

[12]  Qingxiong Yang,et al.  Hardware-Efficient Bilateral Filtering for Stereo Matching , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Rob A. Rutenbar,et al.  FPGA acceleration of Markov Random Field TRW-S inference for stereo matching , 2013, 2013 Eleventh ACM/IEEE International Conference on Formal Methods and Models for Codesign (MEMOCODE 2013).

[14]  Liang-Gee Chen,et al.  Efficient message reduction algorithm for stereo matching using belief propagation , 2010, 2010 IEEE International Conference on Image Processing.

[15]  Jingzhou Huang Stereo matching based on segmented B-spline surface fitting and accelerated region belief propagation , 2015, IET Comput. Vis..

[16]  Carsten Rother,et al.  REal-time local stereo matching using guided image filtering , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[17]  Avishek Saha,et al.  Efficient local stereo matching technique using weighted guided image filtering (WGIF) , 2016, 2016 IEEE International Conference on Consumer Electronics (ICCE).

[18]  Stan Z. Li,et al.  Markov Random Field Modeling in Image Analysis , 2001, Computer Science Workbench.

[19]  Kuk-jin Yoon Stereo matching based on nonlinear diffusion with disparity-dependent support weights , 2012 .

[20]  Lu Fang,et al.  Stereo Matching with Optimal Local Adaptive Radiometric Compensation , 2015, IEEE Signal Processing Letters.

[21]  R. Zabih,et al.  Efficient Graph-Based Energy Minimization Methods in Computer Vision , 1999 .

[22]  Álvaro Arranz,et al.  Multiresolution energy minimisation framework for stereo matching , 2012 .

[23]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[24]  Eric Psota,et al.  Real-Time Stereo Matching on CUDA Using an Iterative Refinement Method for Adaptive Support-Weight Correspondences , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Theocharis Theocharides,et al.  A Low-Cost Real-Time Embedded Stereo Vision System for Accurate Disparity Estimation Based on Guided Image Filtering , 2016, IEEE Transactions on Computers.

[26]  Jinhai Cai,et al.  Integration of optical flow and dynamic programming for stereo matching , 2012 .

[27]  Joost van de Weijer,et al.  Accurate Stereo Matching by Two-Step Energy Minimization , 2015, IEEE Transactions on Image Processing.

[28]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[29]  Minh N. Do,et al.  Joint Histogram-Based Cost Aggregation for Stereo Matching , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Jae Wook Jeon,et al.  Domain Transformation-Based Efficient Cost Aggregation for Local Stereo Matching , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Truong Q. Nguyen,et al.  Discriminability Limits in Spatio-Temporal Stereo Block Matching , 2014, IEEE Transactions on Image Processing.

[32]  Wen Gao,et al.  Local Stereo Matching with Improved Matching Cost and Disparity Refinement , 2014, IEEE MultiMedia.

[33]  Jin-Hyung Kim,et al.  Multi-baseline based texture adaptive belief propagation stereo matching technique for dense depth-map acquisition , 2014, 2014 International Conference on Electronics, Information and Communications (ICEIC).

[34]  Rob A. Rutenbar,et al.  Error Resilient and Energy Efficient MRF Message-Passing-Based Stereo Matching , 2016, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[35]  Yuan Zhou,et al.  Stereo matching based on guided filter and segmentation , 2015 .

[36]  Shiqian Wu,et al.  Weighted Guided Image Filtering , 2016, IEEE Transactions on Image Processing.

[37]  Rob A. Rutenbar,et al.  Video-Rate Stereo Matching Using Markov Random Field TRW-S Inference on a Hybrid CPU+FPGA Computing Platform , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[38]  Nabil Aouf,et al.  A Novel Image Representation via Local Frequency Analysis for Illumination Invariant Stereo Matching , 2015, IEEE Transactions on Image Processing.

[39]  Guohua Peng,et al.  Histogram-based cost aggregation strategy with joint bilateral filtering for stereo matching , 2016, IET Comput. Vis..

[40]  Sang Uk Lee,et al.  Robust Stereo Matching Using Adaptive Normalized Cross-Correlation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Liming Chen,et al.  A Fast Trilateral Filter-Based Adaptive Support Weight Method for Stereo Matching , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[42]  Petros Daras,et al.  Content-Based Guided Image Filtering, Weighted Semi-Global Optimization, and Efficient Disparity Refinement for Fast and Accurate Disparity Estimation , 2016, IEEE Transactions on Multimedia.