Depth Estimation Based on Stereo Image Using Passive Sensor

This article presents an algorithm for depth estimation using a pair of passive sensors which involves two cameras. These cameras did not produce any energy to collect the depth information. However, the depth information obtained from a camera can be produced by a matching process between two images at the same viewpoints. These images are captured from two cameras, which are also known as stereo cameras. The matching process consists of several stages, which will produce depth map. The most challenging problem for the matching process is to get an accurate corresponding point between two images. Hence, this article proposes an algorithm for stereo matching using Weighted Sum of Absolute Differences (WSAD), Median Filter (MF), and Bilateral Filter (BF) to surge up the accuracy. The WSAD will be implemented at the first stage to get the preliminary corresponding result, then the BF works as an edge-preserving filter to remove the noise from the first stage. The MF is used at the last stage to improve final depth map. A standard benchmarking dataset from the Middlebury has been used for the experimental analysis and validation. The proposed work in this article achieves good accuracy. The comparison is also conducted with some established methods where the proposed framework performs much better.

[1]  Rostam Affendi Hamzah,et al.  Depth evaluation in selected region of disparity mapping for navigation of stereo vision mobile robot , 2010, 2010 IEEE Symposium on Industrial Electronics and Applications (ISIEA).

[2]  Ikuko Shimizu,et al.  High accuracy local stereo matching using DoG scale map , 2017, 2017 Fifteenth IAPR International Conference on Machine Vision Applications (MVA).

[3]  Jonathan M. Garibaldi,et al.  Real-Time Correlation-Based Stereo Vision with Reduced Border Errors , 2002, International Journal of Computer Vision.

[4]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[5]  Dongxiao Li,et al.  Fast stereo matching using adaptive guided filtering , 2014, Image Vis. Comput..

[6]  Daphne Bavelier,et al.  Recovering stereo vision by squashing virtual bugs in a virtual reality environment , 2016, Philosophical Transactions of the Royal Society B: Biological Sciences.

[7]  Julian Eggert,et al.  Anisotropic Median Filtering for Stereo Disparity Map Refinement , 2018, VISAPP.

[8]  Qian Liang,et al.  Stereo matching algorithm based on ground control points using graph cut , 2014, 2014 7th International Congress on Image and Signal Processing.

[9]  M. S. Hamid,et al.  A distance and pixel intensity relation for disparity mapping in region of interest , 2011, 2011 IEEE 3rd International Conference on Communication Software and Networks.

[10]  Haifeng Xi,et al.  Wide Baseline Matching Using Support Vector Regression , 2013 .

[11]  Haidi Ibrahim,et al.  Improvement of stereo matching algorithm for 3D surface reconstruction , 2018, Signal Process. Image Commun..

[12]  Rostam Affendi Hamzah,et al.  Disparity Mapping for Navigation of Stereo Vision Autonomous Guided Vehicle , 2009, 2009 International Conference of Soft Computing and Pattern Recognition.

[13]  Rostam Affendi Hamzah,et al.  Region of Interest in Disparity Mapping for Navigation of Stereo Vision Autonomous Guided Vehicle , 2009 .

[14]  Christian Theobalt,et al.  Dense Wide-Baseline Scene Flow from Two Handheld Video Cameras , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[15]  Jean-Charles Bricola,et al.  Morphological processing of stereoscopic image superimpositions for disparity map estimation , 2016 .

[16]  R. A. Hamzah,et al.  A pixel to pixel correspondence and region of interest in stereo vision application , 2012, 2012 IEEE Symposium on Computers & Informatics (ISCI).

[17]  Andreas Geiger,et al.  Efficient Large-Scale Stereo Matching , 2010, ACCV.

[18]  Xiang Li,et al.  Accurate Dense Stereo Matching Based on Image Segmentation Using an Adaptive Multi-Cost Approach , 2016, Symmetry.

[19]  Eric Psota,et al.  Real-Time Stereo Matching on CUDA Using an Iterative Refinement Method for Adaptive Support-Weight Correspondences , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Haidi Ibrahim,et al.  Stereo matching algorithm for 3D surface reconstruction based on triangulation principle , 2016, 2016 1st International Conference on Information Technology, Information Systems and Electrical Engineering (ICITISEE).

[21]  Liang-Gee Chen,et al.  Efficient Hardware Architecture for Large Disparity Range Stereo Matching Based on Belief Propagation , 2016, 2016 IEEE International Workshop on Signal Processing Systems (SiPS).

[22]  Yann LeCun,et al.  Computing the stereo matching cost with a convolutional neural network , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Rostam Affendi Hamzah,et al.  Disparity Refinement Process Based On Ransac Plane Fitting For Machine Vision Applications , 2018 .

[24]  R. A. Hamzah,et al.  Visualization of image distortion on camera calibration for stereo vision application , 2012, 2012 IEEE International Conference on Control System, Computing and Engineering.

[25]  Qingxiong Yang,et al.  A non-local cost aggregation method for stereo matching , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Carsten Rother,et al.  Fast Cost-Volume Filtering for Visual Correspondence and Beyond , 2013, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Andreas Geiger,et al.  Object scene flow for autonomous vehicles , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).