Stereo and Active-Sensor Data Fusion for Improved Stereo Block Matching

This paper proposes an algorithm which uses the depth information acquired from an active sensor as guidance for a block matching stereo algorithm. In the proposed implementation, the disparity search interval used for the block matching is reduced around the depth values obtained from the active sensor, which leads to an improved matching quality and denser disparity maps and point clouds. The performance of the proposed method is evaluated by carrying out a series of experiments on 3 different data sets obtained from different robotic systems. We demonstrate with experimental results that the disparity estimation is improved and denser disparity maps are generated.

[1]  Takeo Kanade,et al.  Integrating LIDAR into Stereo for Fast and Improved Disparity Computation , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[2]  Scott Cohen,et al.  Stereo+Kinect for High Resolution Stereo Correspondences , 2013, 2013 International Conference on 3D Vision.

[3]  Alois Knoll,et al.  Vehicle detection based on LiDAR and camera fusion , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[4]  David A. Clausi,et al.  Simultaneous Scene Reconstruction and Auto-Calibration Using Constrained Iterative Closest Point for 3D Depth Sensor Array , 2015, 2015 12th Conference on Computer and Robot Vision.

[5]  Zixiang Xiong,et al.  3D scene reconstruction by multiple structured-light based commodity depth cameras , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  John P. Kerekes,et al.  3D Scene Reconstruction through a Fusion of Passive Video and Lidar Imagery , 2007, 36th Applied Imagery Pattern Recognition Workshop (aipr 2007).

[7]  Martin Hägele,et al.  Robotic home assistant Care-O-bot® 3 - product vision and innovation platform , 2009, 2009 IEEE Workshop on Advanced Robotics and its Social Impacts.

[8]  W. Sardha Wijesoma,et al.  Improving path planning and mapping based on stereo vision and lidar , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[9]  Giulio Reina,et al.  LIDAR and stereo imagery integration for safe navigation in outdoor settings , 2013, 2013 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).