Accurate and fast obstacle detection method for automotive applications based on stereo vision

This paper describes a simple yet efficient method of obstacle detection. Different from other methods, this study utilizes the coordinate models of and the depth map generated from stereo cameras to accurately detect possible obstacles. The proposed algorithm searches on the depth map along vertical direction for pixels having the same disparity. Having the same disparity indicates that these pixels are from the same object, and such object is an obstacle on the road. After implementation, the average processing time of the proposed obstacle detection algorithm for HD 720p image requires only 4.0 milliseconds (ms) on Intel Core i7 3.6 GHz processor, and 16.3 ms on an embedded system, i.e., the NVIDIA Jetson TX1. The detection performance based on stereo vision is more precise and faster compared with 2-D image object recognition. By directly comparing the purchasing price, the hardware cost to use stereo camera is also much lower than a RADAR or LiDAR system.

[1]  Jianmin Duan,et al.  On-road vehicles detection method based on image entropy , 2016, 2016 2nd International Conference on Control, Automation and Robotics (ICCAR).

[2]  Amaury Nègre,et al.  A Visibility-Based Approach for Occupancy Grid Computation in Disparity Space , 2012, IEEE Transactions on Intelligent Transportation Systems.

[3]  A. Ali,et al.  Distance estimation and vehicle position detection based on monocular camera , 2016, 2016 Al-Sadeq International Conference on Multidisciplinary in IT and Communication Science and Applications (AIC-MITCSA).

[4]  A. Jazayeri,et al.  Vehicle Detection and Tracking in Car Video Based on Motion Model , 2011, IEEE Transactions on Intelligent Transportation Systems.

[5]  Tae-Young Lee,et al.  On-road vehicle detection based on appearance features for autonomous vehicles , 2015, 2015 15th International Conference on Control, Automation and Systems (ICCAS).

[6]  Ke Chen,et al.  Car type recognition with Deep Neural Networks , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[7]  Thomas Greiner,et al.  Matching cost computation algorithm and high speed FPGA architecture for high quality real-time Semi Global Matching stereo vision for road scenes , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[8]  Heiko Hirschmüller,et al.  Evaluation of Cost Functions for Stereo Matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.