Automatic Detection and Classification of Road, Car, and Pedestrian Using Binocular Cameras in Traffic Scenes with a Common Framework

In order to solve the problems of traffic object detection, fuzzification, and simplification in real traffic environment, an automatic detection and classification algorithm for roads, vehicles, and pedestrians with multiple traffic objects under the same framework is proposed. We construct the final V view through a considerate U-V view method, which determines the location of the horizon and the initial contour of the road. Road detection results are obtained through error label reclassification, omitting point reassignment, and so an. We propose a peripheral envelope algorithm to determine sources of vehicles and pedestrians on the road. The initial segmentation results are determined by the regional growth of the source point through the minimum neighbor similarity algorithm. Vehicle detection results on the road are confirmed by combining disparity and color energy minimum algorithms with the object window aspect ratio threshold method. A method of multifeature fusion is presented to obtain the pedestrian target area, and the pedestrian detection results on the road are accurately segmented by combining the disparity neighbor similarity and the minimum energy algorithm. The algorithm is tested in three datasets of Enpeda, KITTI, and Daimler; then, the corresponding results prove the efficiency and accuracy of the proposed approach. Meanwhile, the real-time analysis of the algorithm is performed, and the average time efficiency is 13 pfs, which can realize the real-time performance of the detection process.

[1]  Adrian Burlacu,et al.  Obstacle detection in stereo sequences using multiple representations of the disparity map , 2016, 2016 20th International Conference on System Theory, Control and Computing (ICSTCC).

[2]  Dominique Gruyer,et al.  Weighted V-disparity approach for obstacles localization in highway environments , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[3]  Z. Hu,et al.  U-V-disparity: an efficient algorithm for stereovision based scene analysis , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[4]  Yongfeng Ju,et al.  Online Road Detection under a Shadowy Traffic Image Using a Learning-Based Illumination-Independent Image , 2018, Symmetry.

[5]  Ho Gi Jung,et al.  Dense Stereo-Based Robust Vertical Road Profile Estimation Using Hough Transform and Dynamic Programming , 2015, IEEE Transactions on Intelligent Transportation Systems.

[6]  Jian Yang,et al.  When Dijkstra Meets Vanishing Point: A Stereo Vision Approach for Road Detection , 2018, IEEE Transactions on Image Processing.

[7]  Long Chen,et al.  A cascaded framework for robust traversable region estimation using stereo vision , 2017, 2017 Chinese Automation Congress (CAC).

[8]  T. Vaudrey,et al.  Differences between stereo and motion behaviour on synthetic and real-world stereo sequences , 2008, 2008 23rd International Conference Image and Vision Computing New Zealand.

[9]  Jannik Fritsch,et al.  A new performance measure and evaluation benchmark for road detection algorithms , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[10]  Fouzi Harrou,et al.  Unsupervised obstacle detection in driving environments using deep-learning-based stereovision , 2018, Robotics Auton. Syst..

[11]  Hongdong Li,et al.  Semisupervised and Weakly Supervised Road Detection Based on Generative Adversarial Networks , 2018, IEEE Signal Processing Letters.

[12]  Kwanghoon Sohn,et al.  Automatic illumination invariant road detection with stereo vision , 2012, 2012 7th IEEE Conference on Industrial Electronics and Applications (ICIEA).

[13]  Erik Blasch,et al.  Clustered Object Detection in Aerial Images , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[14]  Hui Kong,et al.  Curb Detection for Road and Sidewalk Detection , 2018, IEEE Transactions on Vehicular Technology.

[15]  Jean-Philippe Tarel,et al.  Real time obstacle detection in stereovision on non flat road geometry through "v-disparity" representation , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[16]  Dariu Gavrila,et al.  A new benchmark for stereo-based pedestrian detection , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[17]  Arthur Daniel Costea,et al.  Fast Boosting Based Detection Using Scale Invariant Multimodal Multiresolution Filtered Features , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Arthur Daniel Costea,et al.  Traffic scene segmentation based on boosting over multimodal low, intermediate and high order multi-range channel features , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[19]  Kwanghoon Sohn,et al.  Real-time rear obstacle detection using reliable disparity for driver assistance , 2016, Expert Syst. Appl..

[20]  Seiichi Mita,et al.  Drivable Road Boundary Detection for Intelligent Vehicles based on Stereovision with Plane-induced Homography , 2013 .

[21]  Haibin Ling,et al.  Multi-Level Contextual RNNs With Attention Model for Scene Labeling , 2016, IEEE Transactions on Intelligent Transportation Systems.

[22]  Vincent Frémont,et al.  Fast road detection from color images , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[23]  Lin Jing-lianga Pedestrian Fast Detection Based on Histograms of Oriented Gradient , 2010 .

[24]  N. Hautiere,et al.  Road Segmentation Supervised by an Extended V-Disparity Algorithm for Autonomous Navigation , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[25]  Myung Jin Chung,et al.  Stereo-vision based free space and obstacle detection with structural and traversability analysis using probabilistic volume polar grid map , 2011, 2011 IEEE 5th International Conference on Robotics, Automation and Mechatronics (RAM).

[26]  Se-Young Oh,et al.  Vision-based fusion of robust lane tracking and forward vehicle detection in a real driving environment , 2012, International Journal of Automotive Technology.

[27]  Sergiu Nedevschi,et al.  Processing Dense Stereo Data Using Elevation Maps: Road Surface, Traffic Isle, and Obstacle Detection , 2010, IEEE Transactions on Vehicular Technology.

[28]  Jian Yang,et al.  Vanishing Point Constrained Lane Detection With a Stereo Camera , 2018, IEEE Transactions on Intelligent Transportation Systems.

[29]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Bin Dai,et al.  Likelihood-Field-Model-Based Dynamic Vehicle Detection and Tracking for Self-Driving , 2016, IEEE Transactions on Intelligent Transportation Systems.

[31]  Danilo Alves de Lima,et al.  A 2D/3D Vision Based Approach Applied to Road Detection in Urban Environments , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[32]  Genshe Chen,et al.  Multitask assessment of roads and vehicles network (MARVN) , 2018, Defense + Security.

[33]  Thambipillai Srikanthan,et al.  Nonparametric Technique Based High-Speed Road Surface Detection , 2015, IEEE Transactions on Intelligent Transportation Systems.

[34]  Vincent Frémont,et al.  Multiple obstacle detection and tracking using stereo vision: Application and analysis , 2014, 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV).