A geometry-driven car-following distance estimation algorithm robust to road slopes

Abstract Locating the surrounding vehicles is an important environment perception task for autonomous vehicles and advanced driver assistance systems. This task is usually explored based on the sensors’ pre-calibration (e.g. height or pitch angle), but can be challenging when the calibration fails (e.g. on the sloping and uneven roads). In this work, we propose a calibrated feature-point based (CFPB) method to estimate the car-following distance adaptive to rough roads, using a single camera. Instead of using the pre-calibrated parameters, CFPB method is based on the surrounding vehicles’ feature points. It benefits from the fixed coordinate relations among these points, which enables the algorithm to be adaptive to rough roads. These fixed coordinate relations can be calibrated during driving. Namely, after a few seconds of observation to a surrounding vehicle, the CFPB method can start working for more accurate estimation. Furthermore, the proposed algorithm takes the perspective-n-point method as the framework. YOLO V3 and scale-invariant feature transform are applied as the vehicle detector and feature point extractor. The feature point calibration is dynamically updated and the results are smoothened by a Kalman filter. The camera is chosen because of the good performance on objects detection and feature extraction. The proposed algorithm is evaluated on a real-world road with dynamic traffic flow. Mobileye, a widely used car-following distance estimator on AV, is installed during the tests as the benchmark. The results indicate that the proposed method achieves decimeter-level accuracy and outperforms the Mobileye system in cases where the road slope changes significantly.

[1]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[2]  Amnon Shashua,et al.  A Computer Vision System on a Chip: a case study from the automotive domain , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[3]  Amnon Shashua,et al.  Vision-based ACC with a single camera: bounds on range and range rate accuracy , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[4]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[5]  Christos Katrakazas,et al.  Real-time motion planning methods for autonomous on-road driving: State-of-the-art and future research directions , 2015 .

[6]  Maya Dawood,et al.  Virtual 3D city model as a priori information source for vehicle localization system , 2016 .

[7]  Said M. Easa,et al.  Proposed collision warning system for right-turning vehicles at two-way stop-controlled rural intersections , 2014 .

[8]  J. Laneurit,et al.  Multisensorial data fusion for global vehicle and obstacles absolute positioning , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[9]  Kun Jiang,et al.  Intelligent and connected vehicles: Current status and future perspectives , 2018, Science China Technological Sciences.

[10]  Mohan M. Trivedi,et al.  Looking at Vehicles on the Road: A Survey of Vision-Based Vehicle Detection, Tracking, and Behavior Analysis , 2013, IEEE Transactions on Intelligent Transportation Systems.

[11]  Raymond J. Kiefer,et al.  Development of a Camera-Based Forward Collision Alert System , 2011 .

[12]  Ngai-Man Cheung,et al.  Image-based vehicle analysis using deep neural network: A systematic study , 2016, 2016 IEEE International Conference on Digital Signal Processing (DSP).

[13]  Sei-Wang Chen,et al.  A Novel Distance Estimation Method Leading a Forward Collision Avoidance Assist System for Vehicles on Highways , 2017, IEEE Transactions on Intelligent Transportation Systems.

[14]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Azim Eskandarian,et al.  Research advances in intelligent collision avoidance and adaptive cruise control , 2003, IEEE Trans. Intell. Transp. Syst..

[16]  Yinhai Wang,et al.  A Cost-Effective Framework for Automated Vehicle-Pedestrian Near-Miss Detection Through Onboard Monocular Vision , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[17]  Sun-Young Hwang,et al.  Robust Range Estimation with a Monocular Camera for Vision-Based Forward Collision Warning System , 2014, TheScientificWorldJournal.

[18]  Zhixia Li,et al.  Fine-tuning ADAS algorithm parameters for optimizing traffic safety and mobility in connected vehicle environment. , 2017, Transportation research. Part C, Emerging technologies.

[19]  Gérard Lachapelle,et al.  Evaluation of GPS-based methods of relative positioning for automotive safety applications , 2012 .

[20]  Shiqi Li,et al.  A Robust O(n) Solution to the Perspective-n-Point Problem , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Zonghai Chen,et al.  Framework for estimating distance and dimension attributes of pedestrians in real-time environments using monocular camera , 2018, Neurocomputing.

[22]  Reinhard Klette,et al.  Robust Vehicle Detection and Distance Estimation Under Challenging Lighting Conditions , 2015, IEEE Transactions on Intelligent Transportation Systems.

[23]  Tom Brijs,et al.  International benchmarking of road safety: state of the art , 2013 .

[24]  Mykel J. Kochenderfer,et al.  The value of inferring the internal state of traffic participants for autonomous freeway driving , 2017, 2017 American Control Conference (ACC).

[25]  Carlos Torre-Ferrero,et al.  Monovision-based vehicle detection, distance and relative speed measurement in urban traffic , 2014 .

[26]  Yi Zhang,et al.  A better understanding of long-range temporal dependence of traffic flow time series , 2018 .

[27]  Wenfeng Wang,et al.  A rough vehicle distance measurement method using monocular vision and license plate , 2015, 2015 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER).

[28]  Jonas Fredriksson,et al.  Lane Change Maneuvers for Automated Vehicles , 2017, IEEE Transactions on Intelligent Transportation Systems.

[29]  Edward Jones,et al.  Distance determination for an automobile environment using Inverse Perspective Mapping in OpenCV , 2010 .

[30]  Sanjiv Singh,et al.  The DARPA Urban Challenge: Autonomous Vehicles in City Traffic, George Air Force Base, Victorville, California, USA , 2009, The DARPA Urban Challenge.

[31]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[32]  Paulo Vinicius Koerich Borges,et al.  Practical Infrared Visual Odometry , 2016, IEEE Transactions on Intelligent Transportation Systems.