Iterative Range and Road Parameters Estimation Using Monocular Camera on Highways

Lane Keeping Assistance and Adaptive Cruise Control in Advanced Driving Assistance Systems (ADAS) requires road parameters for better control of the vehicle. Therefore, in this paper we present the Iterative Least Squares with Optimization (ILSO) method based on a monocular front camera which estimates the horizontal, vertical parameters, lateral slope and the camera’s distances to the left/right line as road parameters and longitudinal range. The ILSO algorithm is smartly divided into two steps LS and optimization depending on their estimation capabilities. First of all, the horizontal and vertical parameters, lateral slope, and distances to the left and right lines are estimated by Least Squares (LS). Then, the longitudinal range is estimated by convex optimization. LS and convex optimization are executed in an alternating manner. ILSO is in advance prior to changes on roads and a simple technique due to its analytical solution which does not require complex geometric calculations and does not need a match between left and right lines. In a simulation environment, given the noisy road lines, ILSO outperforms covariance based and multilayer perceptron (MLP) based methods under different noise variances. In addition, ILSO provides plausible numerical results in both virtual and real road images.

[1]  Junqiang Xi,et al.  A Quaternion Unscented Kalman Filter for Road Grade Estimation , 2020, 2020 IEEE Intelligent Vehicles Symposium (IV).

[2]  Lu Su,et al.  Road Grade Estimation Using Crowd-Sourced Smartphone Data , 2020, 2020 19th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[3]  Trevor Darrell,et al.  BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning , 2018, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Bin Zou,et al.  LiDAR-Based Multi-Task Road Perception Network for Autonomous Vehicles , 2020, IEEE Access.

[5]  Engin Masazade,et al.  Vision‐based road slope estimation methods using road lines or local features from instant images , 2019, IET Intelligent Transport Systems.

[6]  Cyrill Stachniss,et al.  SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[7]  Aleksandr Mikov,et al.  Sensor Fusion For Land Vehicle Localization Using Inertial MEMS and Odometry , 2019, 2019 IEEE International Symposium on Inertial Sensors and Systems (INERTIAL).

[8]  Dan Levi,et al.  3D-LaneNet: End-to-End 3D Multiple Lane Detection , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[9]  Bin Yang,et al.  HDNET: Exploiting HD Maps for 3D Object Detection , 2018, CoRL.

[10]  Chang-il Kim,et al.  Vehicle Dynamics and Road Slope Estimation based on Cascade Extended Kalman Filter , 2018, 2018 International Conference on Information and Communication Technology Robotics (ICT-ROBOT).

[11]  Long Chen,et al.  Advances in Vision-Based Lane Detection: Algorithms, Integration, Assessment, and Perspectives on ACP-Based Parallel Vision , 2018, IEEE/CAA Journal of Automatica Sinica.

[12]  Naim Dahnoun,et al.  Road Surface 3D Reconstruction Based on Dense Subpixel Disparity Map Estimation , 2018, IEEE Transactions on Image Processing.

[13]  Zhaoyang Ai,et al.  A Cross Iteration Estimator with Base Vector for Estimation of Electric Mining Haul Truck's Mass and Road Grade , 2018, IEEE Transactions on Industrial Informatics.

[14]  Frank Gauterin,et al.  Road Grade Estimation With Vehicle-Based Inertial Measurement Unit and Orientation Filter , 2018, IEEE Sensors Journal.

[15]  Dihua Sun,et al.  Real-time road slope estimation based on adaptive extended Kalman filter algorithm with in-vehicle data , 2017, 2017 29th Chinese Control And Decision Conference (CCDC).

[16]  Jian Chen,et al.  Drivable Road Reconstruction for Intelligent Vehicles Based on Two-View Geometry , 2017, IEEE Transactions on Industrial Electronics.

[17]  N. Palella,et al.  Sensor fusion for land vehicle slope estimation , 2016, 2016 DGON Intertial Sensors and Systems (ISS).

[18]  Sebastian Ramos,et al.  The Cityscapes Dataset for Semantic Urban Scene Understanding , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Mehmet Celenk,et al.  Road-Geometry-Based Risk Estimation Model for Horizontal Curves , 2016, IEEE Transactions on Intelligent Transportation Systems.

[20]  Myoungho Sunwoo,et al.  Road Slope Aided Vehicle Position Estimation System Based on Sensor Fusion of GPS and Automotive Onboard Sensors , 2016, IEEE Transactions on Intelligent Transportation Systems.

[21]  Wang Haitao,et al.  A Camera Calibration Method for Obstacle Distance Measurement Based on Monocular Vision , 2014, 2014 Fourth International Conference on Communication Systems and Network Technologies.

[22]  Mehdi Boukallel,et al.  A case study on sensors and techniques for pedestrian inertial navigation , 2014, 2014 International Symposium on Inertial Sensors and Systems (ISISS).

[23]  Xiaobin Zhang,et al.  Real-Time Estimation of Vehicle Mass and Road Grade Based on Multi-Sensor Data Fusion , 2013, 2013 IEEE Vehicle Power and Propulsion Conference (VPPC).

[24]  Mohan M. Trivedi,et al.  A review of recent developments in vision-based vehicle detection , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[25]  Bo Li,et al.  A review on vision-based pedestrian detection in intelligent transportation systems , 2012, Proceedings of 2012 9th IEEE International Conference on Networking, Sensing and Control.

[26]  Saïd Mammar,et al.  3D estimation of road cartography using vehicle localization and observers , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[27]  Sebastien Glaser,et al.  A model driven 3D lane detection system using stereovision , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[28]  Xu Chen,et al.  Null-Space representation for view-invariant motion trajectory classification-recognition and indexing-retrieval , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[29]  David M. Bevly,et al.  Integrating INS Sensors With GPS Measurements for Continuous Estimation of Vehicle Sideslip, Roll, and Tire Cornering Stiffness , 2006, IEEE Transactions on Intelligent Transportation Systems.

[30]  Rama Chellappa,et al.  Principal components null space analysis for image and video classification , 2006, IEEE Transactions on Image Processing.

[31]  Richard M. Murray,et al.  Model-based estimation of off-highway road geometry using single-axis LADAR and inertial sensing , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[32]  Zehang Sun,et al.  On-road vehicle detection: a review , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  G. LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[34]  S. Nedevschi,et al.  3D lane detection system based on stereovision , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[35]  Didier Aubert,et al.  A single framework for vehicle roll, pitch, yaw estimation and obstacles detection by stereovision , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[36]  Romuald Aufrère,et al.  A model-driven approach for real-time road recognition , 2001, Machine Vision and Applications.

[37]  F. Chausse,et al.  A fast and robust vision based road following algorithm , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[38]  Romuald Aufrère,et al.  Recovering the 3D shape of a road by on-board monocular vision , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[39]  Ernst D. Dickmanns,et al.  Recursive 3-D Road and Relative Ego-State Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..