Dynamic Probabilistic Drivability Maps for Lane Change and Merge Driver Assistance

In this paper, we present a novel probabilistic compact representation of the on-road environment, i.e., the dynamic probabilistic drivability map (DPDM), and demonstrate its utility for predictive lane change and merge (LCM) driver assistance during highway and urban driving. The DPDM is a flexible representation and readily accepts data from a variety of sensor modalities to represent the on-road environment as a spatially coded data structure, encapsulating spatial, dynamic, and legal information. Using the DPDM, we develop a general predictive system for LCMs. We formulate the LCM assistance system to solve for the minimum-cost solution to merge or change lanes, which is solved efficiently using dynamic programming over the DPDM. Based on the DPDM, the LCM system recommends the required acceleration and timing to safely merge or change lanes with minimum cost. System performance has been extensively validated using real-world on-road data, including urban driving, on-ramp merges, and both dense and free-flow highway conditions.

[1]  Sergiu Nedevschi,et al.  Processing Dense Stereo Data Using Elevation Maps: Road Surface, Traffic Isle, and Obstacle Detection , 2010, IEEE Transactions on Vehicular Technology.

[2]  Amaury Nègre,et al.  A Visibility-Based Approach for Occupancy Grid Computation in Disparity Space , 2012, IEEE Transactions on Intelligent Transportation Systems.

[3]  Sergiu Nedevschi,et al.  Modeling and Tracking the Driving Environment With a Particle-Based Occupancy Grid , 2011, IEEE Transactions on Intelligent Transportation Systems.

[4]  Mohan M. Trivedi,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS 1 Integrated Lane and Vehicle Detection, Localization, , 2022 .

[5]  Mohan M. Trivedi,et al.  On-road prediction of driver's intent with multimodal sensory cues , 2011, IEEE Pervasive Computing.

[6]  Kyongsu Yi,et al.  Development of lane change driver model for closed-loop simulation of the active safety system , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[7]  Mathias Perrollaz,et al.  Computing occupancy grids from multiple sensors using linear opinion pools , 2012, 2012 IEEE International Conference on Robotics and Automation.

[8]  Charles V. Stewart,et al.  A probabilistic representation of LiDAR range data for efficient 3D object detection , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[9]  Anne T McCartt,et al.  Types and characteristics of ramp-related motor vehicle crashes on urban interstate roadways in Northern Virginia. , 2004, Journal of safety research.

[10]  L. Breuer.  Introduction to Stochastic Processes , 2022, Statistical Methods for Climate Scientists.

[11]  Gerd Wanielik,et al.  Advanced occupancy grid techniques for lidar based object detection and tracking , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[12]  Véronique Berge-Cherfaoui,et al.  Credibilist occupancy grids for vehicle perception in dynamic environments , 2011, 2011 IEEE International Conference on Robotics and Automation.

[13]  Mohan M. Trivedi,et al.  Looking at Vehicles on the Road: A Survey of Vision-Based Vehicle Detection, Tracking, and Behavior Analysis , 2013, IEEE Transactions on Intelligent Transportation Systems.

[14]  Andrew M. Wallace,et al.  Efficient Resource Allocation for Attentive Automotive Vision Systems , 2012, IEEE Transactions on Intelligent Transportation Systems.

[15]  Mohan M. Trivedi,et al.  Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation , 2006, IEEE Transactions on Intelligent Transportation Systems.

[16]  Olivier Aycard,et al.  Detection, classification and tracking of moving objects in a 3D environment , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[17]  Xiaodong Wang,et al.  Monocular based lane-change on scaled-down autonomous vehicles , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[18]  Christian Laugier,et al.  Bayesian Occupancy Filtering for Multitarget Tracking: An Automotive Application , 2006, Int. J. Robotics Res..

[19]  Hermann Winner,et al.  A maneuver-based lane change assistance system , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[20]  Hermann Winner,et al.  Development of a general criticality criterion for the risk estimation of driving situations and its application to a maneuver-based lane change assistance system , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[21]  Masafumi Hashimoto,et al.  Multilayer lidar-based pedestrian tracking in urban environments , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[22]  Hongbin Zha,et al.  Learning lane change trajectories from on-road driving data , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[23]  Daisuke Inoue,et al.  Amplitude-Modulated Laser Radar for Range and Speed Measurement in Car Applications , 2012, IEEE Transactions on Intelligent Transportation Systems.

[24]  Erhan Çinlar,et al.  Introduction to stochastic processes , 1974 .

[25]  Mohan M. Trivedi,et al.  Active learning for on-road vehicle detection: a comparative study , 2014, Machine Vision and Applications.

[26]  Véronique Berge-Cherfaoui,et al.  Drivable space characterization using automotive lidar and georeferenced map information , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[27]  Darius Burschka,et al.  Efficient occupancy grid computation on the GPU with lidar and radar for road boundary detection , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[28]  Robin Schubert,et al.  Evaluating the Utility of Driving: Toward Automated Decision Making Under Uncertainty , 2012, IEEE Transactions on Intelligent Transportation Systems.

[29]  Gerd Wanielik,et al.  Empirical evaluation of a unified Bayesian object and situation assessment approach for lane change assistance , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[30]  Ayoub Al-Hamadi,et al.  Stereo-Camera-Based Urban Environment Perception Using Occupancy Grid and Object Tracking , 2012, IEEE Transactions on Intelligent Transportation Systems.

[31]  John B. Moore,et al.  Hidden Markov Models: Estimation and Control , 1994 .

[32]  Dan C. Marinescu,et al.  On-ramp traffic merging using cooperative intelligent vehicles: A slot-based approach , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[33]  Eduardo Ros Vidal,et al.  Lane-Change Decision Aid System Based on Motion-Driven Vehicle Tracking , 2008, IEEE Transactions on Vehicular Technology.

[34]  Gerd Wanielik,et al.  Situation Assessment for Automatic Lane-Change Maneuvers , 2010, IEEE Transactions on Intelligent Transportation Systems.

[35]  Li-Chen Fu,et al.  Integrating Appearance and Edge Features for Sedan Vehicle Detection in the Blind-Spot Area , 2012, IEEE Transactions on Intelligent Transportation Systems.

[36]  Kristian Kroschel,et al.  A Multilevel Collision Mitigation Approach—Its Situation Assessment, Decision Making, and Performance Tradeoffs , 2006, IEEE Transactions on Intelligent Transportation Systems.

[37]  P. Gács,et al.  Algorithms , 1992 .

[38]  Li Liu,et al.  Dynamic Modeling of Driver Control Strategy of Lane-Change Behavior and Trajectory Planning for Collision Prediction , 2012, IEEE Transactions on Intelligent Transportation Systems.

[39]  Vicente Milanés Montero,et al.  Automated On-Ramp Merging System for Congested Traffic Situations , 2011, IEEE Transactions on Intelligent Transportation Systems.

[40]  Uwe Franke,et al.  6D-Vision: Fusion of Stereo and Motion for Robust Environment Perception , 2005, DAGM-Symposium.

[41]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.