Humanlike Behavior Generation in Urban Environment Based on Learning-Based Potentials With a Low-Cost Lane Graph

It is crucial to understand the surrounding cars with respect to the road context and interact with them harmoniously for the success of autonomous cars used in the mixed urban traffic. In this paper, a vision-based approach is proposed to implement the humanlike autonomous driving function along a predefined lane-level route in the complex urban environment with daily traffic. At first, the surrounding cars are located in the lane level by a deep neural network based detector with a low-cost lane graph. Subsequently, a Bayesian network is employed to classify the detected cars into six categories based on their states of operation, i.e., leader car, parked car, tail-end car, exiting car, merging car, and other car. Finally, a hybrid potential map, consisting of a trajectory-induction potential and a risk-prevention potential, is constructed for each of the cars according to their categories, which will be combined to be used for generating an appropriate behavior. Particularly, both of the trajectory-induction potentials and the risk-prevention potentials are learned from naturalistic driving data of the same situations in the daily urban traffic to encode the human driving skills and experiences. Therefore, the behavior generated based on the proposed learning-based potentials is close to a humanlike performance, which is important to achieve harmony in the mixed traffic. Experimental results in various typical but challenging urban traffic scenes have substantiated the effectiveness of the proposed system.

[1]  Xiaoliang Ma,et al.  Behavior Measurement, Analysis, and Regime Classification in Car Following , 2007, IEEE Transactions on Intelligent Transportation Systems.

[2]  Jordan Navarro,et al.  Lateral control assistance in car driving: classification, review and future prospects , 2011 .

[3]  Pongsathorn Raksincharoensak,et al.  Motion Planning and Control of Autonomous Driving Intelligence System Based on Risk Potential Optimization Framework , 2016 .

[4]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[5]  Yoshiko Kojima,et al.  A Multimodal ADAS System for Unmarked Urban Scenarios Based on Road Context Understanding , 2015, IEEE Transactions on Intelligent Transportation Systems.

[6]  Kazuya Takeda,et al.  Modeling and adaptation of stochastic driver-behavior model with application to car following , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[7]  Marcus J. Huber,et al.  Behavior recognition architecture for surveillance applications , 2008, 2008 37th IEEE Applied Imagery Pattern Recognition Workshop.

[8]  J. P. Lewis Fast Normalized Cross-Correlation , 2010 .

[9]  Jin-Woo Lee,et al.  Human-like planning of swerve maneuvers for autonomous vehicles , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[10]  Sebastian Thrun,et al.  Junior: The Stanford entry in the Urban Challenge , 2008, J. Field Robotics.

[11]  Mykel J. Kochenderfer,et al.  Imitating driver behavior with generative adversarial networks , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[12]  Scott A. Bortoff,et al.  Path planning for UAVs , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[13]  Ulrich Kressel,et al.  Probabilistic trajectory prediction with Gaussian mixture models , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[14]  H. Hirschmüller Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information , 2005, CVPR.

[15]  Wolfgang Rosenstiel,et al.  Object-Oriented Bayesian Networks for Detection of Lane Change Maneuvers , 2012, IEEE Intelligent Transportation Systems Magazine.

[16]  Julius Ziegler,et al.  Trajectory planning for Bertha — A local, continuous method , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[17]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008, J. Field Robotics.

[18]  Yoshiko Kojima,et al.  Proposal for a new localisation method using tightly coupled integration based on a precise estimation of trajectory from GPS Doppler , 2012 .

[19]  O. Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[20]  Jitendra Malik,et al.  Automatic Symbolic Traffic Scene Analysis Using Belief Networks , 1994, AAAI.

[21]  Hongbin Zha,et al.  A real-time motion planner with trajectory optimization for autonomous vehicles , 2012, 2012 IEEE International Conference on Robotics and Automation.

[22]  K. Tanifuji,et al.  A Study of Driver Behavior Inference Model at Time of Lane Change using Bayesian Networks , 2006, 2006 IEEE International Conference on Industrial Technology.

[23]  Junichi Meguro,et al.  A Low-Cost Solution for Automatic Lane-Level Map Generation Using Conventional In-Car Sensors , 2016, IEEE Transactions on Intelligent Transportation Systems.

[24]  Alexander Barth,et al.  Estimating the Driving State of Oncoming Vehicles From a Moving Platform Using Stereo Vision , 2009, IEEE Transactions on Intelligent Transportation Systems.

[25]  Mehmet Celenk,et al.  Interactive risky behavior model for 3-car overtaking scenario using joint Bayesian network , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[26]  Weiwen Deng,et al.  Forward collision avoidance systems considering driver's driving behavior recognized by Gaussian Mixture Model , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[27]  Christoph Stiller,et al.  Map-based long term motion prediction for vehicles in traffic environments , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[28]  Kazuya Takeda,et al.  Driver identification using driving behavior signals , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..

[29]  Joel W. Burdick,et al.  Artificial potential functions for highway driving with collision avoidance , 2008, 2008 IEEE International Conference on Robotics and Automation.

[30]  Seung-Woo Seo,et al.  A learning-based framework for handling dilemmas in urban automated driving , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[31]  Andrew Y. Ng,et al.  End-to-End People Detection in Crowded Scenes , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Tomohiro Yamamura,et al.  Lane-Change Detection Using a Computational Driver Model , 2007, Hum. Factors.