Learning Accurate, Comfortable and Human-like Driving

Autonomous vehicles are more likely to be accepted if they drive accurately, comfortably, but also similar to how human drivers would. This is especially true when autonomous and human-driven vehicles need to share the same road. The main research focus thus far, however, is still on improving driving accuracy only. This paper formalizes the three concerns with the aim of accurate, comfortable and human-like driving. Three contributions are made in this paper. First, numerical map data from HERE Technologies are employed for more accurate driving; a set of map features which are believed to be relevant to driving are engineered to navigate better. Second, the learning procedure is improved from a pointwise prediction to a sequence-based prediction and passengers' comfort measures are embedded into the learning algorithm. Finally, we take advantage of the advances in adversary learning to learn human-like driving; specifically, the standard L1 or L2 loss is augmented by an adversary loss which is based on a discriminator trained to distinguish between human driving and machine driving. Our model is trained and evaluated on the Drive360 dataset, which features 60 hours and 3000 km of real-world driving data. Extensive experiments show that our driving model is more accurate, more comfortable and behaves more like a human driver than previous methods. The resources of this work will be released on the project page.

[1]  Jr. G. Forney,et al.  The viterbi algorithm , 1973 .

[2]  Xin Zhang,et al.  End to End Learning for Self-Driving Cars , 2016, ArXiv.

[3]  Mayank Bansal,et al.  ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worst , 2018, Robotics: Science and Systems.

[4]  Luc Van Gool,et al.  Object Referring in Videos with Language and Human Gaze , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[5]  Michel Basset,et al.  Combined longitudinal and lateral control for automated vehicle guidance , 2014 .

[6]  David Janz,et al.  Learning to Drive in a Day , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[7]  Ashish Kapoor,et al.  AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles , 2017, FSR.

[8]  Yann LeCun,et al.  Off-Road Obstacle Avoidance through End-to-End Learning , 2005, NIPS.

[9]  Alexey Dosovitskiy,et al.  End-to-End Driving Via Conditional Imitation Learning , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Milan Simic,et al.  In the Passenger Seat: Investigating Ride Comfort Measures in Autonomous Cars , 2015, IEEE Intelligent Transportation Systems Magazine.

[11]  Wolfram Burgard,et al.  Learning driving styles for autonomous vehicles from demonstration , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Andrew V. Goldberg,et al.  Route Planning in Transportation Networks , 2015, Algorithm Engineering.

[13]  Zhaohui Wu,et al.  TripPlanner: Personalized Trip Planning Leveraging Heterogeneous Crowdsourced Digital Footprints , 2015, IEEE Transactions on Intelligent Transportation Systems.

[14]  Luc Van Gool,et al.  Failure Prediction for Autonomous Driving , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[15]  Germán Ros,et al.  CARLA: An Open Urban Driving Simulator , 2017, CoRL.

[16]  Christian S. Jensen,et al.  Toward personalized, context-aware routing , 2015, The VLDB Journal.

[17]  Bernard Ghanem,et al.  Driving Policy Transfer via Modularity and Abstraction , 2018, CoRL.

[18]  Ramesh C. Jain,et al.  GPSView: A scenic driving route planner , 2013, TOMCCAP.

[19]  Ira D. Jacobson,et al.  MODELS OF HUMAN COMFORT IN VEHICLE ENVIRONMENTS , 1980 .

[20]  Andreas Geiger,et al.  Conditional Affordance Learning for Driving in Urban Environments , 2018, CoRL.

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Alex Bewley,et al.  Learning to Drive from Simulation without Real World Labels , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[23]  Jay A. Farrell,et al.  High-precision lane-level road map building for vehicle navigation , 2010, IEEE/ION Position, Location and Navigation Symposium.

[24]  Ronald R. Mourant,et al.  Toward More Realistic Driving Behavior Models for Autonomous Vehicles in Driving Simulators , 2003 .

[25]  Amnon Shashua,et al.  Safe, Multi-Agent, Reinforcement Learning for Autonomous Driving , 2016, ArXiv.

[26]  Tao Mei,et al.  Design of a Control System for an Autonomous Vehicle Based on Adaptive-PID , 2012 .

[27]  Hairi Zamzuri,et al.  Modelling and Control Strategies in Path Tracking Control for Autonomous Ground Vehicles: A Review of State of the Art and Challenges , 2017, J. Intell. Robotic Syst..

[28]  Georg Maier,et al.  Generation of high precision digital maps using circular arc splines , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[29]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008, J. Field Robotics.

[30]  M J Griffin,et al.  Motion sickness in public road transport: the effect of driver, route and vehicle. , 1999, Ergonomics.

[31]  Etienne Perot,et al.  Deep Reinforcement Learning framework for Autonomous Driving , 2017, Autonomous Vehicles and Machines.

[32]  John H. L. Hansen,et al.  International Large-Scale Vehicle Corpora for Research on Driver Behavior on the Road , 2011, IEEE Transactions on Intelligent Transportation Systems.

[33]  Guangzhong Sun,et al.  Driving with knowledge from the physical world , 2011, KDD.

[34]  Ronald R. Mourant,et al.  A framework for modeling human-like driving behaviors for autonomous vehicles in driving simulators , 2001, AGENTS '01.

[35]  Yang Gao,et al.  End-to-End Learning of Driving Models from Large-Scale Video Datasets , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Jiming Chen,et al.  Join driving: A smart phone-based driving behavior evaluation system , 2013, 2013 IEEE Global Communications Conference (GLOBECOM).

[37]  Jianxiong Xiao,et al.  DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[38]  Cewu Lu,et al.  LiDAR-Video Driving Dataset: Learning Driving Policies Effectively , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[39]  Fabiano Fruett,et al.  Embedded system to evaluate the passenger comfort in public transportation based on dynamical vehicle behavior with user’s feedback , 2014 .

[40]  Li-Ta Hsu,et al.  Human-like motion planning model for driving in signalized intersections , 2017 .

[41]  Luc Van Gool,et al.  End-to-End Learning of Driving Models with Surround-View Cameras and Route Planners , 2018, ECCV.

[42]  Philip Koopman,et al.  Challenges in Autonomous Vehicle Testing and Validation , 2016 .

[43]  Florian Michahelles,et al.  Driving behavior analysis with smartphones: insights from a controlled field study , 2012, MUM.

[44]  Seiichi Mita,et al.  Bézier curve based path planning for autonomous vehicle in urban environment , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[45]  Gys Albertus Marthinus Meiring,et al.  A Review of Intelligent Driving Style Analysis Systems and Related Artificial Intelligence Algorithms , 2015, Sensors.

[46]  Matthias Althoff,et al.  Formalising Traffic Rules for Accountability of Autonomous Vehicles , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[47]  Chunxiao Liu,et al.  Learning to Steer by Mimicking Features from Heterogeneous Auxiliary Networks , 2018, AAAI.

[48]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[49]  Vladlen Koltun,et al.  On Offline Evaluation of Vision-based Driving Models , 2018, ECCV.

[50]  Narciso García,et al.  Event-Based Vision Meets Deep Learning on Steering Prediction for Self-Driving Cars , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.