Neural network vehicle models for high-performance automated driving

A neural network improved performance over a simple model when implemented in feedforward-feedback control on an experimental vehicle. Automated vehicles navigate through their environment by first planning and subsequently following a safe trajectory. To prove safer than human beings, they must ultimately perform these tasks as well or better than human drivers across a broad range of conditions and in critical situations. We show that a feedforward-feedback control structure incorporating a simple physics-based model can be used to track a path up to the friction limits of the vehicle with performance comparable with a champion amateur race car driver. The key is having the appropriate model. Although physics-based models are useful in their transparency and intuition, they require explicit characterization around a single operating point and fail to make use of the wealth of vehicle data generated by autonomous vehicles. To circumvent these limitations, we propose a neural network structure using a sequence of past states and inputs motivated by the physical model. The neural network achieved better performance than the physical model when implemented in the same feedforward-feedback control architecture on an experimental vehicle. More notably, when trained on a combination of data from dry roads and snow, the model was able to make appropriate predictions for the road surface on which the vehicle was traveling without the need for explicit road friction estimation. These findings suggest that the network structure merits further investigation as the basis for model-based control of automated vehicles over their full operating range.

[1]  Ross A. Knepper,et al.  DeepMPC: Learning Deep Latent Features for Model Predictive Control , 2015, Robotics: Science and Systems.

[2]  M. Gerdts,et al.  Generating locally optimal trajectories for an automatically driven car , 2009 .

[3]  Dirk Langer,et al.  Up to the limits: Autonomous Audi TTS , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[4]  Francesco Borrelli,et al.  Predictive Control of Autonomous Ground Vehicles With Obstacle Avoidance on Slippery Roads , 2010 .

[5]  Sebastian Thrun,et al.  Path Planning for Autonomous Vehicles in Unknown Semi-structured Environments , 2010, Int. J. Robotics Res..

[6]  J. Christian Gerdes,et al.  Autonomous Vehicle Control at the Limits of Handling , 2012 .

[7]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[8]  Claire J. Tomlin,et al.  Learning quadrotor dynamics using neural network for flight control , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[9]  Marios M. Polycarpou,et al.  High-order neural network structures for identification of dynamical systems , 1995, IEEE Trans. Neural Networks.

[10]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[11]  Pieter Abbeel,et al.  Deep learning helicopter dynamics models , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[12]  James M. Rehg,et al.  Information Theoretic MPC Using Neural Network Dynamics , 2016 .

[13]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008, J. Field Robotics.

[14]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[15]  A. Fahim,et al.  Neural networks representation of a vehicle model: 'Neuro–Vehicle (NV)' , 2014 .

[16]  Dean A. Pomerleau,et al.  Knowledge-Based Training of Artificial Neural Networks for Autonomous Robot Driving , 1993 .

[17]  Moritz Diehl,et al.  CasADi: a software framework for nonlinear optimization and optimal control , 2018, Mathematical Programming Computation.

[18]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[19]  Dot Hs,et al.  National Motor Vehicle Crash Causation Survey , 2008 .

[20]  Laura Ryan Ray,et al.  Nonlinear state and tire force estimation for advanced vehicle control , 1995, IEEE Trans. Control. Syst. Technol..

[21]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[22]  Rajesh Rajamani,et al.  GPS-based real-time identification of tire-road friction coefficient , 2002, IEEE Trans. Control. Syst. Technol..

[23]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[24]  J. Christian Gerdes,et al.  Design of a feedback-feedforward steering controller for accurate path tracking and stability at the limits of handling , 2015 .

[25]  F. Takens Detecting strange attractors in turbulence , 1981 .

[26]  Richard D. Braatz,et al.  On the "Identification and control of dynamical systems using neural networks" , 1997, IEEE Trans. Neural Networks.

[27]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[28]  Sebastian Thrun,et al.  Towards fully autonomous driving: Systems and algorithms , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[29]  David J. Cole,et al.  Modelling nonlinear vehicle dynamics with neural networks , 2010 .

[30]  Hermann Winner,et al.  Autonomous Driving: Technical, Legal and Social Aspects , 2016 .

[31]  Matt C. Best Identifying tyre models directly from vehicle test data using an extended Kalman filter , 2010 .

[32]  J. Christian Gerdes,et al.  Insights into vehicle trajectories at the handling limits: analysing open data from race car drivers , 2017 .

[33]  Francesco Borrelli,et al.  Predictive Active Steering Control for Autonomous Vehicle Systems , 2007, IEEE Transactions on Control Systems Technology.

[34]  Emilio Frazzoli,et al.  On steady-state cornering equilibria for wheeled vehicles with drift , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[35]  J. Christian Gerdes,et al.  Path-tracking for autonomous vehicles at the limit of friction , 2017, 2017 American Control Conference (ACC).

[36]  Jonathan P. How,et al.  Reinforcement learning with multi-fidelity simulators , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[37]  C.J. Tomlin,et al.  Autonomous Automobile Trajectory Tracking for Off-Road Driving: Controller Design, Experimental Validation and Racing , 2007, 2007 American Control Conference.

[38]  Manfred Morari,et al.  Optimization‐based autonomous racing of 1:43 scale RC cars , 2015, ArXiv.