Coupled Longitudinal and Lateral Control of a Vehicle using Deep Learning

This paper explores the capability of deep neural networks to capture key characteristics of vehicle dynamics, and their ability to perform coupled longitudinal and lateral control of a vehicle. To this extent, two different artificial neural networks are trained to compute vehicle controls corresponding to a reference trajectory, using a dataset based on high-fidelity simulations of vehicle dynamics. In this study, control inputs are chosen as the steering angle of the front wheels, and the applied torque on each wheel. The performance of both models, namely a Multi-Layer Perceptron (MLP) and a Convolutional Neural Network (CNN), is evaluated based on their ability to drive the vehicle on a challenging test track, shifting between long straight lines and tight curves. A comparison to conventional decoupled controllers on the same track is also provided.

[1]  Pieter Abbeel,et al.  Deep learning helicopter dynamics models , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Ali Ghaffari,et al.  A historical review on lateral and longitudinal control of autonomous vehicle motions , 2010, 2010 International Conference on Mechanical and Electrical Technology.

[3]  J. Christian Gerdes,et al.  Simultaneous stabilization and tracking of basic automobile drifting trajectories , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[4]  Hans B. Pacejka,et al.  Tire and Vehicle Dynamics , 1982 .

[5]  Huei Peng,et al.  Synthesis of safe controller via supervised learning for truck lateral control , 2017, ArXiv.

[6]  Francesco Borrelli,et al.  Predictive Active Steering Control for Autonomous Vehicle Systems , 2007, IEEE Transactions on Control Systems Technology.

[7]  Yunde Jia,et al.  Vehicle Type Classification Using a Semisupervised Convolutional Neural Network , 2015, IEEE Transactions on Intelligent Transportation Systems.

[8]  R. C. Coulter,et al.  Implementation of the Pure Pursuit Path Tracking Algorithm , 1992 .

[9]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[10]  J. Christian Gerdes,et al.  Autonomous Vehicle Control at the Limits of Handling , 2012 .

[11]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Se-Young Oh,et al.  A new reinforcement learning vehicle control architecture for vision-based road following , 2000, IEEE Trans. Veh. Technol..

[13]  Yang Li,et al.  Adaptive Neural Network Control of AUVs With Control Input Nonlinearities Using Reinforcement Learning , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[14]  Davide Castelvecchi,et al.  Can we open the black box of AI? , 2016, Nature.

[15]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[16]  Brigitte d'Andréa-Novel,et al.  Guaranteeing Consistency in a Motion Planning and Control Architecture Using a Kinematic Bicycle Model , 2018, 2018 Annual American Control Conference (ACC).

[17]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge: Research Articles , 2006 .

[18]  L. Personnaz,et al.  Modeling and control of mobile robots and intelligent vehicles by neural networks , 1994, Proceedings of the Intelligent Vehicles '94 Symposium.

[19]  Rajesh Rajamani,et al.  Vehicle dynamics and control , 2005 .

[20]  James M. Rehg,et al.  Aggressive Deep Driving: Model Predictive Control with a CNN Cost Model , 2017, ArXiv.

[21]  Xin Zhang,et al.  End to End Learning for Self-Driving Cars , 2016, ArXiv.