Deep Truck : A deep neural network model for longitudinal dynamics of heavy duty trucks

This article demonstrates the use of deep neural networks (NN) and deep reinforcement learning (deep-RL) for modeling and control of longitudinal heavy duty truck dynamics. Instead of explicit use of analytical model derived information or parameters about the truck, the deep NN model is fitted to data using a brief set of historical data collected from an arbitrary driving cycle. The deep model is used in this article to design a cruise controller for the truck using model-free deep-RL. The deep model and the control loop performances are demonstrated both using state-of-the-art commercial simulation software, and using a real-physical truck. Model and control performances are compared to classical physics-based modeling and control design approaches. The deep NN model is shown to capture latent nonlinear state dynamics and the deep-RL cruise controller is shown to achieve comparable results to a carefully designed and calibrated controller.

[1]  Steven Lake Waslander,et al.  Deep Learning a Quadrotor Dynamic Model for Multi-Step Prediction , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Pieter Abbeel,et al.  Deep learning helicopter dynamics models , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Vicente Milanés Montero,et al.  Cooperative Adaptive Cruise Control in Real Traffic Situations , 2014, IEEE Transactions on Intelligent Transportation Systems.

[4]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[5]  Ben Tse,et al.  Autonomous Inverted Helicopter Flight via Reinforcement Learning , 2004, ISER.

[6]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[7]  J. Karl Hedrick,et al.  Heavy-duty vehicle modelling and longitudinal control , 2005 .

[8]  Claire J. Tomlin,et al.  Learning quadrotor dynamics using neural network for flight control , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[9]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[10]  Kurt Hornik,et al.  Approximation capabilities of multilayer feedforward networks , 1991, Neural Networks.

[11]  Luke Ng,et al.  Reinforcement Learning of Dynamic Collaborative Driving , 2008 .

[12]  Rajesh Rajamani,et al.  Vehicle dynamics and control , 2005 .

[13]  Michael W. Sayers,et al.  Modeling assumptions for realistic multibody simulations of the yaw and roll behavior of heavy trucks , 1996 .