Two-timescale Mechanism-and-Data-Driven Control for Aggressive Driving of Autonomous Cars

The control for aggressive driving of autonomous cars is challenging due to the presence of significant tyre slip. Data-driven and mechanism-based methods for the modeling and control of autonomous cars under aggressive driving conditions are limited in data efficiency and adaptability respectively. This paper is an attempt toward the fusion of the two classes of methods. By means of a modular design that is consisted of mechanism-based and data-driven components, and aware of the two-timescale phenomenon in the car model, our approach effectively improves over previous methods in terms of data efficiency, ability of transfer and final performance. The hybrid mechanism-and-data-driven approach is verified on TORCS (The Open Racing Car Simulator). Experiment results demonstrate the benefit of our approach over purely mechanism-based and purely data-driven methods.

[1]  Christos Dimitrakakis,et al.  TORCS, The Open Racing Car Simulator , 2005 .

[2]  Mehrdad Dianati,et al.  Trajectory planning and tracking for autonomous overtaking: State-of-the-art and future prospects , 2018, Annu. Rev. Control..

[3]  Alexander Liniger,et al.  Cautious NMPC with Gaussian Process Dynamics for Autonomous Miniature Race Cars , 2017, 2018 European Control Conference (ECC).

[4]  Mark Ryan,et al.  The Future of Transportation: Ethical, Legal, Social and Economic Impacts of Self-driving Vehicles in the Year 2025 , 2019, Science and Engineering Ethics.

[5]  J. Lambert.  Numerical Methods for Ordinary Differential Systems: The Initial Value Problem , 1991 .

[6]  Christoph Stiller,et al.  Decision making for autonomous driving considering interaction and uncertain prediction of surrounding vehicles , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[7]  Emilio Frazzoli,et al.  Anytime computation of time-optimal off-road vehicle maneuvers using the RRT* , 2011, IEEE Conference on Decision and Control and European Control Conference.

[8]  Frederick R. Forst,et al.  On robust estimation of the location parameter , 1980 .

[9]  Magnus Egerstedt,et al.  Autonomous driving in urban environments: approaches, lessons and challenges , 2010, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[10]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[11]  Sergey Levine,et al.  Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor , 2018, ICML.

[12]  Francesco Borrelli,et al.  Learning How to Autonomously Race a Car: A Predictive Control Approach , 2019, IEEE Transactions on Control Systems Technology.

[13]  Victor Talpaert,et al.  Exploring applications of deep reinforcement learning for real-world autonomous driving systems , 2019, VISIGRAPP.

[14]  Victor M. Zavala,et al.  Large-scale nonlinear programming using IPOPT: An integrating framework for enterprise-wide dynamic optimization , 2009, Comput. Chem. Eng..

[15]  Hans B. Pacejka,et al.  Magic Formula Tyre Model with Transient Properties , 1997 .