Learn to Make Decision with Small Data for Autonomous Driving: Deep Gaussian Process and Feedback Control

Autonomous driving is a popular and promising field in artificial intelligence. Rapid decision of the next action according to the latest few actions and status, such as acceleration, brake, and steering angle, is a major concern for autonomous driving. There are some learning methods, such as reinforcement learning which automatically learns the decision. However, it usually requires large volume of samples. In this paper, to reduce the sample size, we exploit the deep Gaussian process, where a regression model is trained on small sample datasets and captures the most significant features correctly. Besides, to realize the real-time and close-loop control, we combine the feedback control into the process. Experimental results on the Torcs simulation engine illustrate smooth driving on virtual road which can be achieved. Compared with the amount of training data in deep reinforcement learning, our method uses only 0.34% of its size and obtains similar simulation results. It may be useful for real road tests in the future.

[1]  Yi Zhang,et al.  IVS 09: Future Research in Vehicle Vision Systems , 2009, IEEE Intelligent Systems.

[2]  Carl E. Rasmussen,et al.  A Unifying View of Sparse Approximate Gaussian Process Regression , 2005, J. Mach. Learn. Res..

[3]  Hua Han,et al.  Can Virtual Samples Solve Small Sample Size Problem of KISSME in Pedestrian Re-Identification of Smart Transportation? , 2020, IEEE Transactions on Intelligent Transportation Systems.

[4]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[5]  Daniele Loiacono,et al.  TrackGen: An interactive track generator for TORCS and Speed-Dreams , 2015, Appl. Soft Comput..

[6]  Nanning Zheng,et al.  IVS 05: New Developments and Research Trends for Intelligent Vehicles , 2005, IEEE Intell. Syst..

[7]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[8]  Emilio Frazzoli,et al.  A Survey of Motion Planning and Control Techniques for Self-Driving Urban Vehicles , 2016, IEEE Transactions on Intelligent Vehicles.

[9]  Xuan Li,et al.  Training and testing object detectors with virtual images , 2017, IEEE/CAA Journal of Automatica Sinica.

[10]  Carl E. Rasmussen,et al.  Gaussian Processes for Data-Efficient Learning in Robotics and Control , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Scott R. Granter,et al.  AlphaGo, Deep Learning, and the Future of the Human Microscopist. , 2017, Archives of pathology & laboratory medicine.

[12]  Julius Ziegler,et al.  Making Bertha Drive—An Autonomous Journey on a Historic Route , 2014, IEEE Intelligent Transportation Systems Magazine.

[13]  Mohamed I. Mosaad,et al.  A comparative study of MPC and optimised PID control , 2015 .

[14]  Hong Yang,et al.  Artificial intelligence applications in the development of autonomous vehicles: a survey , 2020, IEEE/CAA Journal of Automatica Sinica.

[15]  David M. Blei,et al.  Variational Inference: A Review for Statisticians , 2016, ArXiv.

[16]  Jorge Nocedal,et al.  Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization , 1997, TOMS.

[17]  Hong Wang,et al.  Parallel planning: a new motion planning framework for autonomous driving , 2019, IEEE/CAA Journal of Automatica Sinica.