Gaussian Process-based Model Predictive Controller for Connected Vehicles with Uncertain Wireless Channel

In this paper, we present a data-driven Model Predictive Controller that leverages a Gaussian Process to generate optimal motion policies for connected autonomous vehicles in regions with uncertainty in the wireless channel. The communication channel between the vehicles of a platoon can be easily influenced by numerous factors, e.g. the surrounding environment, and the relative states of the connected vehicles, etc. In addition, the trajectories of the vehicles depend significantly on the motion policies of the preceding vehicle shared via the wireless channel and any delay can impact the safety and optimality of its performance. In the presented algorithm, Gaussian Process learns the wireless channel model and is involved in the Model Predictive Controller to generate a control sequence that not only minimizes the conventional motion costs, but also minimizes the estimated delay of the wireless channel in the future. This results in a farsighted controller that maximizes the amount of transferred information beyond the controller's time horizon, which in turn guarantees the safety and optimality of the generated trajectories in the future. To decrease computational cost, the algorithm finds the reachable set from the current state and focuses on that region to minimize the size of the kernel matrix and related calculations. In addition, we present an efficient recursive approach to decrease the time complexity of developing the data-driven model and involving it in Model Predictive Control. We demonstrate the capability of the presented algorithm in a simulated scenario.

[1]  Sergey Levine,et al.  Collective robot reinforcement learning with distributed asynchronous guided policy search , 2016, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  Mate Boban,et al.  Vehicular Communications: Survey and Challenges of Channel and Propagation Models , 2015, IEEE Vehicular Technology Magazine.

[3]  Jonathan P. How,et al.  Efficient reinforcement learning for robots using informative simulated priors , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Francesco Borrelli,et al.  Safe Adaptive Cruise Control with Road Grade Preview and V2V Communication , 2018, ArXiv.

[5]  Luigi del Re,et al.  A model predictive Cooperative Adaptive Cruise Control approach , 2013, 2013 American Control Conference.

[6]  Alberto Bemporad,et al.  Predictive Control for Linear and Hybrid Systems , 2017 .

[7]  Andrea Goldsmith,et al.  Effects of communication delay on string stability in vehicle platoons , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[8]  Pravin Varaiya,et al.  Smart cars on smart roads: problems of control , 1991, IEEE Trans. Autom. Control..

[9]  Antonio Saverio Valente,et al.  Adaptive multi-agents synchronization for collaborative driving of autonomous vehicles with multiple communication delays , 2018 .

[10]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[11]  E. Juárez Ruiz,et al.  Relationship between the Inverses of a Matrix and a Submatrix , 2016, Computación y Sistemas.

[12]  Carl E. Rasmussen,et al.  PILCO: A Model-Based and Data-Efficient Approach to Policy Search , 2011, ICML.

[13]  Marc Peter Deisenroth,et al.  Data-Efficient Reinforcement Learning with Probabilistic Model Predictive Control , 2017, AISTATS.

[14]  Jeff G. Schneider,et al.  Exploiting Model Uncertainty Estimates for Safe Dynamic Control Learning , 1996, NIPS.

[15]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[16]  Juš Kocijan,et al.  Modelling and Control of Dynamic Systems Using Gaussian Process Models , 2015 .

[17]  Hassan Jafarzadeh,et al.  DMPC: A Data-and Model-Driven Approach to Predictive Control , 2021, Autom..

[18]  Fuzhen Zhang The Schur complement and its applications , 2005 .

[19]  Hassan Jafarzadeh,et al.  Learning Model Predictive Control for Connected Autonomous Vehicles , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

[20]  Harald Waschl,et al.  Nonlinear MPC for Emission Efficient Cooperative Adaptive Cruise Control , 2015 .