Robust Model Predictive Path Integral Control: Analysis and Performance Guarantees

In this letter we propose a novel decision making architecture for Robust Model-Predictive Path Integral Control (RMPPI) and investigate its performance guarantees and applicability to off-road navigation. Key building blocks of the proposed architecture are an augmented state space representation of the system consisting of nominal and actual dynamics, a placeholder for different types of tracking controllers, a safety logic for nominal state propagation, and an importance sampling scheme that takes into account the capabilities of the underlying tracking control. Using these ingredients, we derive a bound on the free energy growth of the dynamical system which is a function of task constraint satisfaction level, the performance of the underlying tracking controller, and the sampling error of the stochastic optimization used within RMPPI. To validate the bound on free energy growth, we perform experiments in simulation using two types of tracking controllers, namely the iterative Linear Quadratic Gaussian and Contraction-Metric based control. We further demonstrate the applicability of RMPPI in real hardware using the GT AutoRally vehicle. Our experiments demonstrate that RMPPI outperforms MPPI and Tube-MPPI by alleviating issues of the aforementioned model predictive controllers related to either lack of robustness or excessive conservatism. RMPPI provides the best of the two worlds in terms of agility and robustness to disturbances.

[1]  David Q. Mayne,et al.  Robust model predictive control: advantages and disadvantages of tube-based methods ⋆ , 2011 .

[2]  Jonathan P. How,et al.  Robust Sampling-based Motion Planning with Asymptotic Optimality Guarantees , 2013 .

[3]  James M. Rehg,et al.  Information-Theoretic Model Predictive Control: Theory and Applications to Autonomous Driving , 2017, IEEE Transactions on Robotics.

[4]  Freda Kemp,et al.  An Introduction to Sequential Monte Carlo Methods , 2003 .

[5]  Nolan Wagener,et al.  Information theoretic MPC for model-based reinforcement learning , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Pieter Abbeel,et al.  Autonomous Helicopter Aerobatics through Apprenticeship Learning , 2010, Int. J. Robotics Res..

[7]  Evangelos A. Theodorou,et al.  Model Predictive Path Integral Control: From Theory to Parallel Computation , 2017 .

[8]  Ian R. Manchester,et al.  An Amendment to "Control Contraction Metrics: Convex and Intrinsic Criteria for Nonlinear Feedback Design" , 2017, ArXiv.

[9]  A. Richards,et al.  Robust model predictive control with imperfect information , 2005, Proceedings of the 2005, American Control Conference, 2005..

[10]  James M. Rehg,et al.  Vision-Based High-Speed Driving With a Deep Dynamic Observer , 2018, IEEE Robotics and Automation Letters.

[11]  D. Scaramuzza,et al.  AlphaPilot: autonomous drone racing , 2020, Autonomous Robots.

[12]  James M. Rehg,et al.  Locally Weighted Regression Pseudo-Rehearsal for Adaptive Model Predictive Control , 2019, CoRL.

[13]  Jean-Jacques E. Slotine,et al.  On Contraction Analysis for Non-linear Systems , 1998, Autom..

[14]  James M. Rehg,et al.  Best Response Model Predictive Control for Agile Interactions Between Autonomous Ground Vehicles , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Naira Hovakimyan,et al.  Safe Feedback Motion Planning: A Contraction Theory and ℒ1-Adaptive Control Based Approach , 2020, 2020 59th IEEE Conference on Decision and Control (CDC).

[16]  Juraj Oravec,et al.  Alternative LMI-based Robust MPC Design Approaches∗ , 2015 .

[17]  James M. Rehg,et al.  Locally Weighted Regression Pseudo-Rehearsal for Online Learning of Vehicle Dynamics , 2019, ArXiv.

[18]  Gianni Ferretti,et al.  Sampling-based optimal kinodynamic planning with motion primitives , 2018, Autonomous Robots.

[19]  Han Wang,et al.  Applications of the Cross-Entropy Method to Importance Sampling and Optimal Control of Diffusions , 2014, SIAM J. Sci. Comput..

[20]  James M. Rehg,et al.  AutoRally: An Open Platform for Aggressive Autonomous Driving , 2018, IEEE Control Systems.

[21]  Michael Mistry,et al.  Uncertainty averse pushing with model predictive path integral control , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[22]  James M. Rehg,et al.  Robust Sampling Based Model Predictive Control with Sparse Objective Information , 2018, Robotics: Science and Systems.

[23]  Nando de Freitas,et al.  An Introduction to Sequential Monte Carlo Methods , 2001, Sequential Monte Carlo Methods in Practice.

[24]  E. Todorov,et al.  A generalized iterative LQG method for locally-optimal feedback control of constrained nonlinear stochastic systems , 2005, Proceedings of the 2005, American Control Conference, 2005..

[25]  Sang Uk Lee,et al.  Robust sampling-based motion planning for autonomous tracked vehicles in deformable high slip terrain , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).