Model predictive control with random batch methods for a guiding problem

We model, simulate and control the guiding problem for a herd of evaders under the action of repulsive drivers. The problem is formulated in an optimal control framework, where the drivers (controls) aim to guide the evaders (states) to a desired region of the Euclidean space. The numerical simulation of such models quickly becomes unfeasible for a large number of interacting agents. To reduce the computational cost, we use the Random Batch Method (RBM), which provides a computationally feasible approximation of the dynamics. At each time step, the RBM randomly divides the set of particles into small subsets (batches), considering only the interactions inside each batch. Due to the averaging effect, the RBM approximation converges to the exact dynamics as the time discretization gets finer. We propose an algorithm that leads to the optimal control of a fixed RBM approximated trajectory using a classical gradient descent. The resulting control is not optimal for the original complete system, but rather for the reduced RBM model. We then adopt a Model Predictive Control (MPC) strategy to handle the error in the dynamics. While the system evolves in time, the MPC strategy consists in periodically updating the state and computing the optimal control over a long-time horizon, which is implemented recursively in a shorter time-horizon. This leads to a semi-feedback control strategy. Through numerical experiments we show that the combination of RBM and MPC leads to a significant reduction of the computational cost, preserving the capacity of controlling the overall dynamics.

[1]  Jing Ma,et al.  Finite-time flocking control of a swarm of cucker-smale agents with collision avoidance , 2017, 2017 24th International Conference on Mechatronics and Machine Vision in Practice (M2VIP).

[2]  Jos'e A. Carrillo,et al.  An analytical framework for a consensus-based global optimization method , 2016, 1602.00220.

[3]  François Golse,et al.  The mean-field limit for the dynamics of large particle systems , 2003 .

[4]  Florian Dörfler,et al.  Synchronization and transient stability in power networks and non-uniform Kuramoto oscillators , 2009, Proceedings of the 2010 American Control Conference.

[5]  Shi Jin,et al.  A consensus-based global optimization method for high dimensional machine learning problems , 2019 .

[6]  Felipe Cucker,et al.  Avoiding Collisions in Flocks , 2010, IEEE Transactions on Automatic Control.

[7]  Massimo Fornasier,et al.  Sparse control of alignment models in high dimension , 2014, Networks Heterog. Media.

[8]  Andrew J. King,et al.  Solving the shepherding problem: heuristics for herding autonomous, interacting agents , 2014, Journal of The Royal Society Interface.

[9]  Yurii Nesterov,et al.  Introductory Lectures on Convex Optimization - A Basic Course , 2014, Applied Optimization.

[10]  Seung-Yeal Ha,et al.  A simple proof of the Cucker-Smale flocking dynamics and mean-field limit , 2009 .

[11]  Carlos E. García,et al.  Design of Robust Process Controllers , 1987 .

[12]  Raducanu Razvan,et al.  MATHEMATICAL MODELS and METHODS in APPLIED SCIENCES , 2012 .

[13]  Richard M. Murray,et al.  Information flow and cooperative control of vehicle formations , 2004, IEEE Transactions on Automatic Control.

[14]  Nastassia Pouradier Duteil,et al.  Sparse Control of Hegselmann-Krause Models: Black Hole and Declustering , 2018, SIAM J. Control. Optim..

[15]  Maurizio Porfiri,et al.  Criteria for global pinning-controllability of complex networks , 2008, Autom..

[16]  V. Rokhlin Rapid solution of integral equations of classical potential theory , 1985 .

[17]  Nancy M. Amato,et al.  Shepherding behaviors , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[18]  William K. Holstein,et al.  The Mathematical Theory of Optimal Processes , 1965 .

[19]  Prashant Mhaskar,et al.  Robust Model Predictive Control Design for Fault-Tolerant Control of Process Systems , 2006 .

[20]  George J. Pappas,et al.  Flocking in Fixed and Switching Networks , 2007, IEEE Transactions on Automatic Control.

[21]  Emmanuel Trélat,et al.  Contrôle optimal : théorie & applications , 2005 .

[22]  Martin Burger,et al.  Controlling a self-organizing system of individuals guided by a few external agents -- particle description and mean-field limit , 2016, 1610.01325.

[23]  Young-Pil Choi,et al.  Sharp conditions to avoid collisions in singular Cucker-Smale interactions , 2016, 1609.03447.

[24]  Massimo Fornasier,et al.  Mean-Field Pontryagin Maximum Principle , 2015, J. Optim. Theory Appl..

[25]  M. Fornasier,et al.  Sparse stabilization and optimal control of the Cucker-Smale model , 2013 .

[26]  Enrique Zuazua,et al.  Asymptotic behavior and control of a "guidance by repulsion" model , 2019 .

[27]  Jos'e A. Carrillo,et al.  Optimal consensus control of the Cucker-Smale model , 2018, 1802.01529.

[28]  G. Martin,et al.  Nonlinear model predictive control , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[29]  Manfred Morari,et al.  Model predictive control: Theory and practice - A survey , 1989, Autom..

[30]  Claudia Totzeck,et al.  Interacting Particles and Optimization , 2018, PAMM.

[31]  Michael Nikolaou,et al.  Model predictive controllers: A critical synthesis of theory and industrial needs , 2001 .

[32]  Lei Li,et al.  Random Batch Methods (RBM) for interacting particle systems , 2018, J. Comput. Phys..

[33]  Felipe Cucker,et al.  Emergent Behavior in Flocks , 2007, IEEE Transactions on Automatic Control.

[34]  Moritz Diehl,et al.  CasADi: a software framework for nonlinear optimization and optimal control , 2018, Mathematical Programming Computation.

[35]  Enrique Zuazua,et al.  Optimal strategies for driving a mobile agent in a guidance by repulsion model , 2016, Commun. Nonlinear Sci. Numer. Simul..

[36]  Eitan Tadmor,et al.  A New Model for Self-organized Dynamics and Its Flocking Behavior , 2011, 1102.5575.

[37]  H. Jin Kim,et al.  Cucker-Smale Flocking With Inter-Particle Bonding Forces , 2010, IEEE Transactions on Automatic Control.

[38]  Doheon Kim,et al.  Convergence of a first-order consensus-based global optimization algorithm , 2019, Mathematical Models and Methods in Applied Sciences.

[39]  Soon-Jo Chung,et al.  Herding a Flock of Birds Approaching an Airport Using an Unmanned Aerial Vehicle , 2015 .