Density Control of Large-Scale Particles Swarm Through PDE-Constrained Optimization

We describe in this paper an optimal control strategy for shaping a large-scale swarm of particles using boundary global actuation. This problem arises as a key challenge in many swarm robotics applications, especially when the robots are passive particles that need to be guided by external control fields. The system is large-scale and underactuated, making the control strategy at the microscopic particle level infeasible. We consider the Kolmogorov forward equation associated to the stochastic process of the single particle to encode the macroscopic behaviour of the particles swarm. The control inputs shape the velocity field of the density dynamics according to the physical model of the actuators. We find the optimal actuation considering an optimal control problem whose state dynamics is governed by a linear parabolic advection-diffusion equation where the control induces a transport field. From a theoretical standpoint, we show the existence of a solution to the resulting nonlinear optimal control problem. From a numerical standpoint, we employ the discrete adjoint method to accurately compute the reduced gradient and we show how it commutes with the optimize-then-discretize approach. Finally, numerical simulations show the effectiveness of the control strategy in driving the density sufficiently close to the target.

[1]  Fredi Tröltzsch,et al.  On the optimal control of the Schlögl-model , 2013, Comput. Optim. Appl..

[2]  Spring Berman,et al.  Bilinear Controllability of a Class of Advection–Diffusion–Reaction Systems , 2017, IEEE Transactions on Automatic Control.

[3]  Christian Klingenberg,et al.  A Fokker–Planck approach to control collective motion , 2018, Comput. Optim. Appl..

[4]  WächterAndreas,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006 .

[5]  Spring Berman,et al.  Mean-field models in swarm robotics: a survey , 2019, Bioinspiration & biomimetics.

[6]  Yao Zhang,et al.  Optimal reconfiguration with collision avoidance for a granular spacecraft using laser pressure , 2019 .

[7]  A. Quarteroni Numerical Models for Differential Problems , 2009 .

[8]  Arthur Fleig,et al.  Optimal Control of the Fokker–Planck Equation with Space-Dependent Controls , 2017, J. Optim. Theory Appl..

[9]  D. Duffy Second‐Order Parabolic Differential Equations , 2013 .

[10]  Scott A. Basinger,et al.  Optics of a granular imaging system (i.e. “orbiting rainbows”) , 2015, SPIE Optical Engineering + Applications.

[11]  Optimal control of the convective velocity coefficient in a parabolic problem , 2005 .

[12]  Viorel Barbu The Controllability of Fokker-Planck Equations with Reflecting Boundary Conditions and Controllers in Diffusion Term , 2021, SIAM J. Control. Optim..

[13]  Grover A. Swartzlander,et al.  Multi-Scale Dynamics, Control, and Simulation of Granular Spacecraft , 2013 .

[14]  Silvia Ferrari,et al.  Necessary conditions for optimality for a distributed optimal control problem , 2010, 49th IEEE Conference on Decision and Control (CDC).

[15]  G. M.,et al.  Partial Differential Equations I , 2023, Applied Mathematical Sciences.

[16]  Erkin Sidick,et al.  Unconventional imaging with contained granular media , 2017, Optical Engineering + Applications.

[17]  R. Herzog,et al.  Algorithms for PDE‐constrained optimization , 2010 .

[18]  Jacques Simeon,et al.  Compact Sets in the Space L~(O, , 2005 .

[19]  Itai Cohen,et al.  Electronically integrated, mass-manufactured, microscopic robots , 2020, Nature.

[20]  Marco B. Quadrelli,et al.  Dynamics and Control of a Disordered System in Space , 2013 .

[21]  Pedro U. Lima,et al.  Modeling and Optimal Centralized Control of a Large-Size Robotic Population , 2006, IEEE Transactions on Robotics.

[22]  Kazufumi Ito,et al.  Estimation of the convection coefficient in elliptic equations , 1997 .

[23]  H. Brezis Functional Analysis, Sobolev Spaces and Partial Differential Equations , 2010 .

[24]  Stefan Wendl,et al.  Optimal Control of Partial Differential Equations , 2021, Applied Mathematical Sciences.

[25]  F. Tröltzsch Optimal Control of Partial Differential Equations: Theory, Methods and Applications , 2010 .

[26]  Saptarshi Bandyopadhyay,et al.  Optimal Transport Based Control of Granular Imaging System in Space , 2017 .

[27]  Sören Bartels,et al.  Numerical Approximation of Partial Differential Equations , 2016 .

[28]  Silvia Ferrari,et al.  A generalized reduced gradient method for the optimal control of multiscale dynamical systems , 2013, 52nd IEEE Conference on Decision and Control.

[29]  Metin Sitti,et al.  Pros and Cons: Magnetic versus Optical Microrobots , 2020, Advanced materials.

[30]  Aaron T. Becker,et al.  Exploiting Nonslip Wall Contacts to Position Two Particles Using the Same Control Input , 2019, IEEE Transactions on Robotics.

[31]  Xiaoming Yuan,et al.  Bilinear Optimal Control of an Advection-reaction-diffusion System , 2021 .

[32]  Hai Lin,et al.  Deployment of Robotic Swarms via Density Feedback Control , 2020, ArXiv.

[33]  P. Lissy,et al.  Bilinear local controllability to the trajectories of the Fokker–Planck equation with a localized control , 2019, Annales de l'Institut Fourier.

[34]  Spring Berman,et al.  Optimal control of stochastic coverage strategies for robotic swarms , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[35]  Aaron Becker,et al.  Algorithms for shaping a particle swarm with a shared input by exploiting non-slip wall contacts , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[36]  Spring Berman,et al.  PDE-Based Optimization for Stochastic Mapping and Coverage Strategies using Robotic Ensembles , 2017, Autom..

[37]  J. Simon Compact sets in the spaceLp(O,T; B) , 1986 .