Feedback Interconnected Density Estimation and Control

Swarm robotic systems have foreseeable applications in the near future. Recently, there has been an increasing amount of literature that employs partial differential equations (PDEs) to model the time-evolution of the probability density of swarm robotic systems and uses density feedback to design stable control laws that act on individuals such that their density converges to a target profile. However, it remains largely unexplored considering problems of how to estimate the realtime density, how the density estimation algorithms affect the control performance, and whether the estimation performance in turn depends on the control algorithms. In this work, we focus on studying the interplay of these algorithms. Specifically, we propose new density control laws which use the real-time density and its gradient as feedback, and prove that they are globally input-to-state stable (ISS) with respect to estimation errors. Then, we design filtering algorithms to obtain estimates of the density and its gradient, and prove that these estimates are convergent assuming the control laws are known. Finally, we show that the feedback interconnection of these estimation and control algorithms is still globally ISS, which is attributed to the bilinearity of the PDE system. An agent-based simulation is included to verify the stability of these algorithms and their feedback interconnection.

[1]  M. Ledoux,et al.  Analysis and Geometry of Markov Diffusion Operators , 2013 .

[2]  Spring Berman,et al.  Optimal control of stochastic coverage strategies for robotic swarms , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Hai Lin,et al.  Distributed Density Filtering for Large-Scale Systems Using Mean-Filed Models , 2020, 2021 American Control Conference (ACC).

[4]  T. Cacoullos Estimation of a multivariate density , 1966 .

[5]  Sergey Dashkovskiy,et al.  Input-to-state stability of infinite-dimensional control systems , 2012, Mathematics of Control, Signals, and Systems.

[6]  Hai Lin,et al.  PDE-Based Dynamic Density Estimation for Large-Scale Agent Systems , 2020, IEEE Control Systems Letters.

[7]  R. Curtain Infinite-Dimensional Filtering , 1975 .

[8]  D. Duffy Second‐Order Parabolic Differential Equations , 2013 .

[9]  Silvia Ferrari,et al.  Distributed optimal control for multi-agent trajectory optimization , 2014, Autom..

[10]  Behçet Açikmese,et al.  A Markov chain approach to probabilistic swarm guidance , 2012, 2012 American Control Conference (ACC).

[11]  Hai Lin,et al.  Backstepping Density Control for Large-Scale Heterogeneous Nonlinear Stochastic Systems , 2021, ArXiv.

[12]  Hai Lin,et al.  Transporting Robotic Swarms via Mean-Field Feedback Control , 2021, IEEE Transactions on Automatic Control.

[13]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[14]  Tryphon T. Georgiou,et al.  Optimal Steering of a Linear Stochastic System to a Final Probability Distribution, Part I , 2016, IEEE Transactions on Automatic Control.

[15]  P. J. Green,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[16]  Peter E. Caines,et al.  Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle , 2006, Commun. Inf. Syst..

[17]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[18]  Jason R. Marden,et al.  Cooperative Control and Potential Games , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[19]  A. Bensoussan,et al.  Mean Field Games and Mean Field Type Control Theory , 2013 .

[20]  Sonia Martínez,et al.  Distributed Optimal Transport for the Deployment of Swarms , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[21]  Spring Berman,et al.  Bilinear Controllability of a Class of Advection–Diffusion–Reaction Systems , 2017, IEEE Transactions on Automatic Control.

[22]  C. Villani,et al.  ON THE TREND TO EQUILIBRIUM FOR THE FOKKER-PLANCK EQUATION : AN INTERPLAY BETWEEN PHYSICS AND FUNCTIONAL ANALYSIS , 2004 .

[23]  Kazuhide Okamoto,et al.  Nonlinear Uncertainty Control with Iterative Covariance Steering , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

[24]  Behcet Acikmese,et al.  Velocity Field Generation for Density Control of Swarms using Heat Equation and Smoothing Kernels , 2017, 1710.00299.

[25]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.