Learning and Sparse Control of Multiagent Systems

In the past decade there has been a large scope of studies on mathematical models of social dynamics. Self-organization, i.e., the autonomous formation of patterns, has been so far the main driving concept. Usually first or second order models are considered with given predetermined nonlocal interaction potentials, tuned to reproduce, at least qualitatively, certain global patterns (such as flocks of birds, milling school of fish or line formations in pedestrian flows etc.). However, it is common experience that selforganization of a society does not always spontaneously occur. In the first part of this survey paper we address the question of whether it is possible to externally and parsimoniously influence the dynamics, to promote the formation of certain desired patterns. In particular we address the issue of finding the sparsest control strategy for finite agent models in order to lead the dynamics optimally towards a given outcome. In the second part of the paper we show the rigorous limit process connecting finite dimensional sparse optimal control problems with ODE constraints to an infinite dimensional sparse meanfield optimal control problem with a constraint given by a PDE of Vlasov-type, governing the dynamics of the probability distribution of the agent population. Moreover, often in practice we do not dispose of a precise knowledge of the governing dynamics. In the last part of this paper we present a variational and optimal transport framework leading to an algorithmic solution to the problem of learning the interaction potentials from the observation of the dynamics of a multiagent system. 2010 Mathematics Subject Classification. 49J15 / 49J20 / 35Q83 / 35Q91 / 37N25

[1]  Mikhail V. Khlebnikov,et al.  Sparse feedback in linear control systems , 2014, Autom. Remote. Control..

[2]  Ken Sugawara,et al.  Cooperative acceleration of task performance: foraging behavior of interacting multi-robots system , 1997 .

[3]  Tu,et al.  Long-Range Order in a Two-Dimensional Dynamical XY Model: How Birds Fly Together. , 1995, Physical review letters.

[4]  Jie Lin,et al.  Correction to "Coordination of groups of mobile autonomous agents using nearest neighbor rules" , 2003, IEEE Trans. Autom. Control..

[5]  L. Pareschi,et al.  Selective model-predictive control for flocking systems , 2016, Communications in Applied and Industrial Mathematics.

[6]  Felipe Cucker,et al.  Emergent Behavior in Flocks , 2007, IEEE Transactions on Automatic Control.

[7]  Peter E. Caines,et al.  Synthesis of Cucker-Smale type flocking via Mean Field stochastic control theory: Nash equilibria , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[8]  Pedro Elosegui,et al.  Extension of the Cucker-Smale Control Law to Space Flight Formations , 2009 .

[9]  Massimo Fornasier,et al.  Mean-field sparse optimal control , 2014, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[10]  L. Edelstein-Keshet,et al.  Complexity, pattern, and evolutionary trade-offs in animal aggregation. , 1999, Science.

[11]  I. Couzin,et al.  Effective leadership and decision-making in animal groups on the move , 2005, Nature.

[12]  Massimo Fornasier,et al.  Sparse Stabilization and Control of Alignment Models , 2012, 1210.5739.

[13]  K. Kunisch,et al.  A duality-based approach to elliptic control problems in non-reflexive Banach spaces , 2011 .

[14]  I. Flügge-Lotz,et al.  Investigation of Optimal Control With a Minimum-Fuel Consumption Criterion for a Fourth-Order Plant With Two Control Inputs; Synthesis of an Efficient Suboptimal Control , 1965 .

[15]  Sébastien Motsch,et al.  Heterophilious Dynamics Enhances Consensus , 2013, SIAM Rev..

[16]  Roland Herzog,et al.  Directional Sparsity in Optimal Control of Partial Differential Equations , 2012, SIAM J. Control. Optim..

[17]  L. Segel,et al.  Initiation of slime mold aggregation viewed as an instability. , 1970, Journal of theoretical biology.

[18]  B. Perthame Mathematical tools for kinetic equations , 2004 .

[19]  P. Lions,et al.  Mean field games , 2007 .

[20]  Georg Stadler,et al.  Elliptic optimal control problems with L1-control cost and applications for the placement of control devices , 2009, Comput. Optim. Appl..

[21]  Steven V. Viscido,et al.  Self-Organized Fish Schools: An Examination of Emergent Properties , 2002, The Biological Bulletin.

[22]  F. Cucker,et al.  Flocking in noisy environments , 2007, 0706.3343.

[23]  Karl Kunisch,et al.  A measure space approach to optimal source placement , 2012, Comput. Optim. Appl..

[24]  G. Parisi,et al.  Interaction ruling animal collective behavior depends on topological rather than metric distance: Evidence from a field study , 2007, Proceedings of the National Academy of Sciences.

[25]  Massimo Fornasier,et al.  Mean Field Control Hierarchy , 2016, Applied Mathematics & Optimization.

[26]  Karl Kunisch,et al.  Approximation of Elliptic Control Problems in Measure Spaces with Sparse Solutions , 2012, SIAM J. Control. Optim..

[27]  Yoshiki Kuramoto,et al.  Chemical Oscillations, Waves, and Turbulence , 1984, Springer Series in Synergetics.

[28]  Felipe Cucker,et al.  A conditional, collision-avoiding, model for swarming , 2013 .

[29]  P. Caines,et al.  Individual and mass behaviour in large population stochastic wireless power control problems: centralized and Nash equilibrium solutions , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[30]  H. Maurer,et al.  On L1‐minimization in optimal control and applications to robotics , 2006 .

[31]  G. D. Maso,et al.  An Introduction to-convergence , 1993 .

[32]  B. Piccoli,et al.  Multiscale Modeling of Pedestrian Dynamics , 2014 .

[33]  Yonina C. Eldar,et al.  Average Case Analysis of Multichannel Sparse Recovery Using Convex Relaxation , 2009, IEEE Transactions on Information Theory.

[34]  H.G. Tanner,et al.  On the controllability of nearest neighbor interconnections , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[35]  Lorenzo Pareschi,et al.  Kinetic description of optimal control problems and applications to opinion consensus , 2014, 1401.7798.

[36]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[37]  Jos'e A. Carrillo,et al.  A Review on Attractive–Repulsive Hydrodynamics for Consensus in Collective Behavior , 2016, 1605.00232.

[38]  Felipe Cucker,et al.  Modeling Language Evolution , 2004, Found. Comput. Math..

[39]  Magnus Egerstedt,et al.  Controllability of Multi-Agent Systems from a Graph-Theoretic Perspective , 2009, SIAM J. Control. Optim..

[40]  S. Mallat A wavelet tour of signal processing , 1998 .

[41]  Massimo Fornasier,et al.  Sparse stabilization of dynamical systems driven by attraction and avoidance forces , 2014, Networks Heterog. Media.

[42]  Mauro Garavello,et al.  Traffic flow on networks : conservation laws models , 2006 .

[43]  I D Couzin,et al.  Self-organized lane formation and optimized traffic flow in army ants , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[44]  M. Fornasier,et al.  Sparse stabilization and optimal control of the Cucker-Smale model , 2013 .

[45]  T. Vicsek,et al.  Collective Motion , 1999, physics/9902023.

[46]  S. Smale,et al.  On the mathematics of emergence , 2007 .

[47]  Massimo Fornasier,et al.  Mean-Field Pontryagin Maximum Principle , 2015, J. Optim. Theory Appl..

[48]  Andrea L. Bertozzi,et al.  Multi-Vehicle Flocking: Scalability of Cooperative Control Algorithms using Pairwise Potentials , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[49]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[50]  Naomi Ehrich Leonard,et al.  Virtual leaders, artificial potentials and coordinated control of groups , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[51]  Christian A. Yates,et al.  Inherent noise can facilitate coherence in collective swarm motion , 2009, Proceedings of the National Academy of Sciences.

[52]  Massimo Fornasier,et al.  Recovery Algorithms for Vector-Valued Data with Joint Sparsity Constraints , 2008, SIAM J. Numer. Anal..

[53]  Felipe Cucker,et al.  A General Collision-Avoiding Flocking Framework , 2011, IEEE Transactions on Automatic Control.

[54]  Seung-Yeal Ha,et al.  Emergent Behavior of a Cucker-Smale Type Particle Model With Nonlinear Velocity Couplings , 2010, IEEE Transactions on Automatic Control.

[55]  Gerd Wachsmuth,et al.  Convergence and regularization results for optimal control problems with sparsity functional , 2011 .

[56]  G Albi,et al.  Boltzmann-type control of opinion consensus through leaders , 2014, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[57]  Giacomo Albi,et al.  Invisible Control of Self-Organizing Agents Leaving Unknown Environments , 2015, SIAM J. Appl. Math..

[58]  A. Bertozzi,et al.  Self-propelled particles with soft-core interactions: patterns, stability, and collapse. , 2006, Physical review letters.

[59]  A. Bensoussan,et al.  Mean Field Games and Mean Field Type Control Theory , 2013 .

[60]  B. Perthame Transport Equations in Biology , 2006 .

[61]  Benedetto Piccoli,et al.  Control to Flocking of the Kinetic Cucker-Smale Model , 2014, SIAM J. Math. Anal..

[62]  Josef Hofbauer,et al.  Evolutionary Games and Population Dynamics , 1998 .

[63]  W. L. Romey Individual differences make a difference in the trajectories of simulated schools of fish , 1996 .

[64]  J. Carrillo,et al.  Double milling in self-propelled swarms from kinetic theory , 2009 .

[65]  Arthur L. Koch,et al.  The social lifestyle of myxobacteria , 1999 .

[66]  Guy Theraulaz,et al.  Self-Organization in Biological Systems , 2001, Princeton studies in complexity.

[67]  Massimo Fornasier,et al.  Particle, kinetic, and hydrodynamic models of swarming , 2010 .

[68]  James W. Minett,et al.  Self-organization and selection in the emergence of vocabulary , 2002, Complex..

[69]  M. Fornasier,et al.  Inferring Interaction Rules From Observations of Evolutive Systems I: The Variational Approach , 2016, 1602.00342.

[70]  Hiro-Sato Niwa Self-organizing Dynamic Model of Fish Schooling , 1994 .

[71]  U. Krause A DISCRETE NONLINEAR AND NON–AUTONOMOUS MODEL OF CONSENSUS FORMATION , 2007 .

[72]  Massimo Fornasier,et al.  Un)conditional consensus emergence under perturbed and decentralized feedback controls , 2015 .

[73]  H. Chaté,et al.  Onset of collective and cohesive motion. , 2004, Physical review letters.

[74]  Andrea L. Bertozzi,et al.  c ○ World Scientific Publishing Company A STATISTICAL MODEL OF CRIMINAL BEHAVIOR , 2008 .

[75]  Benedetto Piccoli,et al.  Modeling self-organization in pedestrians and animal groups from macroscopic and microscopic viewpoints , 2009, 0906.4702.

[76]  A. Bertozzi,et al.  State Transitions and the Continuum Limit for a 2D Interacting, Self-Propelled Particle System , 2006, nlin/0606031.

[77]  Rainer Hegselmann,et al.  Opinion dynamics and bounded confidence: models, analysis and simulation , 2002, J. Artif. Soc. Soc. Simul..

[78]  O. Scherzer Handbook of mathematical methods in imaging , 2011 .

[79]  M. Fornasier,et al.  Mean-Field Optimal Control , 2013, 1306.5913.

[80]  Vicsek,et al.  Novel type of phase transition in a system of self-driven particles. , 1995, Physical review letters.

[81]  Peter E. Caines,et al.  Mean Field Analysis of Controlled Cucker-Smale Type Flocking: Linear Analysis and Perturbation Equations , 2011 .

[82]  Benedetto Piccoli,et al.  Multiscale Modeling of Granular Flows with Application to Crowd Dynamics , 2010, Multiscale Model. Simul..

[83]  J. A. Carrillo,et al.  The derivation of swarming models: Mean-field limit and Wasserstein distances , 2013, 1304.5776.