Recurrent averaging inequalities in multi-agent control and social dynamics modeling

Abstract Many multi-agent control algorithms and dynamic agent-based models arising in natural and social sciences are based on the principle of iterative averaging. Each agent is associated to a value of interest, which may represent, for instance, the opinion of an individual in a social group, the velocity vector of a mobile robot in a flock, or the measurement of a sensor within a sensor network. This value is updated, at each iteration, to a weighted average of itself and of the values of the adjacent agents. It is well known that, under natural assumptions on the network’s graph connectivity, this local averaging procedure eventually leads to global consensus, or synchronization of the values at all nodes. Applications of iterative averaging include, but are not limited to, algorithms for distributed optimization, for solution of linear and nonlinear equations, for multi-robot coordination and for opinion formation in social groups. Although these algorithms have similar structures, the mathematical techniques used for their analysis are diverse, and conditions for their convergence and differ from case to case. In this paper, we review many of these algorithms and we show that their properties can be analyzed in a unified way by using a novel tool based on recurrent averaging inequalities (RAIs). We develop a theory of RAIs and apply it to the analysis of several important multi-agent algorithms recently proposed in the literature.

[1]  Rainer Hegselmann,et al.  Opinion dynamics and bounded confidence: models, analysis and simulation , 2002, J. Artif. Soc. Soc. Simul..

[2]  Wei Ren,et al.  Constrained Consensus in Unbalanced Networks With Communication Delays , 2014, IEEE Transactions on Automatic Control.

[3]  Randal W. Beard,et al.  Distributed Consensus in Multi-vehicle Cooperative Control - Theory and Applications , 2007, Communications and Control Engineering.

[4]  Tamer Basar,et al.  Exponential Convergence of the Discrete- and Continuous-Time Altafini Models , 2017, IEEE Transactions on Automatic Control.

[5]  Shaoshuai Mou,et al.  A distributed algorithm for solving a linear algebraic equation , 2015, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[6]  Luc Moreau,et al.  Stability of multiagent systems with time-dependent communication links , 2005, IEEE Transactions on Automatic Control.

[7]  Karl Henrik Johansson,et al.  Randomized optimal consensus of multi-agent systems , 2011, Autom..

[8]  Asuman E. Ozdaglar,et al.  Constrained Consensus and Optimization in Multi-Agent Networks , 2008, IEEE Transactions on Automatic Control.

[9]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[10]  Alle Leizarowitz,et al.  On infinite products of stochastic matrices , 1992 .

[11]  Ziyang Meng,et al.  Persistent Flows in Deterministic Chains , 2019, IEEE Transactions on Automatic Control.

[12]  Magnus Egerstedt,et al.  Graph Theoretic Methods in Multiagent Networks , 2010, Princeton Series in Applied Mathematics.

[13]  Behrouz Touri,et al.  On Endogenous Random Consensus and Averaging Dynamics , 2014, IEEE Transactions on Control of Network Systems.

[14]  Kilian Q. Weinberger,et al.  Optimal Convergence Rates for Convex Distributed Optimization in Networks , 2019, J. Mach. Learn. Res..

[15]  David Angeli,et al.  Stability of leaderless discrete-time multi-agent systems , 2006, Math. Control. Signals Syst..

[16]  Alexey S. Matveev,et al.  Popov-Type Criterion for Consensus in Nonlinearly Coupled Networks , 2015, IEEE Transactions on Cybernetics.

[17]  Brian D. O. Anderson,et al.  Reaching a Consensus in a Dynamically Changing Environment: Convergence Rates, Measurement Delays, and Asynchronous Events , 2008, SIAM J. Control. Optim..

[18]  Roberto Tempo,et al.  A new model of opinion dynamics for social actors with multiple interdependent attitudes and prejudices , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[19]  Ming Cao,et al.  Opinion evolution in time-varying social influence networks with prejudiced agents , 2017, ArXiv.

[20]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[21]  Sergio Grammatico,et al.  Towards Time-Varying Proximal Dynamics in Multi-Agent Network Games , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[22]  A. Stephen Morse,et al.  A Distributed Algorithm for Computing a Common Fixed Point of a Finite Family of Paracontractions , 2017, IEEE Transactions on Automatic Control.

[23]  Brian D. O. Anderson,et al.  Reaching a Consensus in a Dynamically Changing Environment: Convergence Rates, Measurement Delays, and Asynchronous Events , 2008, SIAM J. Control. Optim..

[24]  Claudio Altafini,et al.  Dynamics of Opinion Forming in Structurally Balanced Social Networks , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[25]  B. Tošić,et al.  Difference equations in condensed matter physics and their application to exciton systems in thin molecular films , 2005 .

[26]  Chiara Ravazzi,et al.  Gossips and Prejudices: Ergodic Randomized Dynamics in Social Networks , 2013, ArXiv.

[27]  Aryan Mokhtari,et al.  DSA: Decentralized Double Stochastic Averaging Gradient Algorithm , 2015, J. Mach. Learn. Res..

[28]  Behrouz Touri,et al.  Non-Convex Distributed Optimization , 2015, IEEE Transactions on Automatic Control.

[29]  John N. Tsitsiklis,et al.  Convergence of Type-Symmetric and Cut-Balanced Consensus Seeking Systems , 2011, IEEE Transactions on Automatic Control.

[30]  Tamer Basar,et al.  Stability of a distributed algorithm for solving linear algebraic equations , 2014, 53rd IEEE Conference on Decision and Control.

[31]  Dragana Bajović,et al.  Newton-like Method with Diagonal Correction for Distributed Optimization , 2015, SIAM J. Optim..

[32]  Behrouz Touri,et al.  On Ergodicity, Infinite Flow, and Consensus in Random Models , 2010, IEEE Transactions on Automatic Control.

[33]  Sadegh Bolouki,et al.  Consensus algorithms and the decomposition-separation theorem , 2013, 52nd IEEE Conference on Decision and Control.

[34]  P. Antsaklis,et al.  Asynchronous Consensus Protocols Using Nonlinear Paracontractions Theory , 2008, IEEE Transactions on Automatic Control.

[35]  Karl Henrik Johansson,et al.  Finite-Time Consensus Using Stochastic Matrices With Positive Diagonals , 2013, IEEE Transactions on Automatic Control.

[36]  M. Degroot Reaching a Consensus , 1974 .

[37]  Roberto Tempo,et al.  A Tutorial on Modeling and Analysis of Dynamic Social Networks. Part II , 2018, Annu. Rev. Control..

[38]  F. Heider Attitudes and cognitive organization. , 1946, The Journal of psychology.

[39]  Reza Olfati-Saber,et al.  Flocking for multi-agent dynamic systems: algorithms and theory , 2006, IEEE Transactions on Automatic Control.

[40]  Ziyang Meng,et al.  Behaviors of networks with antagonistic interactions and switching topologies , 2016, Autom..

[41]  John N. Tsitsiklis,et al.  Convergence Speed in Distributed Consensus and Averaging , 2009, SIAM J. Control. Optim..

[42]  Yongcan Cao,et al.  Distributed Coordination of Multi-agent Networks , 2011 .

[43]  Bernard Chazelle,et al.  The Total s-Energy of a Multiagent System , 2010, SIAM J. Control. Optim..

[44]  Alexey S. Matveev,et al.  Stability of continuous-time consensus algorithms for switching networks with bidirectional interaction , 2013, 2013 European Control Conference (ECC).

[45]  Rainer Hegselmann,et al.  Truth and Cognitive Division of Labour: First Steps Towards a Computer Aided Social Epistemology , 2006, J. Artif. Soc. Soc. Simul..

[46]  Noah E. Friedkin,et al.  The Problem of Social Control and Coordination of Complex Systems in Sociology: A Look at the Community Cleavage Problem , 2015, IEEE Control Systems.

[47]  F. R. Gantmakher The Theory of Matrices , 1984 .

[48]  Naomi Ehrich Leonard Multi-Agent System Dynamics: Bifurcation and Behavior of Animal Groups , 2013 .

[49]  Anton V. Proskurnikov,et al.  Nonlinear Consensus Algorithms with Uncertain Couplings , 2014 .

[50]  K. Lehrer When Rational Disagreement is Impossible , 1976 .

[51]  Zhisheng Duan,et al.  Distributed Algorithm to Solve a System of Linear Equations With Unique or Multiple Solutions From Arbitrary Initializations , 2019, IEEE Transactions on Control of Network Systems.

[52]  Sascha Kurz,et al.  On the Hegselmann–Krause conjecture in opinion dynamics , 2014, ArXiv.

[53]  John N. Tsitsiklis,et al.  Distributed asynchronous deterministic and stochastic gradient optimization algorithms , 1986 .

[54]  John G. Kemeny,et al.  Finite Markov chains , 1960 .

[55]  Henrik Sandberg,et al.  A Survey of Distributed Optimization and Control Algorithms for Electric Power Systems , 2017, IEEE Transactions on Smart Grid.

[56]  Ziyang Meng,et al.  A survey of distributed optimization , 2019, Annu. Rev. Control..

[57]  M. Bartlett,et al.  Weak ergodicity in non-homogeneous Markov chains , 1958, Mathematical Proceedings of the Cambridge Philosophical Society.

[58]  Oleg Granichin,et al.  Distributed State Estimation of Moving Targets Using Cyclic Simultaneous Perturbation Stochastic Approximation , 2018 .

[59]  Karl Henrik Johansson,et al.  Robust Consensus for Continuous-Time Multiagent Dynamics , 2013, SIAM J. Control. Optim..

[60]  Antoine Girard,et al.  Continuous-Time Consensus under Persistent Connectivity and Slow Divergence of Reciprocal Interaction Weights , 2013, SIAM J. Control. Optim..

[61]  Claudio Altafini,et al.  Consensus Problems on Networks With Antagonistic Interactions , 2013, IEEE Transactions on Automatic Control.

[62]  J. French A formal theory of social power. , 1956, Psychology Review.

[63]  V. Borkar,et al.  Asymptotic agreement in distributed estimation , 1982 .

[64]  Ming Cao,et al.  Modulus consensus in discrete-time signed networks and properties of special recurrent inequalities , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[65]  Roberto Tempo,et al.  Novel Multidimensional Models of Opinion Dynamics in Social Networks , 2015, IEEE Transactions on Automatic Control.

[66]  Shaoshuai Mou,et al.  Solving a system of linear equations: From centralized to distributed algorithms , 2019, Annu. Rev. Control..

[67]  Alexey S. Matveev,et al.  Opinion Dynamics in Social Networks With Hostile Camps: Consensus vs. Polarization , 2015, IEEE Transactions on Automatic Control.

[68]  Jeff S. Shamma,et al.  Cooperative Control of Distributed Multi-Agent Systems , 2008 .

[69]  J.N. Tsitsiklis,et al.  Convergence in Multiagent Coordination, Consensus, and Flocking , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[70]  Samuel Martin,et al.  Continuous-Time Consensus Under Non-Instantaneous Reciprocity , 2014, IEEE Transactions on Automatic Control.

[71]  Frank L. Lewis,et al.  Cooperative Control of Multi-Agent Systems: Optimal and Adaptive Design Approaches , 2013 .

[72]  Claudio Altafini,et al.  Dynamics over Signed Networks , 2017, SIAM Rev..

[73]  Yuming Jiang,et al.  Approximate Consensus in Stochastic Networks With Application to Load Balancing , 2015, IEEE Transactions on Information Theory.

[74]  Roberto Tempo,et al.  A networked parallel algorithm for solving linear algebraic equations , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[75]  J. Wolfowitz Products of indecomposable, aperiodic, stochastic matrices , 1963 .

[76]  Giuseppe Carlo Calafiore,et al.  Distributed Random Convex Programming via Constraints Consensus , 2012, SIAM J. Control. Optim..

[77]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[78]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[79]  Jan Lorenz,et al.  A stabilization theorem for dynamics of continuous opinions , 2005, 0708.2981.

[80]  Behrouz Touri,et al.  On backward product of stochastic matrices , 2011, Autom..

[81]  Karl Henrik Johansson,et al.  The Role of Persistent Graphs in the Agreement Seeking of Social Networks , 2011, IEEE Journal on Selected Areas in Communications.

[82]  Ming Cao,et al.  Opinion dynamics using Altafini's model with a time-varying directed graph , 2014, 2014 IEEE International Symposium on Intelligent Control (ISIC).

[83]  Giuseppe Carlo Calafiore,et al.  Distributed linear estimation over sensor networks , 2009, Int. J. Control.

[84]  Sadegh Bolouki,et al.  Linear Consensus Algorithms Based on Balanced Asymmetric Chains , 2015, IEEE Transactions on Automatic Control.

[85]  Vicsek,et al.  Novel type of phase transition in a system of self-driven particles. , 1995, Physical review letters.

[86]  Luca Schenato,et al.  A Survey on Distributed Estimation and Control Applications Using Linear Consensus Algorithms , 2010 .

[87]  Ming Cao,et al.  Differential Inequalities in Multi-Agent Coordination and Opinion Dynamics Modeling , 2016, Autom..

[88]  Brian D. O. Anderson,et al.  Convergence of Periodic Gossiping Algorithms , 2010 .

[89]  Fritz Heider,et al.  Social perception and phenomenal causality. , 1944 .

[90]  Sergio Grammatico,et al.  Proximal Dynamics in Multiagent Network Games , 2018, IEEE Transactions on Control of Network Systems.

[91]  Norman,et al.  Structural Models: An Introduction to the Theory of Directed Graphs. , 1966 .

[92]  Giuseppe Notarstefano,et al.  Distributed Optimization for Smart Cyber-Physical Networks , 2019, Found. Trends Syst. Control..

[93]  U. Krause A DISCRETE NONLINEAR AND NON–AUTONOMOUS MODEL OF CONSENSUS FORMATION , 2007 .