CONSENSUS IN MULTI-AGENT SYSTEMS

Many cooperative behaviors of multi-agent teams emerge from local interactions among the agents, where an agent interacts with a few “adjacent” teammates, but has no information about the remaining agents. For instance, the selforganization of many biological populations – including swarms of insects, flocks of birds, and schools of fish – are based on such local interaction rules: the motion and decisions of an individual agent are determined by the behavior of its nearest neighbors in the population. A special case of multi-agent coordination is consensus, that is, the agreement of agents on some quantity of interest or, more generally, the full or partial synchronization of their state trajectories. Establishing consensus is a “benchmark” problem in multi-agent systems study, which allows to reveal the main principles of multi-agent coordination and, in particular, the role of the system’s interaction graph (or topology). Consensus lies in the heart of many natural phenomena (e.g., synchronous oscillation of neural cells, which maintains a stable heart rhythm) and engineering designs (e.g., attitude synchronization of satellites). In this article, we give a brief review of distributed consensus algorithms, focusing on the basic ideas and relevant mathematical theory, in particular, graph theoretic methods.

[1]  Wei Xing Zheng,et al.  Consensus of multiple second-order vehicles with a time-varying reference signal under directed topology , 2011, Autom..

[2]  J.N. Tsitsiklis,et al.  Convergence in Multiagent Coordination, Consensus, and Flocking , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[3]  Frank Allgöwer,et al.  Consensus in Multi-Agent Systems With Coupling Delays and Switching Topology , 2011, IEEE Transactions on Automatic Control.

[4]  Miad Moarref,et al.  A Distributed Algorithm for Proportional Task Allocation in Networks of Mobile Agents , 2011, IEEE Transactions on Automatic Control.

[5]  Wenwu Yu,et al.  Second-Order Consensus for Multiagent Systems With Directed Topologies and Nonlinear Dynamics , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Yu-Ping Tian,et al.  Consensus of Multi-Agent Systems With Diverse Input and Communication Delays , 2008, IEEE Transactions on Automatic Control.

[7]  J. Yorke Asymptotic stability for one dimensional differential-delay equations☆ , 1970 .

[8]  Fei Liu,et al.  Stationary consensus of heterogeneous multi-agent systems with bounded communication delays , 2011, Autom..

[9]  Matthew O. Jackson,et al.  Naïve Learning in Social Networks and the Wisdom of Crowds , 2010 .

[10]  J. Wolfowitz Products of indecomposable, aperiodic, stochastic matrices , 1963 .

[11]  Wenwu Yu,et al.  An Overview of Recent Progress in the Study of Distributed Multi-Agent Coordination , 2012, IEEE Transactions on Industrial Informatics.

[12]  J. French A formal theory of social power. , 1956, Psychology Review.

[13]  Ali Jadbabaie,et al.  Non-Bayesian Social Learning , 2011, Games Econ. Behav..

[14]  M. Macy,et al.  Small Worlds and Cultural Polarization , 2011 .

[15]  Wim Michiels,et al.  Consensus Problems with Distributed Delays, with Application to Traffic Flow Models , 2009, SIAM J. Control. Optim..

[16]  Yuming Jiang,et al.  Approximate Consensus in Stochastic Networks With Application to Load Balancing , 2015, IEEE Transactions on Information Theory.

[17]  John N. Tsitsiklis,et al.  Convergence of Type-Symmetric and Cut-Balanced Consensus Seeking Systems , 2011, IEEE Transactions on Automatic Control.

[18]  Frank L. Lewis,et al.  Synchronization of discrete-time multi-agent systems on graphs using Riccati design , 2012, Autom..

[19]  M. Degroot Reaching a Consensus , 1974 .

[20]  Wenwu Yu,et al.  Distributed Consensus Filtering in Sensor Networks , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Luc Moreau,et al.  Stability of multiagent systems with time-dependent communication links , 2005, IEEE Transactions on Automatic Control.

[22]  Frank Allgöwer,et al.  Delay robustness in consensus problems , 2010, Autom..

[23]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[24]  Roberto Tempo,et al.  The PageRank Problem, Multiagent Consensus, and Web Aggregation: A Systems and Control Viewpoint , 2013, IEEE Control Systems.

[25]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[26]  Robert L. Winkler,et al.  The Consensus of Subjective Probability Distributions , 1968 .

[27]  Claudio Altafini,et al.  Consensus Problems on Networks With Antagonistic Interactions , 2013, IEEE Transactions on Automatic Control.

[28]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[29]  John N. Tsitsiklis,et al.  On Krause's Multi-Agent Consensus Model With State-Dependent Connectivity , 2008, IEEE Transactions on Automatic Control.

[30]  José M. F. Moura,et al.  Weight Optimization for Consensus Algorithms With Correlated Switching Topology , 2009, IEEE Transactions on Signal Processing.

[31]  Karl Henrik Johansson,et al.  Event-based broadcasting for multi-agent average consensus , 2013, Autom..

[32]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[33]  Silviu-Iulian Niculescu,et al.  Stability of Traffic Flow Behavior with Distributed Delays Modeling the Memory Effects of the Drivers , 2007, SIAM J. Appl. Math..

[34]  Asuman E. Ozdaglar,et al.  Constrained Consensus and Optimization in Multi-Agent Networks , 2008, IEEE Transactions on Automatic Control.

[35]  Anton V. Proskurnikov,et al.  Consensus in switching networks with sectorial nonlinear couplings: Absolute stability approach , 2013, Autom..

[36]  Tianping Chen,et al.  Consensus of Multi-Agent Systems With Unbounded Time-Varying Delays , 2010, IEEE Transactions on Automatic Control.

[37]  John S. Baras,et al.  Emergent Behaviors Over Signed Random Dynamical Networks: State-Flipping Model , 2014, IEEE Transactions on Control of Network Systems.

[38]  Alexey S. Matveev,et al.  Stability of continuous-time consensus algorithms for switching networks with bidirectional interaction , 2013, 2013 European Control Conference (ECC).

[39]  Anton V. Proskurnikov,et al.  A general criterion for synchronization of incrementally dissipative nonlinearly coupled agents , 2015, 2015 European Control Conference (ECC).

[40]  Guodong Shi,et al.  Global target aggregation and state agreement of nonlinear multi-agent systems with switching topologies , 2009, Autom..

[41]  Anton V. Proskurnikov,et al.  Delay Robustness of Nonlinear Consensus Protocols: Analytic Criteria , 2016 .

[42]  Michaell Taylor,et al.  Towards a Mathematical Theory of Influence and Attitude Change , 1968 .

[43]  Nikolay V. Kuznetsov,et al.  Time-Varying Linearization and the Perron Effects , 2007, Int. J. Bifurc. Chaos.

[44]  V. Latora,et al.  VECTOR OPINION DYNAMICS IN A BOUNDED CONFIDENCE CONSENSUS MODEL , 2005, physics/0504017.

[45]  Wenwu Yu,et al.  Distributed Higher Order Consensus Protocols in Multiagent Dynamical Systems , 2011, IEEE Transactions on Circuits and Systems I: Regular Papers.

[46]  M. Bartlett,et al.  Weak ergodicity in non-homogeneous Markov chains , 1958, Mathematical Proceedings of the Cambridge Philosophical Society.

[47]  E. Eisenberg,et al.  CONSENSUS OF SUBJECTIVE PROBABILITIES: THE PARI-MUTUEL METHOD, , 1959 .

[48]  Glenn Vinnicombe,et al.  Heterogeneity and scalability in group agreement protocols: Beyond small gain and passivity approaches , 2010, Autom..

[49]  Yu-Ping Tian,et al.  Brief paper: High-order consensus of heterogeneous multi-agent systems with unknown communication delays , 2012 .

[50]  Wenwu Yu,et al.  Delay-Induced Consensus and Quasi-Consensus in Multi-Agent Dynamical Systems , 2013, IEEE Transactions on Circuits and Systems I: Regular Papers.

[51]  Reza Olfati-Saber,et al.  Flocking for multi-agent dynamic systems: algorithms and theory , 2006, IEEE Transactions on Automatic Control.

[52]  Reza Olfati-Saber,et al.  Coupled Distributed Estimation and Control for Mobile Sensor Networks , 2012, IEEE Transactions on Automatic Control.

[53]  P. Chebotarev,et al.  On of the Spectra of Nonsymmetric Laplacian Matrices , 2004, math/0508176.

[54]  Francesco Bullo,et al.  Maintaining limited-range connectivity among second-order agents , 2006 .

[55]  Rodolphe Sepulchre,et al.  Synchronization in networks of identical linear systems , 2009, Autom..

[56]  Randal W. Beard,et al.  Distributed Consensus in Multi-vehicle Cooperative Control - Theory and Applications , 2007, Communications and Control Engineering.

[57]  J. Willems Dissipative dynamical systems part I: General theory , 1972 .

[58]  Soummya Kar,et al.  Topology for Distributed Inference on Graphs , 2006, IEEE Transactions on Signal Processing.

[59]  Claudio De Persis,et al.  Discontinuities and hysteresis in quantized average consensus , 2010, Autom..

[60]  Noah E. Friedkin,et al.  The Problem of Social Control and Coordination of Complex Systems in Sociology: A Look at the Community Cleavage Problem , 2015, IEEE Control Systems.

[61]  Claudio Altafini,et al.  Predictable Dynamics of Opinion Forming for Networks With Antagonistic Interactions , 2015, IEEE Transactions on Automatic Control.

[62]  Emilia Fridman,et al.  Passification-based decentralized adaptive synchronization of dynamical networks with time-varying delays , 2015, J. Frankl. Inst..

[63]  Ming Cao,et al.  Clustering in diffusively coupled networks , 2011, Autom..

[64]  Anton V. Proskurnikov,et al.  Nonlinear Consensus Algorithms with Uncertain Couplings , 2014 .

[65]  K. Lehrer When Rational Disagreement is Impossible , 1976 .

[66]  Pierre-Alexandre Bliman,et al.  Average consensus problems in networks of agents with delayed communications , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[67]  Ming Cao,et al.  Sarymsakov Matrices and Asynchronous Implementation of Distributed Coordination Algorithms , 2014, IEEE Transactions on Automatic Control.

[68]  M. Hasler,et al.  Synchronization in asymmetrically coupled networks with node balance. , 2006, Chaos.

[69]  Gerardo Lafferriere,et al.  Decentralized control of vehicle formations , 2005, Syst. Control. Lett..

[70]  Yu-Ping Tian,et al.  Frequency-Domain Analysis and Design of Distributed Control Systems: Tian/Frequency-Domain Analysis and Design of Distributed Control Systems , 2012 .

[71]  Long Wang,et al.  Consensus of Multi-Agent Systems in Directed Networks With Nonuniform Time-Varying Delays , 2009, IEEE Transactions on Automatic Control.

[72]  Frank Allgöwer,et al.  An internal model principle is necessary and sufficient for linear output synchronization , 2011, Autom..

[73]  Andrey V. Savkin,et al.  Decentralized Coverage Control Problems for Mobile Robotic Sensor and Actuator Networks: Savkin/Decentralized , 2015 .

[74]  Ming Li,et al.  BANA: Body Area Network Authentication Exploiting Channel Characteristics , 2013, IEEE J. Sel. Areas Commun..

[75]  Yingmin Jia,et al.  Multi-agent consensus with diverse time-delays and jointly-connected topologies , 2011, Autom..

[76]  E. Seneta,et al.  Towards consensus: some convergence theorems on repeated averaging , 1977, Journal of Applied Probability.

[77]  Abhijit Das,et al.  Cooperative Control of Multi-Agent Systems , 2014 .

[78]  A. Jadbabaie,et al.  Effects of Delay in Multi-Agent Consensus and Oscillator Synchronization , 2010, IEEE Transactions on Automatic Control.

[79]  Pavel Yu. Chebotarev,et al.  The Forest Consensus Theorem , 2013, IEEE Transactions on Automatic Control.

[80]  Rodolphe Sepulchre,et al.  Analysis of Interconnected Oscillators by Dissipativity Theory , 2007, IEEE Transactions on Automatic Control.

[81]  Vincent D. Blondel,et al.  How to Decide Consensus? A Combinatorial Necessary and Sufficient Condition and a Proof that Consensus is Decidable but NP-Hard , 2012, SIAM J. Control. Optim..

[82]  Lin Huang,et al.  Consensus of Multiagent Systems and Synchronization of Complex Networks: A Unified Viewpoint , 2016, IEEE Transactions on Circuits and Systems I: Regular Papers.

[83]  Alexander L. Fradkov,et al.  Decentralized adaptive controller for synchronization of nonlinear dynamical heterogeneous networks , 2013 .

[84]  Mario di Bernardo,et al.  On QUAD, Lipschitz, and Contracting Vector Fields for Consensus and Synchronization of Networks , 2011, IEEE Transactions on Circuits and Systems I: Regular Papers.

[85]  Rodolphe Sepulchre,et al.  Global State Synchronization in Networks of Cyclic Feedback Systems , 2012, IEEE Transactions on Automatic Control.

[86]  Anton V. Proskurnikov,et al.  Consensus robustness against inner delays , 2016, Electron. Notes Discret. Math..

[87]  Pavel Yu. Chebotarev,et al.  The Projection Method for Reaching Consensus in Discrete-Time Multiagent Systems , 2013, MIM.

[88]  Wei Ren,et al.  Information consensus in multivehicle cooperative control , 2007, IEEE Control Systems.

[89]  Mark W. Spong,et al.  On Exponential Synchronization of Kuramoto Oscillators , 2009, IEEE Transactions on Automatic Control.

[90]  Wei Xing Zheng,et al.  Second-order consensus for multi-agent systems with switching topology and communication delay , 2011, Syst. Control. Lett..

[91]  Richard M. Murray,et al.  Information flow and cooperative control of vehicle formations , 2004, IEEE Transactions on Automatic Control.

[92]  Carl G. Wagner,et al.  Consensus through respect: A model of rational group decision-making , 1978 .

[93]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[94]  Vicsek,et al.  Novel type of phase transition in a system of self-driven particles. , 1995, Physical review letters.

[95]  Anton V. Proskurnikov,et al.  Average consensus in networks with nonlinearly delayed couplings and switching topology , 2013, Autom..

[96]  Fan Zhang,et al.  Fully distributed robust synchronization of networked Lur'e systems with incremental nonlinearities , 2014, Autom..

[97]  Soummya Kar,et al.  Consensus + innovations distributed inference over networks: cooperation and sensing in networked systems , 2013, IEEE Signal Processing Magazine.

[98]  Karl Henrik Johansson,et al.  Reaching an Optimal Consensus: Dynamical Systems That Compute Intersections of Convex Sets , 2011, IEEE Transactions on Automatic Control.

[99]  Murat Arcak,et al.  Passivity as a Design Tool for Group Coordination , 2007, IEEE Transactions on Automatic Control.

[100]  Wenwu Yu,et al.  Some necessary and sufficient conditions for second-order consensus in multi-agent dynamical systems , 2010, Autom..

[101]  Guanrong Chen,et al.  A time-varying complex dynamical network model and its controlled synchronization criteria , 2004, IEEE Trans. Autom. Control..

[102]  Brian D. O. Anderson,et al.  Reaching a Consensus in a Dynamically Changing Environment: Convergence Rates, Measurement Delays, and Asynchronous Events , 2008, SIAM J. Control. Optim..

[103]  Florian Dörfler,et al.  Synchronization in complex networks of phase oscillators: A survey , 2014, Autom..

[104]  Claudio De Persis,et al.  Robust Self-Triggered Coordination With Ternary Controllers , 2012, IEEE Transactions on Automatic Control.

[105]  Xu Wang,et al.  Necessary and Sufficient Conditions for Consensus of Double-Integrator Multi-Agent Systems With Measurement Noises , 2011, IEEE Transactions on Automatic Control.

[106]  Mireille E. Broucke,et al.  Formations of vehicles in cyclic pursuit , 2004, IEEE Transactions on Automatic Control.

[107]  Alexey S. Matveev,et al.  Opinion Dynamics in Social Networks With Hostile Camps: Consensus vs. Polarization , 2015, IEEE Transactions on Automatic Control.

[108]  Donald J. Newman,et al.  Cyclic Pursuit or “the Three Bugs Problem” , 1971 .

[109]  Manfredi Maggiore,et al.  State Agreement for Continuous-Time Coupled Nonlinear Systems , 2007, SIAM J. Control. Optim..

[110]  John S. Baras,et al.  Consensus-based linear distributed filtering , 2012, Autom..

[111]  Claudio Altafini,et al.  Dynamics of Opinion Forming in Structurally Balanced Social Networks , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[112]  Karl Henrik Johansson,et al.  Structural Balance and Opinion Separation in Trust–Mistrust Social Networks , 2016, IEEE Transactions on Control of Network Systems.

[113]  T. Carroll,et al.  Master Stability Functions for Synchronized Coupled Systems , 1998 .

[114]  David Angeli,et al.  Stability of leaderless discrete-time multi-agent systems , 2006, Math. Control. Signals Syst..

[115]  M. Stone The Opinion Pool , 1961 .

[116]  Alexey S. Matveev,et al.  Popov-Type Criterion for Consensus in Nonlinearly Coupled Networks , 2015, IEEE Transactions on Cybernetics.

[117]  Henk Nijmeijer,et al.  Synchronization and Graph Topology , 2005, Int. J. Bifurc. Chaos.

[118]  Michael A. Demetriou Design of consensus and adaptive consensus filters for distributed parameter systems , 2010, Autom..

[119]  Jorge Cortes,et al.  Distributed Control of Robotic Networks: A Mathematical Approach to Motion Coordination Algorithms , 2009 .

[120]  Long Wang,et al.  Consensus protocols for discrete-time multi-agent systems with time-varying delays , 2008, Autom..

[121]  Martin Hasler,et al.  Generalized connection graph method for synchronization in asymmetrical networks , 2006 .

[122]  Wenlian Lu,et al.  Synchronization of Discrete-Time Dynamical Networks with Time-Varying Couplings , 2008, SIAM J. Math. Anal..

[123]  Jiahu Qin,et al.  Consensus strategy for a class of multi‐agents with discrete second‐order dynamics , 2012 .

[124]  Martin Hasler,et al.  When Symmetrization Guarantees Synchronization in Directed Networks , 2007, Int. J. Bifurc. Chaos.

[125]  Ali Saberi,et al.  Output synchronization for heterogeneous networks of non-introspective agents , 2012, Autom..