Distributed coordination in multi-agent systems: a graph Laplacian perspective

This paper reviews some main results and progress in distributed multi-agent coordination from a graph Laplacian perspective. Distributed multi-agent coordination has been a very active subject studied extensively by the systems and control community in last decades, including distributed consensus, formation control, sensor localization, distributed optimization, etc. The aim of this paper is to provide both a comprehensive survey of existing literature in distributed multi-agent coordination and a new perspective in terms of graph Laplacian to categorize the fundamental mechanisms for distributed coordination. For different types of graph Laplacians, we summarize their inherent coordination features and specific research issues. This paper also highlights several promising research directions along with some open problems that are deemed important for future study.

[1]  Minyue Fu,et al.  Formation merging control in 3D under directed and switching topologies , 2014 .

[2]  Claudio Altafini,et al.  Consensus Problems on Networks With Antagonistic Interactions , 2013, IEEE Transactions on Automatic Control.

[3]  Tianping Chen,et al.  Partial synchronization in linearly and symmetrically coupled ordinary differential systems , 2009 .

[4]  Lili Wang,et al.  Realizability of similar formation and local control of directed multi-agent networks in discrete-time , 2013, 52nd IEEE Conference on Decision and Control.

[5]  E. David,et al.  Networks, Crowds, and Markets: Reasoning about a Highly Connected World , 2010 .

[6]  Wenyuan Xu,et al.  Three-dimensional formation merging control of second-order agents under directed and switching topologies , 2014, 11th IEEE International Conference on Control & Automation (ICCA).

[7]  Stephen P. Boyd,et al.  The Fastest Mixing Markov Process on a Graph and a Connection to a Maximum Variance Unfolding Problem , 2006, SIAM Rev..

[8]  Jian-Xin Xu,et al.  Consensus Based Approach for Economic Dispatch Problem in a Smart Grid , 2013, IEEE Transactions on Power Systems.

[9]  W. Ren Consensus strategies for cooperative control of vehicle formations , 2007 .

[10]  Stephen P. Boyd,et al.  Distributed average consensus with least-mean-square deviation , 2007, J. Parallel Distributed Comput..

[11]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[12]  Stephen P. Boyd,et al.  Fastest Mixing Markov Chain on Graphs with Symmetries , 2007, SIAM J. Optim..

[13]  Minyue Fu,et al.  A Barycentric Coordinate Based Distributed Localization Algorithm for Sensor Networks , 2014, IEEE Transactions on Signal Processing.

[14]  Asuman E. Ozdaglar,et al.  Constrained Consensus and Optimization in Multi-Agent Networks , 2008, IEEE Transactions on Automatic Control.

[15]  Shihua Li,et al.  Finite-time consensus algorithm for multi-agent systems with double-integrator dynamics , 2011, Autom..

[16]  Gordon F. Royle,et al.  Algebraic Graph Theory , 2001, Graduate texts in mathematics.

[17]  John N. Tsitsiklis,et al.  Convergence of Type-Symmetric and Cut-Balanced Consensus Seeking Systems , 2011, IEEE Transactions on Automatic Control.

[18]  Stephen P. Boyd,et al.  Minimizing Effective Resistance of a Graph , 2008, SIAM Rev..

[19]  Steven J. Gortler,et al.  Characterizing generic global rigidity , 2007, Ad Hoc Networks.

[20]  Christoforos N. Hadjicostis,et al.  Decentralized optimal dispatch of distributed energy resources , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[21]  Lili Wang,et al.  Affine formation of multi-agent systems over directed graphs , 2014, 53rd IEEE Conference on Decision and Control.

[22]  Sahin Albayrak,et al.  Spectral Analysis of Signed Graphs for Clustering, Prediction and Visualization , 2010, SDM.

[23]  J. Hendrickx,et al.  Rigid graph control architectures for autonomous formations , 2008, IEEE Control Systems.

[24]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[25]  Alireza Tahbaz-Salehi,et al.  A Necessary and Sufficient Condition for Consensus Over Random Networks , 2008, IEEE Transactions on Automatic Control.

[26]  A. Ōkubo Dynamical aspects of animal grouping: swarms, schools, flocks, and herds. , 1986, Advances in biophysics.

[27]  Otman A. Basir,et al.  Semi-Flocking Algorithm for Motion Control of Mobile Sensors in Large-Scale Surveillance Systems , 2015, IEEE Transactions on Cybernetics.

[28]  Stanley Wasserman,et al.  Social Network Analysis: Methods and Applications , 1994, Structural analysis in the social sciences.

[29]  Chao Zhai,et al.  A General Alignment Repulsion Algorithm for Flocking of Multi-Agent Systems , 2011, IEEE Transactions on Automatic Control.

[30]  Hongwei Zhang,et al.  Bipartite Consensus of Linear Multi-Agent Systems Over Signed Digraphs: An Output Feedback Control Approach , 2014 .

[31]  Jorge Cortés,et al.  Distributed algorithms for reaching consensus on general functions , 2008, Autom..

[32]  Brian D. O. Anderson,et al.  Localization in sparse networks using sweeps , 2006, MobiCom '06.

[33]  M. Degroot Reaching a Consensus , 1974 .

[34]  N. Abreu Old and new results on algebraic connectivity of graphs , 2007 .

[35]  Magnus Egerstedt,et al.  Graph Theoretic Methods in Multiagent Networks , 2010, Princeton Series in Applied Mathematics.

[36]  Kevin L. Moore,et al.  Consensus of positive real systems cascaded with a single integrator , 2015 .

[37]  Wei Xing Zheng,et al.  Consensus of multiple second-order vehicles with a time-varying reference signal under directed topology , 2011, Autom..

[38]  Manfredi Maggiore,et al.  Necessary and sufficient graphical conditions for formation control of unicycles , 2005, IEEE Transactions on Automatic Control.

[39]  Changbin Yu,et al.  Cluster consensus control of generic linear multi-agent systems under directed topology with acyclic partition , 2013, Autom..

[40]  Stephen P. Boyd Convex optimization of graph Laplacian eigenvalues , 2006 .

[41]  Kevin M. Passino,et al.  Biomimicry of bacterial foraging for distributed optimization and control , 2002 .

[42]  Daniela Pucci de Farias,et al.  Decentralized Resource Allocation in Dynamic Networks of Agents , 2008, SIAM J. Optim..

[43]  Walter Ukovich,et al.  A new class of consensus protocols for agent networks with discrete time dynamics , 2015, Autom..

[44]  AhnHyo-Sung,et al.  A survey of multi-agent formation control , 2015 .

[45]  Z. Qu,et al.  Cooperative Control of Dynamical Systems: Applications to Autonomous Vehicles , 2009 .

[46]  Stephen P. Boyd,et al.  Optimal Scaling of a Gradient Method for Distributed Resource Allocation , 2006 .

[47]  Milos S. Stankovic,et al.  Consensus based overlapping decentralized estimation with missing observations and communication faults , 2009, Autom..

[48]  Florian Dörfler,et al.  Synchronization in complex networks of phase oscillators: A survey , 2014, Autom..

[49]  Minyue Fu,et al.  Localizability and Distributed Localization of Sensor Networks using Relative Position Measurements , 2013 .

[50]  Milos S. Stankovic,et al.  Consensus Based Overlapping Decentralized Estimation With Missing Observations and Communication Faults , 2008 .

[51]  Lili Wang,et al.  Formation control of directed multi-agent networks based on complex Laplacian , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[52]  A.L. Swindlehurst,et al.  Discrete double integrator consensus , 2008, 2008 47th IEEE Conference on Decision and Control.

[53]  Gerhard Weiss,et al.  Multiagent systems: a modern approach to distributed artificial intelligence , 1999 .

[54]  Richard M. Murray,et al.  Recent Research in Cooperative Control of Multivehicle Systems , 2007 .

[55]  Jianghai Hu,et al.  A distributed continuous-time algorithm for network localization using angle-of-arrival information , 2014, Autom..

[56]  Minyue Fu,et al.  A fully distributed approach to formation maneuvering control of multi-agent systems , 2014, 53rd IEEE Conference on Decision and Control.

[57]  Gangfeng Yan,et al.  Pursuit formations with dynamic control gains , 2012 .

[58]  Jiming Chen,et al.  Semi-supervised Laplacian regularized least squares algorithm for localization in wireless sensor networks , 2011, Comput. Networks.

[59]  Wenyuan Xu,et al.  Cooperative localization using angle-of-arrival information , 2014, 11th IEEE International Conference on Control & Automation (ICCA).

[60]  Hao Xing,et al.  Distributed Bisection Method for Economic Power Dispatch in Smart Grid , 2015, IEEE Transactions on Power Systems.

[61]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[62]  R. Beard,et al.  Consensus of information under dynamically changing interaction topologies , 2004, Proceedings of the 2004 American Control Conference.

[63]  Wei Ding,et al.  Collective motions and formations under pursuit strategies on directed acyclic graphs , 2010, Autom..

[64]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1998 .

[65]  Wei Ren On Consensus Algorithms for Double-Integrator Dynamics , 2008, IEEE Trans. Autom. Control..

[66]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[67]  Haibo Jiang,et al.  Cluster anti-consensus in directed networks of multi-agents based on the Q-theory , 2014, J. Frankl. Inst..

[68]  Manfredi Maggiore,et al.  Distributed Control and Analysis of Coupled Cell Systems , 2008 .

[69]  John N. Tsitsiklis,et al.  Distributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms , 1984, 1984 American Control Conference.

[70]  Minyue Fu,et al.  Distributed Self Localization for Relative Position Sensing Networks in 2D Space , 2015, IEEE Transactions on Signal Processing.

[71]  Ali Jadbabaie,et al.  Distributed Geodesic Control Laws for Flocking of Nonholonomic Agents , 2007, IEEE Transactions on Automatic Control.

[72]  G. Hug,et al.  Distributed robust economic dispatch in power systems: A consensus + innovations approach , 2012, 2012 IEEE Power and Energy Society General Meeting.

[73]  Naomi Ehrich Leonard,et al.  Collective Motion, Sensor Networks, and Ocean Sampling , 2007, Proceedings of the IEEE.

[74]  Huajing Fang,et al.  Multi-agent consensus with time-varying delays and switching topologies , 2014 .

[75]  Jiangping Hu,et al.  Tracking control for multi-agent consensus with an active leader and variable topology , 2006, Autom..

[76]  J.N. Tsitsiklis,et al.  Convergence in Multiagent Coordination, Consensus, and Flocking , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[77]  Jorge Cortes,et al.  Distributed Control of Robotic Networks: A Mathematical Approach to Motion Coordination Algorithms , 2009 .

[78]  Manfredi Maggiore,et al.  State Agreement for Continuous-Time Coupled Nonlinear Systems , 2007, SIAM J. Control. Optim..

[79]  Jiming Chen,et al.  A Graph Embedding Method for Wireless Sensor Networks Localization , 2009, GLOBECOM 2009 - 2009 IEEE Global Telecommunications Conference.

[80]  Yun Xu,et al.  A fully distributed approach to resource allocation problem under directed and switching topologies , 2015, 2015 10th Asian Control Conference (ASCC).

[81]  Toru Namerikawa,et al.  Consensus-based cooperative formation control with collision avoidance for a multi-UAV system , 2014, 2014 American Control Conference.

[82]  Hyo-Sung Ahn,et al.  A survey of multi-agent formation control , 2015, Autom..

[83]  Zhiyun Lin,et al.  Complex Laplacian and pattern formation in multi-agent systems , 2012, 2012 24th Chinese Control and Decision Conference (CCDC).

[84]  Jing Wang,et al.  Consensus over networks with dynamic channels , 2008, 2008 American Control Conference.

[85]  Lili Wang,et al.  Distributed Formation Control of Multi-Agent Systems Using Complex Laplacian , 2014, IEEE Transactions on Automatic Control.

[86]  Zhiyun Lin,et al.  Double-graph formation control for co-leader vehicle networks , 2012, 2012 24th Chinese Control and Decision Conference (CCDC).

[87]  Kai Cai,et al.  Average consensus on general strongly connected digraphs , 2012, Autom..

[88]  Tianping Chen,et al.  Cluster Consensus in Discrete-Time Networks of Multiagents With Inter-Cluster Nonidentical Inputs , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[89]  Mireille E. Broucke,et al.  Local control strategies for groups of mobile autonomous agents , 2004, IEEE Transactions on Automatic Control.

[90]  Yongcan Cao,et al.  Convergence of sampled-data consensus algorithms for double-integrator dynamics , 2008, 2008 47th IEEE Conference on Decision and Control.

[91]  Soummya Kar,et al.  Distributed Sensor Localization in Random Environments Using Minimal Number of Anchor Nodes , 2008, IEEE Transactions on Signal Processing.

[92]  Samuel Martin,et al.  Multi-agent flocking under topological interactions , 2013, Syst. Control. Lett..

[93]  Yongcan Cao,et al.  Distributed Coordination of Multi-agent Networks , 2011 .

[94]  Ming Cao,et al.  Clustering in diffusively coupled networks , 2011, Autom..

[95]  Wei Wu,et al.  Cluster Synchronization of Linearly Coupled Complex Networks Under Pinning Control , 2009, IEEE Transactions on Circuits and Systems I: Regular Papers.

[96]  Jorge Cortés,et al.  Global and robust formation-shape stabilization of relative sensing networks , 2009, Autom..

[97]  Kao-Shing Hwang,et al.  Cooperative strategy based on adaptive Q-learning for robot soccer systems , 2004, IEEE Transactions on Fuzzy Systems.

[98]  Francesco Bullo,et al.  Distributed Control of Robotic Networks , 2009 .

[99]  Long Wang,et al.  Group consensus in multi-agent systems with switching topologies and communication delays , 2010, Syst. Control. Lett..

[100]  Tianping Chen,et al.  Cluster synchronization in networks of coupled nonidentical dynamical systems. , 2009, Chaos.

[101]  Peng Huanxin,et al.  Flocking control with communication noise based on second-order distributed consensus algorithm , 2012, 2012 Power Engineering and Automation Conference.

[102]  Randal W. Beard,et al.  Distributed Consensus in Multi-vehicle Cooperative Control - Theory and Applications , 2007, Communications and Control Engineering.

[103]  Ichiro Suzuki,et al.  Distributed motion coordination of multiple mobile robots , 1990, Proceedings. 5th IEEE International Symposium on Intelligent Control 1990.

[104]  Hyo-Sung Ahn,et al.  Formation Control and Network Localization via Orientation Alignment , 2014, IEEE Transactions on Automatic Control.

[105]  Luc Moreau,et al.  Stability of multiagent systems with time-dependent communication links , 2005, IEEE Transactions on Automatic Control.

[106]  Daizhan Cheng,et al.  Leader-following consensus of second-order agents with multiple time-varying delays , 2010, Autom..

[107]  Pierre-Alexandre Bliman,et al.  Average consensus problems in networks of agents with delayed communications , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[108]  Zhiyong Chen,et al.  Consensus Acceleration in a Class of Predictive Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[109]  Chen Shi-Hua,et al.  Cluster consensus of second-order multi-agent systems via pinning control , 2010 .

[110]  Cheng-Lin Liu,et al.  Robust consensus of multi-agent systems with diverse input delays and asymmetric interconnection perturbations , 2009, Autom..

[111]  Alessandro Giua,et al.  Leader-follower formation via complex Laplacian , 2013, Autom..

[112]  Huang Huang,et al.  H∞ control of distributed multi-agent formation systems with Toeplitz-based consensus algorithms , 2010, Proceedings of the 2010 American Control Conference.

[113]  R.W. Beard,et al.  Discrete-time average-consensus under switching network topologies , 2006, 2006 American Control Conference.

[114]  Qing Zhou,et al.  A Necessary and Sufficient Condition for Consensus of Continuous-Time Agents Over Undirected Time-Varying Networks , 2011, IEEE Transactions on Automatic Control.

[115]  Anton V. Proskurnikov,et al.  Consensus in switching symmetric networks of first-order agents with delayed relative measurements , 2013, 52nd IEEE Conference on Decision and Control.

[116]  Ιωαννησ Τσιτσικλησ,et al.  PROBLEMS IN DECENTRALIZED DECISION MAKING AND COMPUTATION , 1984 .

[117]  Wei Ren,et al.  Consensus strategies for cooperative control of vehicle formations , 2007 .

[118]  Minyue Fu,et al.  A linear control approach to distributed multi-agent formations in d-dimensional space , 2013, 52nd IEEE Conference on Decision and Control.

[119]  Lili Wang,et al.  A linear approach to formation control under directed and switching topologies , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[120]  Randal W. Beard,et al.  Consensus seeking in multiagent systems under dynamically changing interaction topologies , 2005, IEEE Transactions on Automatic Control.

[121]  Chen Shi-Hua,et al.  Cluster Consensus of Nonlinearly Coupled Multi-Agent Systems in Directed Graphs , 2010 .

[122]  Junping Du,et al.  Flocking for multi-agent systems with switching topology in a noisy environment , 2008, 2008 American Control Conference.

[123]  Xiwei Liu,et al.  Cluster Synchronization in Directed Networks Via Intermittent Pinning Control , 2011, IEEE Transactions on Neural Networks.

[124]  Zuren Feng,et al.  Flocking of multi-agents based on consensus protocol and pinning control , 2012, Proceedings of the 10th World Congress on Intelligent Control and Automation.

[125]  Kostas Daniilidis,et al.  Vision-based control laws for distributed flocking of nonholonomic agents , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[126]  Fabio Morbidi,et al.  The deformed consensus protocol , 2013, Autom..

[127]  Kai Cai,et al.  Average Consensus on Arbitrary Strongly Connected Digraphs With Time-Varying Topologies , 2013, IEEE Transactions on Automatic Control.

[128]  Lili Wang,et al.  Local formation control strategies with undetermined and determined formation scales for co-leader vehicle networks , 2013, 52nd IEEE Conference on Decision and Control.

[129]  Wei Ren,et al.  Information consensus in multivehicle cooperative control , 2007, IEEE Control Systems.