Delay robustness in cooperative control

The robustness of various cooperative control schemes on large scale networked systems with respect to heterogeneous communication and coupling delays is investigated. The presented results provide delay-dependent and delay-independent conditions that guarantee consensus, rendezvous, flocking, and synchronization in different classes of multi-agent systems (MAS). All conditions are scalable to arbitrarily large multi-agent systems with non-identical agent dynamics. In particular, conditions for linear agents, for nonlinear agents with relative degree one, and for a class of nonlinear agents with relative degree two are presented. The interconnection topology between the agents is in most cases represented by an undirected graph. The results for nonlinear agents with relative degree one hold also for the more general case of directed graphs with switching topologies. Different delay configurations are investigated and compared. These configurations represent different ways how the delays affect the coupling between the agents. The presented robustness analysis considers constant, time-varying, and distributed delays in order to take different sources of delays into account. The results are applied to several typical applications and simulations illustrate the findings. The main contributions of this thesis include: (i) Consensus and rendezvous in single integrator MAS are robust to arbitrarily large delays even on switching topologies. However, the convergence rate of this MAS is delay-dependent and scalable convergence rate conditions are presented. (ii) Consensus and rendezvous in relative degree two MAS are robust to sufficiently small delays. Local, scalable conditions are derived for these MAS that guarantee consensus and rendezvous for bounded delays. (iii) Finally, the derived delay robustness analysis for general linear MAS allows for the first time to compare different delay configurations in a unifying framework. In dieser Dissertation wird die Robustheit von verschiedenen kooperierenden Regelungen bezuglich heterogener Kommunikations- und Kopplungsverzogerungen untersucht. Es werden skalierbare Analysemethoden fur Konsens, Rendezvous, Herdenverhalten (engl. flocking) und Synchronisation fur verschiedene Klassen von linearen und nichtlinearen Agentensystemen (engl. multi-agent systems) vorgestellt. Die Ergebnisse werden auf verschiedene typische Anwendungen ubertragen und durch Simulationen veranschaulicht.

[1]  George J. Pappas,et al.  Flocking in Fixed and Switching Networks , 2007, IEEE Transactions on Automatic Control.

[2]  Glenn Vinnicombe,et al.  Scalable robust stability for nonsymmetric heterogeneous networks , 2007, Autom..

[3]  E. Eisenberg,et al.  CONSENSUS OF SUBJECTIVE PROBABILITIES: THE PARI-MUTUEL METHOD, , 1959 .

[4]  Mark W. Spong,et al.  Passivity-Based Control of Multi-Agent Systems , 2006 .

[5]  Charles R. Johnson,et al.  Topics in Matrix Analysis , 1991 .

[6]  Michael D. Lemmon,et al.  Convergence of consensus filtering under network throughput limitations , 2007, 2007 46th IEEE Conference on Decision and Control.

[7]  Fatihcan M. Atay,et al.  Stability of Coupled Map Networks with Delays , 2006, SIAM J. Appl. Dyn. Syst..

[8]  Antonis Papachristodoulou,et al.  Global Stability Analysis of Primal Internet Congestion Control Schemes with Heterogeneous Delays , 2008 .

[9]  Richard M. Murray,et al.  Information flow and cooperative control of vehicle formations , 2004, IEEE Transactions on Automatic Control.

[10]  Ulf T. Jönsson,et al.  A Scalable Robust Stability Criterion for Systems With Heterogeneous LTI Components , 2009, IEEE Transactions on Automatic Control.

[11]  C.T. Abdallah,et al.  Practical issues in networked control systems , 2006, 2006 American Control Conference.

[12]  K. Aihara,et al.  A model of periodic oscillation for genetic regulatory systems , 2002 .

[13]  Antonis Papachristodoulou,et al.  Multi-agent system consensus in packet-switched networks , 2007, 2007 European Control Conference (ECC).

[14]  R. Olfati-Saber.  Ultrafast consensus in small-world networks , 2005, Proceedings of the 2005, American Control Conference, 2005..

[15]  Glenn Vinnicombe,et al.  Scalable robustness for consensus protocols with heterogeneous dynamics , 2005 .

[16]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[17]  Ruggero Carli,et al.  Quantized Coordination Algorithms for Rendezvous and Deployment , 2009, SIAM J. Control. Optim..

[18]  Frank Allgöwer,et al.  Robust Consensus Controller Design for Nonlinear Relative Degree Two Multi-Agent Systems With Communication Constraints , 2011, IEEE Transactions on Automatic Control.

[19]  Lacra Pavel,et al.  An analysis of stability with time-delay of link level power control in optical networks , 2009, Autom..

[20]  K. Hasebe,et al.  Structure stability of congestion in traffic dynamics , 1994 .

[21]  P.J. Antsaklis,et al.  Information consensus of asynchronous discrete-time multi-agent systems , 2005, Proceedings of the 2005, American Control Conference, 2005..

[22]  C. Desoer,et al.  On the generalized Nyquist stability criterion , 1979, 1979 18th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[23]  S. Strogatz,et al.  Time Delay in the Kuramoto Model of Coupled Oscillators , 1998, chao-dyn/9807030.

[24]  Randal W. Beard,et al.  Distributed Consensus in Multi-vehicle Cooperative Control - Theory and Applications , 2007, Communications and Control Engineering.

[25]  Jean-Pierre Richard,et al.  Time-delay systems: an overview of some recent advances and open problems , 2003, Autom..

[26]  Z. K. Liu,et al.  Dynamical Systems with Multiple Time-Varying Delays: Stability and Stabilizability , 2000 .

[27]  Emilia Fridman,et al.  Robust sampled-data stabilization of linear systems: an input delay approach , 2004, Autom..

[28]  Wim Michiels,et al.  Stabilization of time-delay systems with a Controlled time-varying delay and applications , 2005, IEEE Transactions on Automatic Control.

[29]  Wassim M. Haddad,et al.  On System State Equipartitioning and Semistability in Network Dynamical Systems with Arbitrary Time-Delays , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[30]  Glenn Vinnicombe,et al.  On the stability of the Foschini-Miljanic algorithm with time-delays , 2008, 2008 47th IEEE Conference on Decision and Control.

[31]  Mehran Mesbahi,et al.  Agreement over random networks , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[32]  Carlos Silvestre,et al.  Synchronization in multi-agent systems with switching topologies and non-homogeneous communication delays , 2007, 2007 46th IEEE Conference on Decision and Control.

[33]  R. Srikant,et al.  Quantized Consensus , 2006, 2006 IEEE International Symposium on Information Theory.

[34]  F. Allgöwer,et al.  Nonlinear Multi-Agent System Consensus with Time-Varying Delays , 2008 .

[35]  Vladimir L. Kharitonov,et al.  Stability of Time-Delay Systems , 2003, Control Engineering.

[36]  D. Helbing.  Traffic and related self-driven many-particle systems , 2000, cond-mat/0012229.

[37]  Asuman E. Ozdaglar,et al.  Convergence rate for consensus with delays , 2010, J. Glob. Optim..

[38]  Rifat Sipahi,et al.  A survey of deterministic time delay traffic flow models , 2007 .

[39]  Jared R. Leadbetter,et al.  Control in an Information Rich World Report of the Panel on Future Directions in Control , Dynamics , and Systems , 2002 .

[40]  Ulf T. Jönsson,et al.  Characterization of Robust Stability of a Class of Interconnected Systems , 2007, 2007 American Control Conference.

[41]  Lacra Pavel,et al.  A stability analysis with time-delay of primal-dual power control in optical links , 2009, Autom..

[42]  D. Peaucelle,et al.  Stability of Time-Delay Systems with Non-Small Delay , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[43]  Kazuyuki Aihara,et al.  Construction of genetic oscillators with interlocked feedback networks. , 2006, Journal of theoretical biology.

[44]  Rodolphe Sepulchre,et al.  Geometry and Symmetries in Coordination Control , 2009 .

[45]  Naomi Ehrich Leonard,et al.  Stabilization of Planar Collective Motion With Limited Communication , 2008, IEEE Transactions on Automatic Control.

[46]  Frank Allgöwer,et al.  Multi-agent speed consensus via delayed position feedback with application to Kuramoto oscillators , 2009, 2009 European Control Conference (ECC).

[47]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[48]  J. Tyson,et al.  Design principles of biochemical oscillators , 2008, Nature Reviews Molecular Cell Biology.

[49]  Rayadurgam Srikant,et al.  The Mathematics of Internet Congestion Control , 2003 .

[50]  Henk Nijmeijer,et al.  Synchronization of delay-coupled nonlinear oscillators: an approach based on the stability analysis of synchronized equilibria. , 2009, Chaos.

[51]  John J. Tyson,et al.  Biochemical Oscillations , 2004 .

[52]  Frank Allgöwer,et al.  Model predictive control of constrained nonlinear time-delay systems , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[53]  Tal Shima,et al.  Special Issue on Analysis and Control of Multi-Agent Dynamic Systems , 2007 .

[54]  M. Degroot.  Reaching a Consensus , 1974 .

[55]  Tudor C. Ionescu,et al.  TOPICS IN TIME DELAY SYSTEMS: ANALYSIS, ALGORITHMS AND CONTROL , 2009 .

[56]  Reza Olfati-Saber,et al.  Flocking for multi-agent dynamic systems: algorithms and theory , 2006, IEEE Transactions on Automatic Control.

[57]  Jim M Cushing,et al.  Integrodifferential Equations and Delay Models in Population Dynamics , 1977 .

[58]  Sergio Barbarossa,et al.  Distributed Decision Through Self-Synchronizing Sensor Networks in the Presence of Propagation Delays and Asymmetric Channels , 2007, IEEE Transactions on Signal Processing.

[59]  Karl Henrik Johansson,et al.  Consensus under communication delays , 2008, 2008 47th IEEE Conference on Decision and Control.

[60]  Frank Allgöwer,et al.  Delay robustness in consensus problems , 2010, Autom..

[61]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[62]  Dawn M. Tilbury,et al.  The Emergence of Industrial Control Networks for Manufacturing Control, Diagnostics, and Safety Data , 2007, Proceedings of the IEEE.

[63]  Gregor Goebel,et al.  Stabilization of linear systems with distributed input delay , 2010, Proceedings of the 2010 American Control Conference.

[64]  Tal Shima,et al.  UAV Cooperative Decision and Control: Challenges and Practical Approaches , 2008 .

[65]  Jay A. Farrell,et al.  Decentralized cooperative control of multiple nonholonomic dynamic systems with uncertainty , 2009, Autom..

[66]  Wim Michiels,et al.  Consensus Problems with Distributed Delays, with Application to Traffic Flow Models , 2009, SIAM J. Control. Optim..

[67]  Themistoklis Charalambous,et al.  On the stability of a power control algorithm for wireless networks in the presence of time-varying delays , 2009, 2009 European Control Conference (ECC).

[68]  Mrdjan J. Jankovic,et al.  Constructive Nonlinear Control , 2011 .

[69]  S. Niculescu,et al.  Stability and Stabilization of Time-Delay Systems: An Eigenvalue-Based Approach , 2007 .

[70]  Jing Wang,et al.  Consensus over networks with dynamic channels , 2008, 2008 American Control Conference.

[71]  Frank Allgöwer,et al.  L2-Gain based controller design for linear systems with distributed delays and rational delay kernels , 2007 .

[72]  Antonis Papachristodoulou,et al.  Delay Robustness of Nonlinear Internet Congestion Control Schemes , 2010, IEEE Transactions on Automatic Control.

[73]  Steven H. Strogatz,et al.  Nonlinear dynamics: Death by delay , 1998, Nature.

[74]  Marios M. Polycarpou,et al.  Cooperative Control of Distributed Multi-Agent Systems , 2001 .

[75]  R. Jackson.  Inequalities , 2007, Algebra for Parents.

[76]  R. Olfati-Saber,et al.  Consensus Filters for Sensor Networks and Distributed Sensor Fusion , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[77]  Gordon F. Royle,et al.  Algebraic Graph Theory , 2001, Graduate texts in mathematics.

[78]  Frank Allgöwer,et al.  Consensus in bistable and multistable multi-agent systems , 2010, 49th IEEE Conference on Decision and Control (CDC).

[79]  Panos J. Antsaklis,et al.  Special Issue on Technology of Networked Control Systems , 2007 .

[80]  C. Pennartz,et al.  A Mathematical Model for the Intracellular Circadian Rhythm Generator , 1999, The Journal of Neuroscience.

[81]  M. Pavella,et al.  Transient stability of power systems: Theory and practice , 1994 .

[82]  Frank Allgöwer,et al.  Generalized Nyquist consensus condition for high-order linear multi-agent systems with communication delays , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[83]  Nicole Radde,et al.  The Impact of Time Delays on the Robustness of Biological Oscillators and the Effect of Bifurcations on the Inverse Problem , 2008, EURASIP J. Bioinform. Syst. Biol..

[84]  Andre B. Bondi,et al.  Characteristics of scalability and their impact on performance , 2000, WOSP '00.

[85]  M. G. Earl,et al.  Synchronization in oscillator networks with delayed coupling: a stability criterion. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[86]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[87]  Alireza Tahbaz-Salehi,et al.  A Necessary and Sufficient Condition for Consensus Over Random Networks , 2008, IEEE Transactions on Automatic Control.

[88]  K. Hasebe,et al.  Analysis of optimal velocity model with explicit delay , 1998, patt-sol/9805002.

[89]  Long Wang,et al.  Asynchronous Consensus in Continuous-Time Multi-Agent Systems With Switching Topology and Time-Varying Delays , 2006, IEEE Transactions on Automatic Control.

[90]  Fatihcan M. Atay,et al.  Synchronization and Amplitude Death in Coupled Limit Cycle Oscillators with Time Delays , 2009 .

[91]  Romeo Ortega,et al.  Passivity-based Control of Euler-Lagrange Systems , 1998 .

[92]  Murat Arcak,et al.  Delay robustness of a class of nonlinear systems and applications to communication networks , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[93]  Pierre-Alexandre Bliman,et al.  Average consensus problems in networks of agents with delayed communications , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[94]  T. Vamos,et al.  Cooperative systems based on non-cooperative people , 1983, IEEE Control Systems Magazine.

[95]  D. Volfson,et al.  Delay-induced stochastic oscillations in gene regulation. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[96]  Frank Allgöwer,et al.  On topology and dynamics of consensus among linear high-order agents , 2011, Int. J. Syst. Sci..

[97]  Manfredi Maggiore,et al.  State Agreement for Continuous-Time Coupled Nonlinear Systems , 2007, SIAM J. Control. Optim..

[98]  Yingmin Jia,et al.  Consensus of second-order discrete-time multi-agent systems with nonuniform time-delays and dynamically changing topologies , 2009, Autom..

[99]  S. Strogatz.  From Kuramoto to Crawford: exploring the onset of synchronization in populations of coupled oscillators , 2000 .

[100]  Liu Chenglin,et al.  Consensus of Multi-agent System with Diverse Communication Delays , 2006, 2007 Chinese Control Conference.

[101]  Yoshiki Kuramoto,et al.  Chemical Oscillations, Waves, and Turbulence , 1984, Springer Series in Synergetics.

[102]  Luc Moreau,et al.  Stability of multiagent systems with time-dependent communication links , 2005, IEEE Transactions on Automatic Control.

[103]  John N. Tsitsiklis,et al.  Problems in decentralized decision making and computation , 1984 .

[104]  A. Jadbabaie,et al.  Synchronization in Oscillator Networks: Switching Topologies and Non-homogeneous Delays , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[105]  Carlos Silvestre,et al.  Continuous-time consensus with discrete-time communication , 2009, 2009 European Control Conference (ECC).

[106]  Yu-Ping Tian,et al.  Consensus of Multi-Agent Systems With Diverse Input and Communication Delays , 2008, IEEE Transactions on Automatic Control.

[107]  Frank Allgöwer,et al.  Stability of Networked Systems with Multiple Delays Using Linear Programming , 2007, 2007 American Control Conference.

[108]  Kazuyuki Aihara,et al.  Detection of cellular rhythms and global stability within interlocked feedback systems. , 2007, Mathematical biosciences.

[109]  Yu-Ping Tian,et al.  Coordination of Multi-Agent Systems with Communication Delays , 2008 .

[110]  Murat Arcak,et al.  Passivity as a Design Tool for Group Coordination , 2007, IEEE Transactions on Automatic Control.

[111]  Andrea L. Bertozzi,et al.  Stability of a second order consensus algorithm with time delay , 2008, 2008 47th IEEE Conference on Decision and Control.

[112]  Brian D. O. Anderson,et al.  Reaching a Consensus in a Dynamically Changing Environment: Convergence Rates, Measurement Delays, and Asynchronous Events , 2008, SIAM J. Control. Optim..

[113]  U. Feige,et al.  Spectral Graph Theory , 2015 .

[114]  Ian Postlethwaite,et al.  Multivariable Feedback Control: Analysis and Design , 1996 .

[115]  A. Jadbabaie,et al.  Effects of Delay in Multi-Agent Consensus and Oscillator Synchronization , 2010, IEEE Transactions on Automatic Control.

[116]  Glenn Vinnicombe,et al.  Scalable Decentralized Robust Stability Certificates for Networks of Interconnected Heterogeneous Dynamical Systems , 2006, IEEE Transactions on Automatic Control.

[117]  S. Niculescu.  Delay Effects on Stability: A Robust Control Approach , 2001 .

[118]  Francesco Bullo,et al.  Distributed Control of Robotic Networks , 2009 .

[119]  Linda Bushnell,et al.  Special issue on "collective behavior and control of multi-agent systems" , 2008 .

[120]  Frank Allgöwer,et al.  Robust Stability of Distributed Delay Systems , 2008 .

[121]  F. Allgöwer,et al.  Comparison of Different Stability Conditions for Linear Time-Delay Systems with Incommensurate Delays , 2009 .

[122]  F. Allgöwer,et al.  Generalized Nyquist Consensus Condition for Linear Multi Agent Systems with Heterogeneous Delays , 2009 .

[123]  I. Couzin,et al.  Effective leadership and decision-making in animal groups on the move , 2005, Nature.

[124]  K. Gu.  Refined discretized Lyapunov functional method for systems with multiple delays , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[125]  Craig W. Reynolds.  Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[126]  H. Roth,et al.  Remote control of mechatronic systems over communication networks , 2005, IEEE International Conference Mechatronics and Automation, 2005.

[127]  Mark W. Spong,et al.  Output Synchronization of Nonlinear Systems with Relative Degree One , 2008, Recent Advances in Learning and Control.

[128]  S. Mossaheb,et al.  A Nyquist type stability criterion for linear multivariable delayed systems , 1980 .

[129]  Irinel-Constantin Morarescu,et al.  Stability Crossing Curves of Shifted Gamma-Distributed Delay Systems , 2007, SIAM J. Appl. Dyn. Syst..

[130]  Glenn Vinnicombe,et al.  The S-hull approach to consensus , 2007, 2007 46th IEEE Conference on Decision and Control.

[131]  M. Spong,et al.  Agreement with non-uniform information delays , 2006, 2006 American Control Conference.

[132]  Irad Yavneh,et al.  Delays and Oscillations in Networks of Spiking Neurons: A Two-Timescale Analysis , 2009, Neural Computation.

[133]  D.M. Stipanovic,et al.  On synchronization and collision avoidance for mechanical systems , 2008, 2008 American Control Conference.

[134]  Frank Allgöwer,et al.  Consensus reaching in multi-agent packet-switched networks with non-linear coupling , 2009, Int. J. Control.

[135]  Mike McDonald,et al.  Car-following: a historical review , 1999 .

[136]  Dragan Obradovic,et al.  Synchronization Performance of the Precision Time Protocol in Industrial Automation Networks , 2009, IEEE Transactions on Instrumentation and Measurement.

[137]  Jay A. Farrell,et al.  Cooperative Control of Multiple Nonholonomic Mobile Agents , 2008, IEEE Transactions on Automatic Control.

[138]  Long Wang,et al.  Consensus protocols for discrete-time multi-agent systems with time-varying delays , 2008, Autom..

[139]  L. Moreau,et al.  Stability of continuous-time distributed consensus algorithms , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[140]  Ruiqi Wang,et al.  Modelling periodic oscillation of biological systems with multiple timescale networks. , 2004, Systems biology.

[141]  Frank Allgöwer,et al.  Output Consensus Controller Design for Nonlinear Relative Degree One Multi-Agent Systems with Delays* , 2009 .

[142]  Frank Allgöwer,et al.  Delay-dependent rendezvous and flocking of large scale multi-agent systems with communication delays , 2008, 2008 47th IEEE Conference on Decision and Control.

[143]  F. Allgöwer,et al.  On consensus in multi-agent systems with linear high-order agents , 2008 .