Submodularity in Dynamics and Control of Networked Systems

This book presents a framework for the control of networked systems utilizing submodular optimization techniques. The main focus is on selecting input nodes for the control of networked systems, an inherently discrete optimization problem with applications in power system stability, social influence dynamics, and the control of vehicle formations. The first part of the book is devoted to background information on submodular functions, matroids, and submodular optimization, and presents algorithms for distributed submodular optimization that are scalable to large networked systems.In turn, the second part develops a unifying submodular optimization approach to controlling networked systems based on multiple performance and controllability criteria. Techniques are introduced for selecting input nodes to ensure smooth convergence, synchronization, and robustness to environmental and adversarial noise. Submodular optimization is the first unifying approach towards guaranteeing both performance and controllability with provable optimality bounds in static as well as time-varying networks. Throughout the text, the submodular framework is illustrated with the help of numerical examples and application-based case studies in biological, energy and vehicular systems.The book effectively combines two areas of growing interest, and will be especially useful for researchers in control theory, applied mathematics, networking or machine learning with experience in submodular optimization but who are less familiar with the problems and tools available for networked systems (or vice versa). It will also benefit graduate students, offering consistent terminology and notation that greatly reduces the initial effort associated with beginning a course of study in a new area.

[1]  A. Winfree.  Biological rhythms and the behavior of populations of coupled oscillators. , 1967, Journal of theoretical biology.

[2]  Ching-tai Lin.  Structural controllability , 1974 .

[3]  M. Degroot.  Reaching a Consensus , 1974 .

[4]  Yoshiki Kuramoto,et al.  Self-entrainment of a population of coupled non-linear oscillators , 1975 .

[5]  J. P. Corfmat,et al.  Structurally controllable and structurally canonical systems , 1976 .

[6]  E. Seneta,et al.  Towards consensus: some convergence theorems on repeated averaging , 1977, Journal of Applied Probability.

[7]  Laurence A. Wolsey,et al.  Best Algorithms for Approximating the Maximum of a Submodular Set Function , 1978, Math. Oper. Res..

[8]  M. L. Fisher,et al.  An analysis of approximations for maximizing submodular set functions—I , 1978, Math. Program..

[9]  R. F. Sincovec,et al.  Solvability, controllability, and observability of continuous descriptor systems , 1981 .

[10]  Laurence A. Wolsey,et al.  An analysis of the greedy algorithm for the submodular set covering problem , 1982, Comb..

[11]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[12]  Peter G. Doyle,et al.  Random Walks and Electric Networks: REFERENCES , 1987 .

[13]  Arthur R. Bergen,et al.  Power Systems Analysis , 1986 .

[14]  K. Murota.  Refined study on structural controllability of descriptor systems by means of matroids , 1987 .

[15]  J. Jalife,et al.  Mechanisms of Sinoatrial Pacemaker Synchronization: A New Hypothesis , 1987, Circulation research.

[16]  Laurence A. Wolsey,et al.  Integer and Combinatorial Optimization , 1988 .

[17]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[18]  S. Strogatz,et al.  Synchronization of pulse-coupled biological oscillators , 1990 .

[19]  Satoru Fujishige,et al.  Submodular functions and optimization , 1991 .

[20]  James G. Oxley,et al.  Matroid theory , 1992 .

[21]  Kazuo Murota,et al.  Disturbance Decoupling with Pole Placement for Structured Systems: A Graph-Theoretic Approach , 1995, SIAM J. Matrix Anal. Appl..

[22]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[23]  W. Klimesch.  Memory processes, brain oscillations and EEG synchronization. , 1996, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[24]  Kurths,et al.  Phase synchronization of chaotic oscillators. , 1996, Physical review letters.

[25]  K. Reinschke,et al.  Digraph characterization of structural controllability for linear descriptor systems , 1997 .

[26]  U. Feige.  A threshold of ln n for approximating set cover , 1998, JACM.

[27]  Xiaoyan Hong,et al.  A group mobility model for ad hoc wireless networks , 1999, MSWiM '99.

[28]  M. Mesbahi,et al.  Graphs, matrix inequalities, and switching for the formation flying control of multiple spacecraft , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[29]  S. Strogatz.  From Kuramoto to Crawford: exploring the onset of synchronization in populations of coupled oscillators , 2000 .

[30]  Vijay Kumar,et al.  Modeling and control of formations of nonholonomic mobile robots , 2001, IEEE Trans. Robotics Autom..

[31]  David R. Karger,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM '01.

[32]  A. Oliviero,et al.  Movement-related changes in synchronization in the human basal ganglia. , 2002, Brain : a journal of neurology.

[33]  Paolo Santi,et al.  The Node Distribution of the Random Waypoint Mobility Model for Wireless Ad Hoc Networks , 2003, IEEE Trans. Mob. Comput..

[34]  Eitan Altman,et al.  S-modular games and power control in wireless networks , 2003, IEEE Trans. Autom. Control..

[35]  Christian Commault,et al.  Generic properties and control of linear structured systems: a survey , 2003, Autom..

[36]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[37]  John G. Proakis.  Spread Spectrum Signals for Digital Communications , 2003 .

[38]  Alexander Schrijver,et al.  Combinatorial optimization. Polyhedra and efficiency. , 2003 .

[39]  Petter Ögren,et al.  Cooperative control of mobile sensor networks:Adaptive gradient climbing in a distributed environment , 2004, IEEE Transactions on Automatic Control.

[40]  Kamesh Munagala,et al.  Local Search Heuristics for k-Median and Facility Location Problems , 2004, SIAM J. Comput..

[41]  A. Mikhailov,et al.  Entrainment of randomly coupled oscillator networks by a pacemaker. , 2004, Physical review letters.

[42]  R. Eckhorn,et al.  Coherent oscillations: A mechanism of feature linking in the visual cortex? , 1988, Biological Cybernetics.

[43]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[44]  L. Moreau,et al.  Stability of continuous-time distributed consensus algorithms , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[45]  Mehran Mesbahi,et al.  Agreement over random networks , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[46]  H.G. Tanner,et al.  On the controllability of nearest neighbor interconnections , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[47]  A. Jadbabaie,et al.  On the stability of the Kuramoto model of coupled nonlinear oscillators , 2005, Proceedings of the 2004 American Control Conference.

[48]  F. Paganini,et al.  Global considerations on the Kuramoto model of sinusoidally coupled oscillators , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[49]  Jeff S. Shamma,et al.  Dynamic fictitious play, dynamic gradient play, and distributed convergence to Nash equilibria , 2005, IEEE Transactions on Automatic Control.

[50]  Juan P. Torres,et al.  The Kuramoto model: A simple paradigm for synchronization phenomena , 2005 .

[51]  Prabhakar Raghavan,et al.  The electrical resistance of a graph captures its commute and cover times , 2005, computational complexity.

[52]  Bernard P. Brooks,et al.  The Brouwer Fixed Point Theorem applied to rumour transmission , 2006, Appl. Math. Lett..

[53]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[54]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[55]  P. Barooah,et al.  Graph Effective Resistance and Distributed Control: Spectral Properties and Applications , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[56]  M. Egerstedt,et al.  Leader-based multi-agent coordination: controllability and optimal control , 2006, 2006 American Control Conference.

[57]  Aranyak Mehta,et al.  A Note on Approximate Nash Equilibria , 2006, WINE.

[58]  S. Strogatz,et al.  The size of the sync basin. , 2006, Chaos.

[59]  Gábor Lugosi,et al.  Prediction, learning, and games , 2006 .

[60]  Sergio D. Servetto,et al.  On the scalability of cooperative time synchronization in pulse-connected networks , 2005, IEEE Transactions on Information Theory.

[61]  Reza Olfati-Saber,et al.  Flocking for multi-agent dynamic systems: algorithms and theory , 2006, IEEE Transactions on Automatic Control.

[62]  João Pedro Hespanha,et al.  Distributed Optimal Estimation from Relative Measurements for Localization and Time Synchronization , 2006, DCOSS.

[63]  Vahab S. Mirrokni,et al.  Maximizing Non-Monotone Submodular Functions , 2011, 48th Annual IEEE Symposium on Foundations of Computer Science (FOCS'07).

[64]  Stephen P. Boyd,et al.  Distributed average consensus with least-mean-square deviation , 2007, J. Parallel Distributed Comput..

[65]  R. Sepulchre,et al.  Oscillator Models and Collective Motion , 2007, IEEE Control Systems.

[66]  Andreas Krause,et al.  Selecting Observations against Adversarial Objectives , 2007, NIPS.

[67]  Jan Vondrák,et al.  Maximizing a Submodular Set Function Subject to a Matroid Constraint (Extended Abstract) , 2007, IPCO.

[68]  G. Filatrella,et al.  Analysis of a power grid using a Kuramoto-like model , 2007, 0705.1305.

[69]  Giancarlo Ferrari-Trecate,et al.  Containment Control in Mobile Networks , 2008, IEEE Transactions on Automatic Control.

[70]  Elizabeth L. Wilmer,et al.  Markov Chains and Mixing Times , 2008 .

[71]  Antonio Bicchi,et al.  Steering a Leader-Follower Team Via Linear Consensus , 2008, HSCC.

[72]  Matthew J. Streeter,et al.  An Online Algorithm for Maximizing Submodular Functions , 2008, NIPS.

[73]  Yoav Shoham,et al.  Multiagent Systems - Algorithmic, Game-Theoretic, and Logical Foundations , 2009 .

[74]  Andrea E. F. Clementi,et al.  Minimum-Energy Broadcast and disk cover in grid wireless networks , 2006, Theor. Comput. Sci..

[75]  Randal W. Beard,et al.  Distributed Consensus in Multi-vehicle Cooperative Control - Theory and Applications , 2007, Communications and Control Engineering.

[76]  Wei Ren.  On Consensus Algorithms for Double-Integrator Dynamics , 2008, IEEE Trans. Autom. Control..

[77]  Brian D. O. Anderson,et al.  Reaching a Consensus in a Dynamically Changing Environment: Convergence Rates, Measurement Delays, and Asynchronous Events , 2008, SIAM J. Control. Optim..

[78]  Andreas Krause,et al.  Near-Optimal Sensor Placements in Gaussian Processes: Theory, Efficient Algorithms and Empirical Studies , 2008, J. Mach. Learn. Res..

[79]  Alireza Tahbaz-Salehi,et al.  A Necessary and Sufficient Condition for Consensus Over Random Networks , 2008, IEEE Transactions on Automatic Control.

[80]  Guangming Xie,et al.  Controllability of a Leader–Follower Dynamic Network With Switching Topology , 2008, IEEE Transactions on Automatic Control.

[81]  S. Strogatz,et al.  Stability diagram for the forced Kuramoto model. , 2008, Chaos.

[82]  Jurgen Kurths,et al.  Synchronization in complex networks , 2008, 0805.2976.

[83]  Sui Huang.  Reprogramming cell fates: reconciling rarity with robustness , 2009, BioEssays : news and reviews in molecular, cellular and developmental biology.

[84]  Devavrat Shah,et al.  Gossip Algorithms , 2009, Found. Trends Netw..

[85]  Magnus Egerstedt,et al.  Controllability of Multi-Agent Systems from a Graph-Theoretic Perspective , 2009, SIAM J. Control. Optim..

[86]  John N. Tsitsiklis,et al.  Convergence Speed in Distributed Consensus and Averaging , 2009, SIAM J. Control. Optim..

[87]  Mark W. Spong,et al.  On Exponential Synchronization of Kuramoto Oscillators , 2009, IEEE Transactions on Automatic Control.

[88]  Philip J. Hahn,et al.  Network perspectives on the mechanisms of deep brain stimulation , 2010, Neurobiology of Disease.

[89]  Vivek S. Borkar,et al.  Manufacturing consent , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[90]  Andreas Krause,et al.  Online distributed sensor selection , 2010, IPSN '10.

[91]  J. L. Hudson,et al.  Synchronization engineering: tuning the phase relationship between dissimilar oscillators using nonlinear feedback , 2010, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[92]  José M. F. Moura,et al.  Weight Optimization for Consensus Algorithms With Correlated Switching Topology , 2009, IEEE Transactions on Signal Processing.

[93]  Tim Roughgarden,et al.  Algorithmic Game Theory , 2007 .

[94]  Magnus Egerstedt,et al.  Graph Theoretic Methods in Multiagent Networks , 2010, Princeton Series in Applied Mathematics.

[95]  Florian Dörfler,et al.  Synchronization and transient stability in power networks and non-uniform Kuramoto oscillators , 2009, Proceedings of the 2010 American Control Conference.

[96]  Roberto Baldoni,et al.  Coupling-Based Internal Clock Synchronization for Large-Scale Dynamic Distributed Systems , 2010, IEEE Transactions on Parallel and Distributed Systems.

[97]  Jan Vondrák,et al.  Dependent Randomized Rounding via Exchange Properties of Combinatorial Structures , 2010, 2010 IEEE 51st Annual Symposium on Foundations of Computer Science.

[98]  Amr El Abbadi,et al.  Convergence Rates of Distributed Average Consensus With Stochastic Link Failures , 2010, IEEE Transactions on Automatic Control.

[99]  Bassam Bamieh,et al.  Leader selection for optimal network coherence , 2010, 49th IEEE Conference on Decision and Control (CDC).

[100]  Fu Lin,et al.  Algorithms for leader selection in large dynamical networks: Noise-free leaders , 2011, IEEE Conference on Decision and Control and European Control Conference.

[101]  Philipp Birken,et al.  Numerical Linear Algebra , 2011, Encyclopedia of Parallel Computing.

[102]  Andreas Krause,et al.  Simultaneous Optimization of Sensor Placements and Balanced Schedules , 2011, IEEE Transactions on Automatic Control.

[103]  Magnus Egerstedt,et al.  Containment in leader-follower networks with switching communication topologies , 2011, Autom..

[104]  Lisa Zhang,et al.  Scheduling Algorithms for Multicarrier Wireless Data Systems , 2007, IEEE/ACM Transactions on Networking.

[105]  Lav R. Varshney,et al.  Structural Properties of the Caenorhabditis elegans Neuronal Network , 2009, PLoS Comput. Biol..

[106]  Albert-László Barabási,et al.  Controllability of complex networks , 2011, Nature.

[107]  Fu Lin,et al.  Algorithms for leader selection in large dynamical networks: Noise-corrupted leaders , 2011, IEEE Conference on Decision and Control and European Control Conference.

[108]  Naomi Ehrich Leonard,et al.  Decision versus compromise for animal groups in motion , 2011, Proceedings of the National Academy of Sciences.

[109]  Henry Stark,et al.  Probability, Statistics, and Random Processes for Engineers , 2011 .

[110]  P. Tass,et al.  Macroscopic entrainment of periodically forced oscillatory ensembles. , 2011, Progress in biophysics and molecular biology.

[111]  U. Feige,et al.  Maximizing Non-monotone Submodular Functions , 2011 .

[112]  Kai Cai,et al.  Convergence time analysis of quantized gossip consensus on digraphs , 2011, Autom..

[113]  Bassam Bamieh,et al.  Coherence in Large-Scale Networks: Dimension-Dependent Limitations of Local Feedback , 2011, IEEE Transactions on Automatic Control.

[114]  Radha Poovendran,et al.  On leader selection for performance and controllability in multi-agent systems , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[115]  Fu Lin,et al.  Optimal Control of Vehicular Formations With Nearest Neighbor Interactions , 2011, IEEE Transactions on Automatic Control.

[116]  Richard M. Murray,et al.  Decentralised minimal-time dynamic consensus , 2012, 2012 American Control Conference (ACC).

[117]  Yixin Chen,et al.  Submodular game for distributed application allocation in shared sensor networks , 2012, 2012 Proceedings IEEE INFOCOM.

[118]  Pablo A. Parrilo,et al.  Convex graph invariants , 2012, CISS.

[119]  Radha Poovendran,et al.  Leader selection for minimizing convergence error in leader-follower systems: A supermodular optimization approach , 2012, 2012 10th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks (WiOpt).

[120]  Alexandros G. Dimakis,et al.  FemtoCaching: Wireless video content delivery through distributed caching helpers , 2011, 2012 Proceedings IEEE INFOCOM.

[121]  Yongqiang Wang,et al.  Exponential Synchronization Rate of Kuramoto Oscillators in the Presence of a Pacemaker , 2012, IEEE Transactions on Automatic Control.

[122]  Jörg Raisch,et al.  On the weight controllability of consensus algorithms , 2013, 2013 European Control Conference (ECC).

[123]  F. Bullo,et al.  Synchronization in complex oscillator networks and smart grids , 2012, Proceedings of the National Academy of Sciences.

[124]  Naomi Ehrich Leonard,et al.  Information centrality and optimal leader selection in noisy networks , 2013, 52nd IEEE Conference on Decision and Control.

[125]  Zheng Wen,et al.  Adaptive Submodular Maximization in Bandit Setting , 2013, NIPS.

[126]  Radha Poovendran,et al.  Joint leader and link weight selection for fast convergence in multi-agent systems , 2013, 2013 American Control Conference.

[127]  P. Olver.  Nonlinear Systems , 2013 .

[128]  Wenwu Yu,et al.  An Overview of Recent Progress in the Study of Distributed Multi-Agent Coordination , 2012, IEEE Transactions on Industrial Informatics.

[129]  Francesco Bullo,et al.  Controllability Metrics and Algorithms for Complex Networks , 2013, ArXiv.

[130]  Mehran Mesbahi,et al.  On strong structural controllability of networked systems: A constrained matching approach , 2013, 2013 American Control Conference.

[131]  Andreas Krause,et al.  Submodular Function Maximization , 2014, Tractability.

[132]  Derek Ruths,et al.  Control Profiles of Complex Networks , 2014, Science.

[133]  Basel Alomair,et al.  Minimizing Convergence Error in Multi-Agent Systems Via Leader Selection: A Supermodular Optimization Approach , 2013, IEEE Transactions on Automatic Control.

[134]  Radha Poovendran,et al.  A Supermodular Optimization Framework for Leader Selection Under Link Noise in Linear Multi-Agent Systems , 2012, IEEE Transactions on Automatic Control.

[135]  Alexander Olshevsky,et al.  Minimum input selection for structural controllability , 2014, 2015 American Control Conference (ACC).

[136]  Éva Tardos,et al.  Maximizing the Spread of Influence through a Social Network , 2015, Theory Comput..

[137]  Joseph Naor,et al.  A Tight Linear Time (1/2)-Approximation for Unconstrained Submodular Maximization , 2015, SIAM J. Comput..

[138]  L. Asz.  Random Walks on Graphs: a Survey , 2022 .