Distributed Submodular Maximization With Limited Information

We consider a class of distributed submodular maximization problems in which each agent must choose a single strategy from its strategy set. The global objective is to maximize a submodular function of the strategies chosen by each agent. When choosing a strategy, each agent has access to only a limited number of other agents’ choices. For each of its strategies, an agent can evaluate its marginal contribution to the global objective given its information. The main objective is to investigate how this limitation of information about the strategies chosen by other agents affects the performance when agents make choices according to a local greedy algorithm. In particular, we provide lower bounds on the performance of greedy algorithms for submodular maximization, which depend on the clique number of a graph that captures the information structure. We also characterize graph-theoretic upper bounds in terms of the chromatic number of the graph. Finally, we demonstrate how certain graph properties limit the performance of the greedy algorithm. Simulations on several common models for random networks demonstrate our results.

[1]  Dorian Mazauric,et al.  Analysis of Failures in Power Grids , 2017, IEEE Transactions on Control of Network Systems.

[2]  Andreas Krause,et al.  Distributed Submodular Maximization: Identifying Representative Elements in Massive Data , 2013, NIPS.

[3]  Mikael Johansson,et al.  A Randomized Incremental Subgradient Method for Distributed Optimization in Networked Systems , 2009, SIAM J. Optim..

[4]  Huy L. Nguyen,et al.  A New Framework for Distributed Submodular Maximization , 2015, 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS).

[5]  B. Bollobás,et al.  Cliques in random graphs , 1976, Mathematical Proceedings of the Cambridge Philosophical Society.

[6]  Robert Nowak,et al.  Distributed optimization in sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[7]  Giacomo Baggio,et al.  On the Role of Network Centrality in the Controllability of Complex Networks , 2015, IEEE Transactions on Control of Network Systems.

[8]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[9]  Stephen L. Smith,et al.  Submodularity and greedy algorithms in sensor scheduling for linear dynamical systems , 2015, Autom..

[10]  John N. Tsitsiklis,et al.  Distributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms , 1984, 1984 American Control Conference.

[11]  P. Stobbe,et al.  Convex Analysis for Minimizing and Learning Submodular Set Functions , 2013 .

[12]  S. Butenko,et al.  Clique , independent set , and graph coloring , 2010 .

[13]  Andreas Krause,et al.  Submodular Function Maximization , 2014, Tractability.

[14]  Jason R. Marden The Role of Information in Distributed Resource Allocation , 2017, IEEE Transactions on Control of Network Systems.

[15]  Asuman E. Ozdaglar,et al.  Constrained Consensus and Optimization in Multi-Agent Networks , 2008, IEEE Transactions on Automatic Control.

[16]  Basel Alomair,et al.  Scalable and distributed submodular maximization with matroid constraints , 2015, 2015 13th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt).

[17]  Jan Vondrák,et al.  Maximizing a Monotone Submodular Function Subject to a Matroid Constraint , 2011, SIAM J. Comput..

[18]  Maxim Sviridenko,et al.  Pipage Rounding: A New Method of Constructing Algorithms with Proven Performance Guarantee , 2004, J. Comb. Optim..

[19]  Stephen P. Boyd,et al.  Optimal Scaling of a Gradient Method for Distributed Resource Allocation , 2006 .

[20]  László Lovász,et al.  Submodular functions and convexity , 1982, ISMP.

[21]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[22]  Michael D. Lemmon,et al.  Event-triggered distributed optimization in sensor networks , 2009, 2009 International Conference on Information Processing in Sensor Networks.

[23]  M. L. Fisher,et al.  An analysis of approximations for maximizing submodular set functions—I , 1978, Math. Program..

[24]  Angelia Nedic,et al.  Distributed Optimization Over Time-Varying Directed Graphs , 2015, IEEE Trans. Autom. Control..

[25]  Bahman Gharesifard,et al.  On distributed submodular maximization with limited information , 2016, 2016 American Control Conference (ACC).

[26]  Bahman Gharesifard,et al.  Distributed Continuous-Time Convex Optimization on Weight-Balanced Digraphs , 2012, IEEE Transactions on Automatic Control.

[27]  Stephen L. Smith,et al.  Informative path planning as a maximum traveling salesman problem with submodular rewards , 2015, Discret. Appl. Math..

[28]  Andreas Krause,et al.  Distributed Submodular Maximization , 2014, J. Mach. Learn. Res..

[29]  Satoru Fujishige,et al.  Submodular functions and optimization , 1991 .