Distributed Submodular Maximization with Parallel Execution

The submodular maximization problem is widely applicable in many engineering problems where objectives exhibit diminishing returns. While this problem is known to be NP-hard for certain subclasses of objective functions, there is a greedy algorithm which guarantees approximation at least 1/2 of the optimal solution. This greedy algorithm can be implemented with a set of agents, each making a decision sequentially based on the choices of all prior agents. In this paper, we consider a generalization of the greedy algorithm in which agents can make decisions in parallel, rather than strictly in sequence. In particular, we are interested in partitioning the agents, where a set of agents in the partition all make a decision simultaneously based on the choices of prior agents, so that the algorithm terminates in limited iterations. We provide bounds on the performance of this parallelized version of the greedy algorithm and show that dividing the agents evenly among the sets in the partition yields an optimal structure. It is shown that such optimal structures holds even under very relaxed information constraints. We additionally show that this optimal structure is still near-optimal, even when additional information (i.e., total curvature) is known about the objective function.

[1]  Hui Lin,et al.  A Class of Submodular Functions for Document Summarization , 2011, ACL.

[2]  C. Guestrin,et al.  Near-optimal sensor placements: maximizing information while minimizing communication cost , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[3]  Martin Gairing,et al.  Covering Games: Approximation through Non-cooperation , 2009, WINE.

[4]  M. L. Fisher,et al.  An analysis of approximations for maximizing submodular set functions—I , 1978, Math. Program..

[5]  Jason R. Marden The Role of Information in Distributed Resource Allocation , 2017, IEEE Transactions on Control of Network Systems.

[6]  Nathan Michael,et al.  Distributed Submodular Maximization on Partition Matroids for Planning on Large Sensor Networks , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[7]  László Lovász,et al.  Submodular functions and convexity , 1982, ISMP.

[8]  Joseph Naor,et al.  A Tight Linear Time (1/2)-Approximation for Unconstrained Submodular Maximization , 2012, 2012 IEEE 53rd Annual Symposium on Foundations of Computer Science.

[9]  Joseph K. Bradley,et al.  Parallel Double Greedy Submodular Maximization , 2014, NIPS.

[10]  Jan Vondrák,et al.  Optimal approximation for the submodular welfare problem in the value oracle model , 2008, STOC.

[11]  Andreas Krause,et al.  Cost-effective outbreak detection in networks , 2007, KDD '07.

[12]  Huy L. Nguyen,et al.  A Parallel Double Greedy Algorithm for Submodular Maximization , 2018, ArXiv.

[13]  Andreas Krause,et al.  Distributed Submodular Maximization: Identifying Representative Elements in Massive Data , 2013, NIPS.

[14]  Jure Leskovec,et al.  Inferring networks of diffusion and influence , 2010, KDD.

[15]  Radha Poovendran,et al.  A submodular optimization framework for leader selection in linear multi-agent systems , 2011, IEEE Conference on Decision and Control and European Control Conference.

[16]  Michel Minoux,et al.  Accelerated greedy algorithms for maximizing submodular set functions , 1978 .

[17]  Jan Vondrák,et al.  Maximizing a Submodular Set Function Subject to a Matroid Constraint (Extended Abstract) , 2007, IPCO.

[18]  Andreas Krause,et al.  Efficient Planning of Informative Paths for Multiple Robots , 2006, IJCAI.

[19]  Basel Alomair,et al.  Submodularity in Dynamics and Control of Networked Systems , 2016 .

[20]  João Pedro Hespanha,et al.  Impact of information in greedy submodular maximization , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[21]  Na Li,et al.  Distributed greedy algorithm for multi-agent task assignment problem with submodular utility functions , 2019, Autom..

[22]  Bahman Gharesifard,et al.  On distributed submodular maximization with limited information , 2016, 2016 American Control Conference (ACC).

[23]  Éva Tardos,et al.  Maximizing the Spread of Influence through a Social Network , 2015, Theory Comput..