Sequence submodular maximization meets streaming

In this paper, we study the problem of maximizing a sequence submodular function in the streaming setting, where the utility function is defined on sequences instead of sets of elements. We encode the sequence submodular maximization with a weighted digraph, in which the weight of a vertex reveals the utility value in selecting a single element and the weight of an edge reveals the additional profit with respect to a certain selection sequence. The edges are visited in a streaming fashion and the aim is to sieve a sequence of at most k elements from the stream, such that the utility is maximized. In this work, we present an edge-based threshold procedure, which makes one pass over the stream, attains an approximation ratio of $$(1/(2\varDelta +1)- O(\epsilon ))$$ ( 1 / ( 2 Δ + 1 ) - O ( ϵ ) ) , consumes $$O(k\varDelta /\epsilon )$$ O ( k Δ / ϵ ) memory source in total and $$O(\log (k\varDelta )/\epsilon )$$ O ( log ( k Δ ) / ϵ ) update time per edge, where $$\varDelta $$ Δ is the minimum of the maximal outdegree and indegree of the directed graph.

[1]  Silvio Lattanzi,et al.  Submodular Streaming in All its Glory: Tight Approximation, Minimum Memory and Low Adaptive Complexity , 2019, ICML.

[2]  Jan Vondrák,et al.  Maximizing a Monotone Submodular Function Subject to a Matroid Constraint , 2011, SIAM J. Comput..

[3]  Wenruo Bai,et al.  Greed is Still Good: Maximizing Monotone Submodular+Supermodular Functions , 2018, ICML.

[4]  Andreas Krause,et al.  Streaming submodular maximization: massive data summarization on the fly , 2014, KDD.

[5]  Dachuan Xu,et al.  Sequence Submodular Maximization Meets Streaming , 2019, COCOA.

[6]  Huy L. Nguyen,et al.  Constrained Submodular Maximization: Beyond 1/e , 2016, 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS).

[7]  Yanjun Jiang,et al.  Approximating Robust Parameterized Submodular Function Maximization in Large-Scales , 2019, Asia Pac. J. Oper. Res..

[8]  Amin Karbasi,et al.  Do Less, Get More: Streaming Submodular Maximization with Subsampling , 2018, NeurIPS.

[9]  Niv Buchbinder,et al.  Deterministic (1/2 + ε)-Approximation for Submodular Maximization over a Matroid , 2018, SODA 2019.

[10]  Niv Buchbinder,et al.  Deterministic (1/2 + ε)-Approximation for Submodular Maximization over a Matroid , 2019, SODA.

[11]  Vahab S. Mirrokni,et al.  Maximizing Nonmonotone Submodular Functions under Matroid or Knapsack Constraints , 2009, SIAM J. Discret. Math..

[12]  Aaron Roth,et al.  Constrained Non-monotone Submodular Maximization: Offline and Secretary Algorithms , 2010, WINE.

[13]  Dachuan Xu,et al.  Non-submodular maximization on massive data streams , 2019, J. Glob. Optim..

[14]  U. Feige,et al.  Maximizing Non-monotone Submodular Functions , 2011 .

[15]  Dachuan Xu,et al.  Minimizing Ratio of Monotone Non-submodular Functions , 2019, Journal of the Operations Research Society of China.

[16]  Gérard Cornuéjols,et al.  Submodular set functions, matroids and the greedy algorithm: Tight worst-case bounds and some generalizations of the Rado-Edmonds theorem , 1984, Discret. Appl. Math..

[17]  Kent Quanrud,et al.  Streaming Algorithms for Submodular Function Maximization , 2015, ICALP.

[18]  M. L. Fisher,et al.  An analysis of approximations for maximizing submodular set functions—I , 1978, Math. Program..

[19]  Maxim Sviridenko,et al.  A note on maximizing a submodular set function subject to a knapsack constraint , 2004, Oper. Res. Lett..

[20]  Alexandros G. Dimakis,et al.  Streaming Weak Submodularity: Interpreting Neural Networks on the Fly , 2017, NIPS.

[21]  Moran Feldman,et al.  Making a Sieve Random: Improved Semi-Streaming Algorithm for Submodular Maximization under a Cardinality Constraint , 2019, ArXiv.

[22]  Yuichi Yoshida,et al.  Streaming Algorithms for Maximizing Monotone Submodular Functions Under a Knapsack Constraint , 2017, Algorithmica.

[23]  Yicheng Xu,et al.  Maximization of Constrained Non-submodular Functions , 2019, COCOON.

[24]  Abhimanyu Das,et al.  Submodular meets Spectral: Greedy Algorithms for Subset Selection, Sparse Approximation and Dictionary Selection , 2011, ICML.

[25]  Amin Karbasi,et al.  Streaming Submodular Maximization under a k-Set System Constraint , 2020, ICML.

[26]  Joseph Naor,et al.  A Tight Linear Time (1/2)-Approximation for Unconstrained Submodular Maximization , 2015, SIAM J. Comput..

[27]  Andreas Krause,et al.  Adaptive Submodularity: Theory and Applications in Active Learning and Stochastic Optimization , 2010, J. Artif. Intell. Res..

[28]  Andreas Krause,et al.  Adaptive Sequence Submodularity , 2019, NeurIPS.

[29]  Joseph Naor,et al.  Nonmonotone Submodular Maximization via a Structural Continuous Greedy Algorithm - (Extended Abstract) , 2011, ICALP.

[30]  Joseph Naor,et al.  Submodular Maximization with Cardinality Constraints , 2014, SODA.

[31]  Jan Vondrák,et al.  Optimal approximation for submodular and supermodular optimization with bounded curvature , 2013, SODA.

[32]  Uriel Feige,et al.  Welfare maximization and the supermodular degree , 2013, ITCS '13.

[33]  Quan Pan,et al.  Approximation for maximizing monotone non-decreasing set functions with a greedy method , 2016, J. Comb. Optim..

[34]  Joseph Naor,et al.  A Unified Continuous Greedy Algorithm for Submodular Maximization , 2011, 2011 IEEE 52nd Annual Symposium on Foundations of Computer Science.

[35]  Andreas Krause,et al.  Guarantees for Greedy Maximization of Non-submodular Functions with Applications , 2017, ICML.

[36]  Volkan Cevher,et al.  Robust Maximization of Non-Submodular Objectives , 2018, AISTATS.

[37]  Huy L. Nguyen,et al.  An Optimal Streaming Algorithm for Non-monotone Submodular Maximization , 2019, ArXiv.

[38]  Ola Svensson,et al.  Beyond 1/2-Approximation for Submodular Maximization on Massive Data Streams , 2018, ICML.

[39]  Amit Chakrabarti,et al.  Submodular maximization meets streaming: matchings, matroids, and more , 2015, Math. Program..

[40]  Yanjun Jiang,et al.  Streaming algorithm for maximizing a monotone non-submodular function under d-knapsack constraint , 2020, Optim. Lett..

[41]  Andreas Krause,et al.  Selecting Sequences of Items via Submodular Maximization , 2017, AAAI.

[42]  Andreas Krause,et al.  Submodularity on Hypergraphs: From Sets to Sequences , 2018, AISTATS.

[43]  Yuval Filmus,et al.  A Tight Combinatorial Algorithm for Submodular Maximization Subject to a Matroid Constraint , 2012, 2012 IEEE 53rd Annual Symposium on Foundations of Computer Science.

[44]  Dachuan Xu,et al.  Simultaneous Approximation of Multi-criteria Submodular Function Maximization , 2014 .

[45]  Jan Vondrák,et al.  Submodular maximization by simulated annealing , 2010, SODA '11.

[46]  Ding-Zhu Du,et al.  Set Function Optimization , 2018, Journal of the Operations Research Society of China.