ALGORITHMS FOR L-CONVEX FUNCTION MINIMIZATION: CONNECTION BETWEEN DISCRETE CONVEX ANALYSIS AND OTHER RESEARCH FIELDS

L-convexity is a concept of discrete convexity for functions defined on the integer lattice points, and plays a central role in the framework of discrete convex analysis. In this paper, we present algorithms for L-convex function minimization. Algorithms proposed independently in research fields such as discrete optimization, auction theory, and computer vision can be regarded as minimization algorithms applied to specific L-convex functions. This fact indicates the close connection between discrete convex analysis and these research fields. We then theoretically analyze the number of iterations required by some minimization algorithms, and show that the precise bounds can be given in terms of distance between the initial solution and the minimizer found by the algorithms. This fact implies that the algorithms output the “nearest” minimizer to the initial solution, and that the trajectory of solutions generated by the algorithms are “shortest paths” from the initial solution to the found minimizer. In this way, we can provide a unified viewpoint to algorithms appearing in various research fields by analyzing steepest descent algorithms for an L-convex function. Finally, we apply the analysis results to iterative auctions in auction theory. We show that the essence of the iterative auctions proposed by Ausubel (2006) lies in L-convexity, and using this fact we analyze the behavior of the iterative auctions. We also review the iterative auctions proposed by Murota–Shioura–Yang (2016), which are based on the understanding of discrete convex analysis.

[1]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[2]  Alexander Schrijver,et al.  Combinatorial optimization. Polyhedra and efficiency. , 2003 .

[3]  Ennio Stacchetti,et al.  The English Auction with Differentiated Commodities , 2000, J. Econ. Theory.

[4]  Kazuo Murota,et al.  M-Convex Functions on Jump Systems: A General Framework for Minsquare Graph Factor Problem , 2006, SIAM J. Discret. Math..

[5]  Satoru Iwata,et al.  A combinatorial, strongly polynomial-time algorithm for minimizing submodular functions , 2000, STOC '00.

[6]  Kazuo Murota,et al.  On Steepest Descent Algorithms for Discrete Convex Functions , 2003, SIAM J. Optim..

[7]  W. Marsden I and J , 2012 .

[8]  Hiroshi Hirai,et al.  Discrete convexity and polynomial solvability in minimum 0-extension problems , 2013, Math. Program..

[9]  Kazuo Murota,et al.  M-Convex Function on Generalized Polymatroid , 1999, Math. Oper. Res..

[10]  Kazuo Murota,et al.  Dijkstra’s algorithm and L-concave function maximization , 2014, Math. Program..

[11]  Zaifu Yang,et al.  A Note on Kelso and Crawford's Gross Substitutes Condition , 2003, Math. Oper. Res..

[12]  Kazuo Murota,et al.  Discrete convex analysis , 1998, Math. Program..

[13]  Kazuo Murota,et al.  Exact bounds for steepest descent algorithms of L-convex function minimization , 2014, Oper. Res. Lett..

[14]  Kazuo Murota,et al.  Time bounds for iterative auctions: A unified approach by discrete convex analysis , 2016, Discret. Optim..

[15]  Nam-Kee Chung,et al.  A dual algorithm for submodular flow problems , 1991, Oper. Res. Lett..

[16]  David C. Parkes,et al.  Multi-item Vickrey-Dutch auctions , 2009, Games Econ. Behav..

[17]  Kazuo Murota,et al.  Notes on L-/M-convex functions and the separation theorems , 2000, Math. Program..

[18]  José M. Bioucas-Dias,et al.  Phase Unwrapping via Graph Cuts , 2007, IEEE Trans. Image Process..

[19]  Kazuo Murota,et al.  Extension of M-Convexity and L-Convexity to Polyhedral Convex Functions , 1999, Adv. Appl. Math..

[20]  Kazuo Murota,et al.  Conjugacy relationship between M-convex and L-convex functions in continuous variables , 2004, Math. Program..

[21]  Shmuel Peleg,et al.  Seamless image stitching by minimizing false edges , 2006, IEEE Transactions on Image Processing.

[22]  Kazuo Murota,et al.  MATHEMATICAL ENGINEERING TECHNICAL REPORTS Monotonicity in Steepest Ascent Algorithms for Polyhedral L-concave Functions , 2014 .

[23]  Hiroshi Hirai,et al.  L-extendable functions and a proximity scaling algorithm for minimum cost multiflow problem , 2014, Discret. Optim..

[24]  Refael Hassin,et al.  The minimum cost flow problem: A unifying approach to dual algorithms and a new tree-search algorithm , 1983, Math. Program..

[25]  Yoav Shoham,et al.  Combinatorial Auctions , 2005, Encyclopedia of Wireless Networks.

[26]  Kazuo Murota,et al.  MATHEMATICAL ENGINEERING TECHNICAL REPORTS Recent Developments in Discrete Convex Analysis , 2008 .

[27]  Walter Wenzel,et al.  Valuated matroids: a new look at the greedy algorithm , 1989 .

[28]  Jérôme Darbon,et al.  Image Restoration with Discrete Constrained Total Variation Part I: Fast and Exact Optimization , 2006, Journal of Mathematical Imaging and Vision.

[29]  Satoru Fujishige,et al.  Submodular functions and optimization , 1991 .

[30]  Kazuo Murota,et al.  Quadratic M-convex and L-convex functions , 2004, Adv. Appl. Math..

[31]  V. Kolmogorov Primal-dual Algorithm for Convex Markov Random Fields , 2005 .

[32]  Paul H. Zipkin On the Structure of Lost-Sales Inventory Models , 2008, Oper. Res..

[33]  Tommy Andersson,et al.  Multi-item Vickrey-English-Dutch auctions , 2013, Games Econ. Behav..

[34]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Vladimir Kolmogorov,et al.  New algorithms for convex cost tension problem with application to computer vision , 2009, Discret. Optim..

[36]  H. Hirai Discrete Convexity for Multiflows and 0-extensions , 2013 .

[37]  Alexander Schrijver,et al.  A Combinatorial Algorithm Minimizing Submodular Functions in Strongly Polynomial Time , 2000, J. Comb. Theory B.

[38]  Woonghee Tim Huh,et al.  On the Optimal Policy Structure in Serial Inventory Systems with Lost Sales , 2010, Oper. Res..

[39]  Faruk Gul,et al.  WALRASIAN EQUILIBRIUM WITH GROSS SUBSTITUTES , 1999 .

[40]  K. Murota Convexity and Steinitz's Exchange Property , 1996 .

[41]  D. Gale,et al.  Multi-Item Auctions , 1986, Journal of Political Economy.

[42]  Satoru Iwata,et al.  A combinatorial strongly polynomial algorithm for minimizing submodular functions , 2001, JACM.

[43]  V. Crawford,et al.  Job Matching, Coalition Formation, and Gross Substitutes , 1982 .

[44]  Lawrence M. Ausubel An efficient dynamic auction for heterogeneous commodities , 2006 .