Minimal Zero Norm Solutions of Linear Complementarity Problems

In this paper, we study minimal zero norm solutions of the linear complementarity problems, defined as the solutions with smallest cardinality. Minimal zero norm solutions are often desired in some real applications such as bimatrix game and portfolio selection. We first show the uniqueness of the minimal zero norm solution for Z-matrix linear complementarity problems. To find minimal zero norm solutions is equivalent to solve a difficult zero norm minimization problem with linear complementarity constraints. We then propose a p norm regularized minimization model with p in the open interval from zero to one, and show that it can approximate minimal zero norm solutions very well by sequentially decreasing the regularization parameter. We establish a threshold lower bound for any nonzero entry in its local minimizers, that can be used to identify zero entries precisely in computed solutions. We also consider the choice of regularization parameter to get desired sparsity. Based on the theoretical results, we design a sequential smoothing gradient method to solve the model. Numerical results demonstrate that the sequential smoothing gradient method can effectively solve the regularized model and get minimal zero norm solutions of linear complementarity problems.

[1]  I. Althöfer On sparse approximations to randomized strategies and convex combinations , 1994 .

[2]  Masao Fukushima,et al.  Some Feasibility Issues in Mathematical Programs with Equilibrium Constraints , 1998, SIAM J. Optim..

[3]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[4]  Balas K. Natarajan,et al.  Sparse Approximate Solutions to Linear Systems , 1995, SIAM J. Comput..

[5]  Jong-Shi Pang,et al.  Complementarity: Applications, Algorithms and Extensions (Applied Optimization) , 2001 .

[6]  Masao Fukushima,et al.  An Implementable Active-Set Algorithm for Computing a B-Stationary Point of a Mathematical Program with Linear Complementarity Constraints , 2002, SIAM J. Optim..

[7]  Gui-Hua Lin,et al.  New reformulations for stochastic nonlinear complementarity problems , 2006, Optim. Methods Softw..

[8]  Bethany L. Nicholson,et al.  Mathematical Programs with Equilibrium Constraints , 2021, Pyomo — Optimization Modeling in Python.

[9]  Y. Ye,et al.  Lower Bound Theory of Nonzero Entries in Solutions of ℓ2-ℓp Minimization , 2010, SIAM J. Sci. Comput..

[10]  Yinyu Ye,et al.  A note on the complexity of Lp minimization , 2011, Math. Program..

[11]  David Auger,et al.  Multiple Tree for Partially Observable Monte-Carlo Tree Search , 2011, EvoApplications.

[12]  Xiaojun Chen,et al.  Smoothing Nonlinear Conjugate Gradient Method for Image Restoration Using Nonsmooth Nonconvex Minimization , 2010, SIAM J. Imaging Sci..

[13]  Olivier Teytaud,et al.  Online Sparse Bandit for Card Games , 2011, ACG.

[14]  Richard W. Cottle,et al.  Linear Complementarity Problem. , 1992 .

[15]  Xiaojun Chen,et al.  Smoothing Projected Gradient Method and Its Application to Stochastic Linear Complementarity Problems , 2009, SIAM J. Optim..

[16]  G. Hoek,et al.  The Optimal Selection of Small Portfolios , 1983 .

[17]  Michael C. Ferris,et al.  Complementarity: Applications, Algorithms and Extensions , 2010 .