A row relaxation method for large minimax problems

AbstractThis paper presents a row relaxation method for solving the doubly regularized minimax problem $$minimize \tfrac{1}{2}\varepsilon (\parallel x\parallel _2^2 + \parallel Ax - b\parallel _\infty ^2 ) + \parallel Ax - b\parallel _\infty $$ whereε is a given positive constant. It is shown that the dual of this problem can be brought to the form $$minimize \tfrac{1}{2}\parallel A^T y\parallel _2^2 - \varepsilon b^T y + \tfrac{1}{2}(max\{ 0,\parallel y\parallel _1 - 1\} )^2 $$ and ify solves the dual thenATy/ε solves the primal. The dual problem is solved via a row relaxation method that resembles Kaczmarz's method. This feature makes the new method suitable for problems in whichA is large, sparse, and unstructured. Another advantage is that the method is easily adapted to handle linear constraints. Numerical results are included.

[1]  G. Herman,et al.  Algebraic reconstruction techniques (ART) for three-dimensional electron microscopy and x-ray photography. , 1970, Journal of theoretical biology.

[2]  G T Herman,et al.  ART: mathematics and applications. A report on the mathematical foundations and on the applicability to real data of the algebraic reconstruction techniques. , 1973, Journal of theoretical biology.

[3]  Gabor T. Herman,et al.  A Storage-Efficient Algorithm for Finding the Regularized Solution of a Large, Inconsistent System of Equations , 1980 .

[4]  O. Mangasarian Iterative Solution of Linear Programs , 1981 .

[5]  Clifford Hildreth,et al.  A quadratic programming procedure , 1957 .

[6]  A. Dax A row relaxation method for large l1 problems , 1991 .

[7]  Yair Censor,et al.  An automatic relaxation method for solving interval linear inequalities , 1985 .

[8]  Gabor T. Herman,et al.  A relaxation method for reconstructing objects from noisy X-rays , 1975, Math. Program..

[9]  O. Mangasarian,et al.  NONLINEAR PERTURBATION OF LINEAR PROGRAMS , 1979 .

[10]  Y. Censor,et al.  On the use of Cimmino's simultaneous projections method for computing a solution of the inverse problem in radiation therapy treatment planning , 1988 .

[11]  Gabor T. Herman,et al.  A family of iterative quadratic optimization algorithms for pairs of inequalities, with application in diagnostic radiology , 1978 .

[12]  Y. Censor Row-Action Methods for Huge and Sparse Systems and Their Applications , 1981 .

[13]  I. J. Schoenberg,et al.  The Relaxation Method for Linear Inequalities , 1954, Canadian Journal of Mathematics.

[14]  A. Dax Successive Refinement of Large Multicell Models , 1985 .

[15]  A. Pierro,et al.  A simultaneous iterative method for computing projections on polyhedra , 1987 .

[16]  Yair Censor,et al.  Parallel application of block-iterative methods in medical imaging and radiation therapy , 1988, Math. Program..

[17]  S. Agmon The Relaxation Method for Linear Inequalities , 1954, Canadian Journal of Mathematics.

[18]  Y. Censor,et al.  An iterative row-action method for interval convex programming , 1981 .

[19]  Achiya Dax,et al.  Column Relaxation Methods for Least Norm Problems , 1990, SIAM J. Sci. Comput..