Large-scale eigenvalue problems in trust-region calculations

The Trust-Region Subproblem of minimizing a quadratic function subject to a norm constraint arises in the context of trust-region methods in optimization and in the regularization of discrete forms of illposed problems. In recent years, methods and software for large-scale trust-region subproblems have been developed that require the solution of a large bordered eigenvalue problem at each iteration. In this work, we describe the bordered eigenvalue problems, the computational challenges in solving them, and present some approaches for their efficient solution by means of Krylov subspace methods for linear and nonlinear eigenvalue problems.

[1]  A. N. Tikhonov,et al.  REGULARIZATION OF INCORRECTLY POSED PROBLEMS , 1963 .

[2]  L. Eldén Algorithms for the regularization of ill-conditioned least squares problems , 1977 .

[3]  B. Parlett The Symmetric Eigenvalue Problem , 1981 .

[4]  D. Sorensen Newton's method with a model trust region modification , 1982 .

[5]  T. Steihaug The Conjugate Gradient Method and Trust Regions in Large Scale Optimization , 1983 .

[6]  Jorge J. Moré,et al.  Computing a Trust Region Step , 1983 .

[7]  P. Hansen Rank-Deficient and Discrete Ill-Posed Problems: Numerical Aspects of Linear Inversion , 1987 .

[8]  Danny C. Sorensen,et al.  Implicit Application of Polynomial Filters in a k-Step Arnoldi Method , 1992, SIAM J. Matrix Anal. Appl..

[9]  Gerard L. G. Sleijpen,et al.  A Jacobi-Davidson Iteration Method for Linear Eigenvalue Problems , 1996, SIAM J. Matrix Anal. Appl..

[10]  Danny C. Sorensen,et al.  Minimization of a Large-Scale Quadratic FunctionSubject to a Spherical Constraint , 1997, SIAM J. Optim..

[11]  Franz Rendl,et al.  A semidefinite framework for trust region subproblems with applications to large scale minimization , 1997, Math. Program..

[12]  D. Sorensen,et al.  4. The Implicitly Restarted Arnoldi Method , 1998 .

[13]  D. Sorensen,et al.  A large-scale trust-region approach to the regularization of discrete ill-posed problems , 1999 .

[14]  Nicholas I. M. Gould,et al.  Solving the Trust-Region Subproblem using the Lanczos Method , 1999, SIAM J. Optim..

[15]  William W. Hager,et al.  Minimizing a Quadratic Over a Sphere , 2001, SIAM J. Optim..

[16]  Danny C. Sorensen,et al.  A New Matrix-Free Algorithm for the Large-Scale Trust-Region Subproblem , 2000, SIAM J. Optim..

[17]  Danny C. Sorensen,et al.  A Trust-Region Approach to the Regularization of Large-Scale Discrete Forms of Ill-Posed Problems , 2001, SIAM J. Sci. Comput..

[18]  Henry Wolkowicz,et al.  The trust region subproblem and semidefinite programming , 2004, Optim. Methods Softw..

[19]  H. Voss An Arnoldi Method for Nonlinear Eigenvalue Problems , 2004 .

[20]  Per Christian Hansen,et al.  Regularization Tools version 4.0 for Matlab 7.3 , 2007, Numerical Algorithms.

[21]  Danny C. Sorensen,et al.  Algorithm 873: LSTRS: MATLAB software for large-scale trust-region subproblems and regularization , 2008, TOMS.

[22]  B. H. Fotland,et al.  A matrix-free method for regularisation with unrestricted variables , 2008 .

[23]  Danny C. Sorensen,et al.  Accelerating the LSTRS Algorithm , 2010, SIAM J. Sci. Comput..