Approximation of the Newton Step by a Defect Correction Process

Abstract. In this paper, an optimal control problem governed by a partial differential equation is considered. TheNewton step for this system can be computed by solving a coupled system of equations. To do this efficiently with aniterative defect correction process, a modifying operator is introduced into the system. This operator is motivated bylocal mode analysis. The operator can be used also for preconditioning in GMRES. We give a detailed convergenceanalysis for the defect correction process and show the derivation of the modifying operator. Numerical tests aredone on the small disturbance shape optimization problem in two dimensions for the defect correction process and forGMRES.Key words, optimal control governed by PDEs, iterative methods, defect correction, GMRES, preconditioning,Newton step, SQESubject classification. Applied and Numerical Mathematics1. Introduction. Many optimization problems can be formulated as equality constrained problems with a specialstructure. If one considers optimal control or optimal design problems, the variables are partitioned into the state andcontrol or design variables which we denote by _ and u, respectively. This leads to the following problem formulationrain .Y'(4),u) s.t. h(_b, u) = O.(_,u)If one is interested in algorithms with a fast rate of convergence, one would tend to use Newton's method for theseproblems. Note that this method can be applied in two different ways. Under appropriate assumptions, see Section 2.1,one can solve for each control variable u the system equation h(_b(u), u) = 0 to obtain a state q_(u) which depends onu. This is typical, when h represents a boundary value problem where the control variable is on the right hand side ofthe differential equation. Then one can apply Newton's method to the unconstrained minimization problem

[1]  Veer N. Vatsa,et al.  A Preconditioning Method for Shape Optimization Governed by the Euler Equations , 1998 .

[2]  Eyal Arian,et al.  On the Coupling of Aerodynamic and Structural Design , 1997 .

[3]  Ilse C. F. Ipsen,et al.  GMRES and the minimal polynomial , 1996 .

[4]  S. Ta'asan,et al.  ANALYSIS OF THE HESSIAN FOR AERODYNAMIC OPTIMIZATION: INVISCID FLOW , 1996 .

[5]  A. Wathen,et al.  The convergence rate of the minimal residual method for the Stokes problem , 1995 .

[6]  Axel Klawonn,et al.  An Optimal Preconditioner for a Class of Saddle Point Problems with a Penalty Term , 1995, SIAM J. Sci. Comput..

[7]  A. Wathen,et al.  Fast iterative solution of stabilised Stokes systems part II: using general block preconditioners , 1994 .

[8]  R. Rogers,et al.  An introduction to partial differential equations , 1993 .

[9]  Ekkehard W. Sachs,et al.  Multilevel Algorithms for Constrained Compact Fixed Point Problems , 1994, SIAM J. Sci. Comput..

[10]  Andrew J. Wathen,et al.  Fast iterative solution of stabilised Stokes systems, part I: using simple diagonal preconditioners , 1993 .

[11]  Ragnar Winther,et al.  A Preconditioned Iterative Method for Saddlepoint Problems , 1992, SIAM J. Matrix Anal. Appl..

[12]  D. Whittaker,et al.  A Course in Functional Analysis , 1991, The Mathematical Gazette.

[13]  E. Zeidler Nonlinear functional analysis and its applications , 1988 .

[14]  C. Kelley,et al.  Quasi Newton methods and unconstrained optimal control problems , 1986, 1986 25th IEEE Conference on Decision and Control.

[15]  Y. Saad,et al.  GMRES: a generalized minimal residual algorithm for solving nonsymmetric linear systems , 1986 .

[16]  R. Dembo,et al.  INEXACT NEWTON METHODS , 1982 .

[17]  H. Stetter The defect correction principle and discretization methods , 1978 .

[18]  R. Tapia Diagonalized multiplier methods and quasi-Newton methods for constrained optimization , 1977 .

[19]  Axel Klawonn,et al.  Block-Triangular Preconditioners for Saddle Point Problems with a Penalty Term , 1998, SIAM J. Sci. Comput..

[20]  Matthias Heinkenschloss,et al.  Preconditioners for Karush-Kuhn-Tucker Matrices Arising in the Optimal Control of Distributed Systems , 1998 .

[21]  R. Freund Preconditioning of Symmetric, but Highly Indefinite Linear Systems , 1997 .

[22]  Michael A. Saunders,et al.  Preconditioners for Indefinite Systems Arising in Optimization , 1992, SIAM J. Matrix Anal. Appl..

[23]  C. Hirsch Numerical computation of internal and external flows , 1988 .

[24]  C. Kelley Iterative Methods for Linear and Nonlinear Equations , 1987 .

[25]  G. Golub Matrix computations , 1983 .

[26]  Josef Stoer,et al.  Solution of Large Linear Systems of Equations by Conjugate Gradient Type Methods , 1982, ISMP.

[27]  D. Luenberger Optimization by Vector Space Methods , 1968 .