Partial conjugate gradient methods for a class of optimal control problems

In this paper, we examine the computational aspects of a certain class of discrete-time optimal control problems. We propose and analyze two partial conjugate gradient algorithms which operate in cycles of s+1 conjugate gradient steps ( s \leq n = state space dimension). The algorithms are motivated by the special form of the Hessian matrix of the cost functional. The first algorithm exhibits a linear convergence rate and offers some advantages over steepest descent in certain cases such as when the system is unstable. The second algorithm requires second-order information with respect to the control variables at the beginning of each cycle and exhibits s+1 - step superlinear convergence rate. Furthermore, it solves a linear-quadratic problem in s+1 steps as compared with the m.N steps ( m = control space dimension, N = number of stages) required by the ordinary conjugate gradient method.

[1]  A. E. Bryson,et al.  A Steepest-Ascent Method for Solving Optimum Programming Problems , 1962 .

[2]  H. Kelley Method of Gradients , 1962 .

[3]  A. Goldstein Convex programming in Hilbert space , 1964 .

[4]  D. Russell Penalty Functions and Bounded Phase Coordinate Control , 1964 .

[5]  K. Okamura Some Mathematical Theory of the Penalty Method for Solving Optimum Control Problems , 1964 .

[6]  A. Bryson,et al.  A SUCCESSIVE SWEEP METHOD FOR SOLVING OPTIMAL PROGRAMMING PROBLEMS , 1965 .

[7]  Sanjoy K. Mitter,et al.  Successive approximation methods for the solution of optimal control problems , 1966, Autom..

[8]  Boris Polyak,et al.  Constrained minimization methods , 1966 .

[9]  S. Mcreynolds The successive sweep method and dynamic programming , 1967 .

[10]  S. Mitter,et al.  The conjugate gradient method for optimal control problems , 1967 .

[11]  G. Forsythe On the asymptotic directions of thes-dimensional optimum gradient method , 1968 .

[12]  H. Sorenson Comparison of some conjugate direction procedures for function minimization , 1969 .

[13]  Boris Polyak The conjugate gradient method in extremal problems , 1969 .

[14]  M. Hestenes Multiplier and gradient methods , 1969 .

[15]  D. Luenberger Convergence rate of a penalty-function scheme , 1971 .

[16]  E. Barnes SOLUTION OF A DUAL PROBLEM IN OPTIMAL CONTROL THEORY , 1973 .

[17]  D. Bertsekas COMBINED PRIMAL-DUAL AND PENALTY METHODS FOR CONSTRAINED MINIMIZATION* , 1975 .