A Continuous Implementation of a Second-Variation Optimal Control Method for Space Trajectory Problems

The paper describes a continuous second-variation method to solve optimal control problems with terminal constraints where the control is defined on a closed set. The integration of matrix differential equations based on a second-order expansion of a Lagrangian provides linear updates of the control and a locally optimal feedback controller. The process involves a backward and a forward integration stage, which require storing trajectories. A method has been devised to store continuous solutions of ordinary differential equations and compute accurately the continuous expansion of the Lagrangian around a nominal trajectory. Thanks to the continuous approach, the method adapts implicitly the numerical time mesh and provides precise gradient iterates to find an optimal control. The method represents an evolution to the continuous case of discrete second-order techniques of optimal control. The novel method is demonstrated on bang–bang optimal control problems, showing its suitability to identify automatically optimal switching points in the control without insight into the switching structure or a choice of the time mesh. A complex space trajectory problem is tackled to demonstrate the numerical robustness of the method to problems with different time scales.

[1]  Ryan P. Russell,et al.  A Hybrid Differential Dynamic Programming Algorithm for Constrained Optimal Control Problems. Part 1: Theory , 2012, Journal of Optimization Theory and Applications.

[2]  T. Başar Contributions to the Theory of Optimal Control , 2001 .

[3]  Richard S. Bucy,et al.  Global Theory of the Riccati Equation , 1967, J. Comput. Syst. Sci..

[4]  M. Vasile,et al.  Optimal low-thrust trajectories to asteroids through an algorithm based on differential dynamic programming , 2009 .

[5]  David Q. Mayne,et al.  Differential dynamic programming , 1972, The Mathematical Gazette.

[6]  G. Franklin,et al.  A second-order feedback method for optimal control computations , 1967, IEEE Transactions on Automatic Control.

[7]  Nicholas I. M. Gould,et al.  Trust Region Methods , 2000, MOS-SIAM Series on Optimization.

[8]  M. Shamsi A modified pseudospectral scheme for accurate solution of Bang‐Bang optimal control problems , 2011 .

[9]  W. Grantham,et al.  Neighbouring extremals for nonlinear systems with control constraints , 1995 .

[10]  D. Izzo,et al.  Near Earth Asteroids Accessible to Human Exploration in 2020-2035 , 2010 .

[11]  D. Jacobson New conditions for boundedness of the solution of a matrix Riccati differential equation , 1970 .

[12]  I. Michael Ross,et al.  Legendre Pseudospectral Approximations of Optimal Control Problems , 2003 .

[13]  Sanjoy K. Mitter,et al.  Successive approximation methods for the solution of optimal control problems , 1966, Autom..

[14]  J. Pantoja,et al.  Differential dynamic programming and Newton's method , 1988 .

[15]  J. Olympio Algorithm for Low Thrust Optimal Interplanetary Transfers with Escape and Capture Phases , 2008 .

[16]  Thomas F. Coleman,et al.  An efficient trust region method for unconstrained discrete-time optimal control problems , 1995, Comput. Optim. Appl..

[17]  Cesar A. Ocampo,et al.  Indirect optimization of three dimensional finite-burning interplanetary transfers including spiral dynamics , 2007 .

[18]  Interpolation for variable order, Runge-Kutta methods , 1987 .

[19]  L. S. Pontryagin,et al.  Mathematical Theory of Optimal Processes , 1962 .

[20]  Ernst Hairer,et al.  Solving Ordinary Differential Equations I: Nonstiff Problems , 2009 .

[21]  G. J. Whiffen,et al.  Application of the SDC optimal control algorithm to low-thrust escape and capture including fourth body effects , 2002 .

[22]  R. Epenoy,et al.  New smoothing techniques for solving bang–bang optimal control problems—numerical results and statistical interpretation , 2002 .

[23]  Anastassios E. Petropoulos,et al.  Simple control laws for continuous-thrust escape or capture and their use in optimisation , 2002 .

[24]  M. Hestenes Multiplier and gradient methods , 1969 .

[25]  D. H. Jacobson,et al.  A New Necessary Condition of Optimality for Singular Control Problems , 1969 .

[26]  J. Bullock,et al.  Computation of optimal controls by a method based on second variations , 1967 .

[27]  L. Watson,et al.  Trust Region Augmented Lagrangian Methods for Sequential Response Surface Approximation and Optimization , 1998 .

[28]  Joris T. Olympio,et al.  Optimisation and optimal control methods for planet sequence design of low-thrust Interplanetary transfer problems with gravity-assists. (Techniques de commande optimale pour la recherche automatique de stratégies avec assistances gravitationnelles dans le cadre de missions interplanétaires) , 2008 .

[29]  G. J. Whiffen,et al.  Application of a novel optimal control algorithm to low-thrust trajectory optimization , 2001 .

[30]  P. Dyer,et al.  Optimization of control systems with discontinuities and terminal constraints , 1969 .

[31]  D. Mayne A Second-order Gradient Method for Determining Optimal Trajectories of Non-linear Discrete-time Systems , 1966 .

[32]  S. Yakowitz,et al.  Differential dynamic programming and Newton's method for discrete optimal control problems , 1984 .

[33]  D. Jacobson,et al.  A discrete-time differential dynamic programming algorithm with application to optimal orbit transfer , 1970 .

[34]  A. Bryson,et al.  A SUCCESSIVE SWEEP METHOD FOR SOLVING OPTIMAL PROGRAMMING PROBLEMS , 1965 .

[35]  Ryan P. Russell,et al.  A Hybrid Differential Dynamic Programming Algorithm for Constrained Optimal Control Problems. Part 2: Application , 2012, Journal of Optimization Theory and Applications.

[36]  Christophe Talbot,et al.  An Interior-Point Approach to Trajectory Optimization , 2007 .

[37]  J. Betts Survey of Numerical Methods for Trajectory Optimization , 1998 .

[38]  D. Stoffer,et al.  Variable steps for reversible integration methods , 1995, Computing.

[39]  S. Jain MULTIRESOLUTION STRATEGIES FOR THE NUMERICAL SOLUTION OF OPTIMAL CONTROL PROBLEMS , 2008 .

[40]  A. V. Levy,et al.  On the method of multipliers for mathematical programming problems , 1972 .

[41]  J. Betts,et al.  MESH REFINEMENT IN DIRECT TRANSCRIPTION METHODS FOR OPTIMAL CONTROL , 1998 .

[42]  M. J. D. Powell,et al.  A method for nonlinear constraints in minimization problems , 1969 .

[43]  Jason L. Speyer,et al.  Primer on Optimal Control Theory , 2010 .