A Historical Introduction to the Convector Mapping Principle

In 1696, Johann Bernoulli solved the brachistochrone problem by an ingenious method of combining Fermat’s principle of minimum time, Snell’s law of refraction and “finite element” discretization. This appears to be the first application of a “direct method.” By taking the limits of these “broken-line solutions,” Bernoulli arrived at an equation for the cycloid. About fifty years later (1744), Euler generalized Bernoulli’s direct method for the general problem of finding optimal curves and derived the now-famous Euler-Lagrange equations. Lagrange’s contribution did not come until 1755 when he (Lagrange) showed that Euler’s result could be arrived at by an alternative route of a new calculus. Lagrange’s ideas superceded the Bernoulli-Euler method and paved the way for a calculus of variations that culminated in the 1930s at the University of Chicago. In the late 1950s, the complexity of these variational equations were dramatically reduced by the landmark results of Bellman and Pontryagin. Their results are connected to Karush’s generalization of Lagrange’s yet-another-idea of “undetermined” multipliers. The simplicity of their equations also came with an amazing bonus of greater generality that engineers could now conceive of applying their results to practical problems. In recognizing that the elegant methods of Bellman and Pontryagin were not scalable to space trajectory optimization, astrodynamicists developed a broad set of computational tools that frequently required deep physical insights to solve real-world mission planning problems. In parallel, mathematicians discovered that the equations of Bellman and Pontryagin were incompatible with the original ideas of Bernoulli and Euler. Since the 1960s, intense research within the mathematical community has lead to the notion of “hidden convexity,” set-valued analysis, geometric integrators and many other mathematical topics that have immediate practical consequences, particularly to simplifying complex mission planning problems. This is the story of the covector mapping principle. When combined with a modern computer, it renders difficult trajectory optimization problems remarkably easy that it is now possible to routinely generate even real-time solutions.

[1]  S. Fomin,et al.  Elements of the Theory of Functions and Functional Analysis , 1961 .

[2]  I. Michael Ross How to Find Minimum-Fuel Controllers , 2004 .

[3]  William W. Hager,et al.  Runge-Kutta methods in optimal control and the transformed adjoint system , 2000, Numerische Mathematik.

[4]  W. Hager Numerical Analysis in Optimal Control , 2001 .

[5]  Michael C. Ferris,et al.  Interior-Point Methods for Massive Support Vector Machines , 2002, SIAM J. Optim..

[6]  Jeremy Rea,et al.  Launch Vehicle Trajectory Optimization Using a Legendre Pseudospectral Method , 2003 .

[7]  I.M. Ross,et al.  Time-optimal nonlinear feedback control for the NPSAT1 spacecraft , 2005, Proceedings, 2005 IEEE/ASME International Conference on Advanced Intelligent Mechatronics..

[8]  I. Michael Ross,et al.  Issues in the real-time computation of optimal control , 2006, Math. Comput. Model..

[9]  Bruce A. Conway,et al.  Discrete approximations to optimal trajectories using direct transcription and nonlinear programming , 1992 .

[10]  I. Michael Ross,et al.  DESIGNING OPTIMAL SPACECRAFT FORMATIONS , 2002 .

[11]  H. Halkin,et al.  On "Convexity and the maximum principle for discrete systems" , 1966 .

[12]  E. Dickmanns,et al.  Approximate Solution of Optimal Control Problems Using Third Order Hermite Polynomial Functions , 1974 .

[13]  Gamal N. Elnagar,et al.  The pseudospectral Legendre method for discretizing optimal control problems , 1995, IEEE Trans. Autom. Control..

[14]  Harold W. Kuhn,et al.  Being in the Right Place at the Right Time , 2002, Oper. Res..

[15]  C. Hargraves,et al.  DIRECT TRAJECTORY OPTIMIZATION USING NONLINEAR PROGRAMMING AND COLLOCATION , 1987 .

[16]  I. Michael Ross Hybrid Optimal Control Framework for Mission Planning , 2005, Journal of Guidance, Control, and Dynamics.

[17]  R. V. Gamkrelidze,et al.  Discovery of the Maximum Principle , 1999 .

[18]  Arthur E. Bryson,et al.  Applied Optimal Control , 1969 .

[19]  Stuart Dreyfus,et al.  Richard Bellman on the Birth of Dynamic Programming , 2002, Oper. Res..

[20]  Jean Pierre Marec,et al.  Optimal Space Trajectories , 1979 .

[21]  I. Michael Ross,et al.  Legendre Pseudospectral Approximations of Optimal Control Problems , 2003 .

[22]  Héctor J. Sussmann,et al.  THE BRACHISTOCHRONE PROBLEM AND MODERN CONTROL THEORY , 2002 .

[23]  Paul T. Boggs,et al.  A Global Convergence Analysis of an Algorithm for Large-Scale Nonlinear Optimization Problems , 1999, SIAM J. Optim..

[24]  I. Michael Ross,et al.  Costate Estimation by a Legendre Pseudospectral Method , 1998 .

[25]  Mendy,et al.  Multiple satellite trajectory optimization , 2004 .

[26]  I. Michael Ross,et al.  Discrete verification of necessary conditions for switched nonlinear optimal control systems , 2001, Proceedings of the 2004 American Control Conference.

[27]  Yu. S. Ledyaev,et al.  Nonsmooth analysis and control theory , 1998 .

[28]  Anil V. Rao,et al.  Practical Methods for Optimal Control Using Nonlinear Programming , 1987 .

[29]  H. Halkin A Maximum Principle of the Pontryagin Type for Systems Described by Nonlinear Difference Equations , 1966 .

[30]  E. Polak An historical survey of computational methods in optimal control. , 1973 .

[31]  I. M. Ross Review of Dynamic Optimization , 2000 .

[32]  I. Michael Ross,et al.  Design and Control of Libration Point Spacecraft Formations , 2004 .

[33]  Robert Stevens,et al.  Preliminary Design of Earth-Mars Cyclers Using Solar Sails , 2005 .

[34]  Jan C. Willems,et al.  300 years of optimal control: From the brachystochrone to the maximum principle , 1997 .

[35]  J. Betts Survey of Numerical Methods for Trajectory Optimization , 1998 .

[36]  I. Michael Ross,et al.  Rapid Verification Method for the Trajectory Optimization of Reentry Vehicles , 2003 .

[37]  M. Bardi,et al.  Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations , 1997 .

[38]  W. L. Duren Graduate Student at Chicago in the Twenties , 1976 .

[39]  R. Tyrrell Rockafellar,et al.  Lagrange Multipliers and Optimality , 1993, SIAM Rev..

[40]  Boris S. Mordukhovich,et al.  The Approximate Maximum Principle in Constrained Optimal Control , 2004, SIAM J. Control. Optim..

[41]  Stan Wagon,et al.  Pi: A 2000-Year Search Changes Direction , 2000 .

[42]  I. Michael Ross A Roadmap for Optimal Control: The Right Way to Commute , 2005, Annals of the New York Academy of Sciences.

[43]  I. Michael Ross,et al.  A Perspective on Methods for Trajectory Optimization , 2002 .

[44]  Paul J. Nahin When Least Is Best , 2003 .

[45]  Richard B. Vinter,et al.  Optimal Control , 2000 .

[46]  O. V. Stryk,et al.  Numerical Solution of Optimal Control Problems by Direct Collocation , 1993 .

[47]  J. Cullum Discrete Approximations to Continuous Optimal Control Problems , 1969 .

[48]  Derek F Lawden,et al.  Optimal trajectories for space navigation , 1964 .

[49]  A. L. Herman,et al.  Direct optimization using collocation based on high-order Gauss-Lobatto quadrature rules , 1996 .