Ordered Upwind Methods for Hybrid Control

We introduce a family of highly efficient (non-iterative) numerical methods for a wide class of hybrid control systems. The application of Dijkstra's classical method to a discrete optimal trajectory problem on a network obtains the solution in O(M log M) operations. The key idea behind the method is a careful use of the direction of information propagation, stemming from the optimality principle. In a series of recent papers, we have introduced a number of Ordered Upwind Methods (OUMs) to efficiently solve the fully anisotropic continuous optimal control problems. These techniques rely on using a partial information on the characteristic directions of the Hamilton-Jacobi-Bellman PDE, stemming from the continuous variant of the optimality principle. The resulting non-iterative algorithms have the computational complexity of O(M log M), where M is the total number of grid points where the solution is computed, regardless of the dimension of the control/state variables. In this paper, we showho wOrde red Upwind Methods may be extended to efficiently solve the hybrid (discrete/continuous) control problems. We illustrate our methods by solving a series of hybrid optimal trajectory problems with and without time-dependence of anisotropic speed functions.

[1]  Michael S. Branicky,et al.  Fast marching for hybrid control , 1999, Proceedings of the 1999 IEEE International Symposium on Computer Aided Control System Design (Cat. No.99TH8404).

[2]  J. Tsitsiklis,et al.  Efficient algorithms for globally optimal trajectories , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[3]  J. A. Sethian,et al.  Fast Marching Methods , 1999, SIAM Rev..

[4]  R. González,et al.  On Deterministic Control Problems: An Approximation Procedure for the Optimal Cost I. The Stationary Problem , 1985 .

[5]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods: Evolving Interfaces in Computational Geometry, Fluid , 2012 .

[6]  John Guckenheimer,et al.  A Fast Method for Approximating Invariant Manifolds , 2004, SIAM J. Appl. Dyn. Syst..

[7]  M. Branicky,et al.  A fast marching algorithm for hybrid systems , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[8]  H. W. Knobloch On optimal control problems with state space constraints , 1975 .

[9]  J. Sethian,et al.  Ordered upwind methods for static Hamilton–Jacobi equations , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Alex M. Andrew,et al.  Level Set Methods and Fast Marching Methods: Evolving Interfaces in Computational Geometry, Fluid Mechanics, Computer Vision, and Materials Science (2nd edition) , 2000 .

[11]  Richard Bellman,et al.  Introduction to the mathematical theory of control processes , 1967 .

[12]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[13]  A. V. Ladimirsky Static PDEs for time-dependent control problems , 2004 .

[14]  Tyrone E. Duncan,et al.  Numerical Methods for Stochastic Control Problems in Continuous Time (Harold J. Kushner and Paul G. Dupuis) , 1994, SIAM Rev..

[15]  A. Vladimirsky Fast methods for static Hamilton-Jacobi Partial Differential Equations , 2001 .

[16]  Alexander Vladimirsky,et al.  Ordered Upwind Methods for Static Hamilton-Jacobi Equations: Theory and Algorithms , 2003, SIAM J. Numer. Anal..

[17]  B. Hamber Publications , 1998, Weed Technology.

[18]  J A Sethian,et al.  A fast marching level set method for monotonically advancing fronts. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[19]  M. Falcone,et al.  An approximation scheme for the minimum time function , 1990 .

[20]  H. Kushner Numerical Methods for Stochastic Control Problems in Continuous Time , 2000 .

[21]  J. Sethian,et al.  Fast methods for the Eikonal and related Hamilton- Jacobi equations on unstructured meshes. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[22]  H. Soner Optimal control with state-space constraint I , 1986 .

[23]  Seth Stovack Kessler Piezoelectric-based in-situ damage detection of composite materials for structural health monitoring systems , 2002 .