What happens when certainty equivalence is not valid?: Is there an optimal estimator for terminal guidance?

Almost every known optimal control design has been based on the simplifying implementation idea that assumes the validity of the Certainty Equivalence Principleand the associated Separation Theorem . However, there are some optimal control problems for which the principle is not valid and a conventional design based on the unjustified assumption of validity can create unsatisfactory performance. This pitfall is illustrated by an example of interceptor guidance in a ballistic missile defense scenario. Results of extensive Monte Carlo simulations question the very existence of an independently designed optimal estimator for this task. © 2003 Elsevier Ltd. All rights reserved.

[1]  Josef Shinar,et al.  Solution of a delayed Information Linear Pursuit-Evasion Game with Bounded Controls , 1999, IGTR.

[2]  Y. Bar-Shalom,et al.  Dual effect, certainty equivalence, and separation in stochastic control , 1974 .

[3]  Yaakov Bar-Shalom,et al.  Generalized certainty equivalence and dual effect in stochastic control , 1975 .

[4]  James G. Root Optimum Control of Non-Gaussian Linear Stochastic Systems with Inaccessible State Variables , 1969 .

[5]  Y. Bar-Shalom Stochastic dynamic programming: Caution and probing , 1981 .

[6]  D. Joseph,et al.  On linear control theory , 1961, Transactions of the American Institute of Electrical Engineers, Part II: Applications and Industry.

[7]  H. Witsenhausen Separation of estimation and control for discrete time systems , 1971 .

[8]  J. Shinar Solution Techniques for Realistic Pursuit-Evasion Games , 1981 .

[9]  R. Gabasov,et al.  Optimal synthesis of control systems , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[10]  Gene F. Franklin,et al.  A General Solution for Linear, Sampled-Data Control , 1963 .

[11]  R. Kalman,et al.  New results in linear prediction and filtering theory Trans. AMSE , 1961 .

[12]  R. E. Kalman,et al.  New Results in Linear Filtering and Prediction Theory , 1961 .

[13]  P. Zarchan Tracking and intercepting spiraling ballistic missiles , 2000, IEEE 2000. Position Location and Navigation Symposium (Cat. No.00CH37062).

[14]  Josef Shinar,et al.  Non-orthodox guidance law development approach for the interception of maneuvering anti-surface missiles , 2000 .

[15]  R. Larson,et al.  Dynamic programming for stochastic control of discrete systems , 1971 .

[16]  H. Simon,et al.  Dynamic Programming Under Uncertainty with a Quadratic Criterion Function , 1956 .

[17]  Tze Leung Lai,et al.  Efficient recursive algorithms for detection of abrupt changes in signals and control systems , 1999, IEEE Trans. Autom. Control..

[18]  H. Theil A Note on Certainty Equivalence in Dynamic Planning , 1957 .

[19]  C. Striebel Sufficient statistics in the optimum control of stochastic systems , 1965 .

[20]  Paul Zarchan Representation of Realistic Evasive Maneuvers by the Use of Shaping Filters , 1979 .

[21]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[22]  Paul Zarchan,et al.  Proportional navigation and weaving targets , 1995 .

[23]  J. Shinar,et al.  Optimal Evasion from a Pursuer with Delayed Information , 2001 .

[24]  Josef Shinar,et al.  AN EFFICIENT APPLICATION OF MULTIPLE MODEL ADAPTIVE ESTIMATION IN BALLISTIC MISSILE INTERCEPTION SCENARIOS , 2000 .

[25]  J. Shinar,et al.  Time-Varying Linear Pursuit-Evasion Game Models with Bounded Controls , 2002 .

[26]  D. Jacobson,et al.  Optimization of stochastic linear systems with additive measurement and process noise using exponential performance criteria , 1974 .

[27]  W. Wonham On the Separation Theorem of Stochastic Control , 1968 .

[28]  Josef Shinar,et al.  New Interceptor Guidance Law Integrating Time-Varying and Estimation-Delay Models , 2001 .