Stochastic game approach to air operations

A command and control (C/sup 2/) problem for military air operations is addressed. Specifically, we consider C/sup 2/ problems for air vehicles against ground-based targets and defensive systems. The problem is viewed as a stochastic game. We restrict our attention to the C/sup 2/ level where the problem may consist of a few unmanned combat air vehicles (UCAVs) or aircraft (or possibly teams of vehicles), less than say, a half-dozen enemy surface-to-air missile air defense units (SAMs), a few enemy assets (viewed as targets from our standpoint), and some enemy decoys (assumed to mimic SAM radar signatures). At this low level, some targets are mapped out and possible SAM sites that are unavoidably part of the situation are known. One may then employ a discrete stochastic game problem formulation to determine which of these SAMs should optimally be engaged (if any), and by what series of air vehicle operations. We provide analysis, numerical implementation, and simulation for full state-feedback and measurement feedback control within this C/sup 2/ context. Sensitivity to parameter uncertainty is discussed. Some insight into the structure of optimal and near-optimal strategies for C/sup 2/ is obtained. The analysis is extended to the case of observations which may be affected by adversarial inputs. A heuristic based on risk-sensitive control is applied, and it is found that this produces improved results over more standard approaches.

[1]  Debasish Ghose,et al.  Modeling and analysis of air campaign resource allocation: a spatio-temporal decomposition approach , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[2]  M. R. James,et al.  Partially Observed Differential Games, Infinite-Dimensional Hamilton--Jacobi--Isaacs Equations, and Nonlinear $H_\infty$ Control , 1996 .

[3]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[4]  Tamer Başar,et al.  H1-Optimal Control and Related Minimax Design Problems , 1995 .

[5]  P. Bernhard,et al.  Rabbit and hunter game: Two discrete stochastic formulations , 1987 .

[6]  W. Fleming,et al.  Risk-Sensitive Control on an Infinite Time Horizon , 1995 .

[7]  I. Tunay,et al.  Game-theoretic linear quadratic method for air mission control , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[8]  Milton B. Adams,et al.  Closed-Loop Hierarchical Control of Military Air Operations , 2002 .

[9]  Rhodes,et al.  Optimal stochastic linear systems with exponential performance criteria and their relation to deterministic differential games , 1973 .

[10]  Mark L. Hanson,et al.  Mixed Initiative Planning and Control Under Uncertainty , 2002 .

[11]  K. Ito,et al.  Stochastic games and inverse Lyapunov methods in air operations , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[12]  J. Jelinek,et al.  Model predictive control of military operations , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[13]  P. Whittle.  Risk-sensitive linear/quadratic/gaussian control , 1981, Advances in Applied Probability.

[14]  Debasish Ghose,et al.  Game theoretic campaign modeling and analysis , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[15]  W. McEneaney.  Robust/ H ∞ filtering for nonlinear systems , 1998 .

[16]  William McEneaney,et al.  CONTROL FOR UAV OPERATIONS UNDER IMPERFECT INFORMATION , 2002 .

[17]  W. Fleming,et al.  Risk sensitive optimal control and differential games , 1992 .

[18]  Jacqueline Scherpen.  Proceedings of the 32nd IEEE Conference on Decision and Control, 1993 , 1993 .

[19]  P. Dupuis,et al.  A risk-sensitive escape criterion and robust limit , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[20]  W.M. McEneaney.  Convergence and error analysis for a max-plus algorithm , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[21]  Jose B. Cruz,et al.  An application of dynamic Nash task assignment strategies to multi-team military air operations , 2003, Autom..

[22]  R. Elliott,et al.  The Existence Of Value In Differential Games , 1972 .

[23]  Debasish Ghose,et al.  A Game Theoretical Multiple Resource Interaction Approach to Resource Allocation in an Air Campaign , 2002, Ann. Oper. Res..

[24]  Wendell H. Fleming,et al.  Deterministic and Stochastic Approaches to Nonlinear Filtering , 2000 .

[25]  Matthew R. James,et al.  A nonlinear partially observed differential game with a finite-dimensional information state , 1995 .

[26]  Tamer Basar,et al.  H∞-Optimal Control and Related , 1991 .

[27]  Jerzy A. Filar,et al.  Markov Decision Processes: The Noncompetitive Case , 1997 .

[28]  W. Fleming.  Deterministic nonlinear filtering , 1997 .

[29]  William M. McEneaney,et al.  Robust Limits of Risk Sensitive Nonlinear Filters , 2001, Math. Control. Signals Syst..

[30]  Matthew R. James,et al.  Asymptotic analysis of nonlinear stochastic risk-sensitive control and differential games , 1992, Math. Control. Signals Syst..

[31]  H. S. Morse,et al.  The DARPA JFACC program: modeling and control of military operations , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[32]  W. Fleming,et al.  Risk sensitive control with ergodic cost criteria , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[33]  G. Olsder,et al.  About When to Use the Searchlight , 1988 .

[34]  Huihui Jiang,et al.  Modeling and control of military operations against adversarial control , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[35]  Dimitri P. Bertsekas,et al.  Dynamic Programming: Deterministic and Stochastic Models , 1987 .

[36]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[37]  Thordur Runolfsson.  Risk-sensitive control of Markov chains and differential games , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[38]  Kagan Gokbayrak,et al.  Modeling and agile control for joint air operation environment , 2001, SPIE Defense + Commercial Sensing.

[39]  M. James,et al.  Extending H-infinity Control to Nonlinear Systems: Control of Nonlinear Systems to Achieve Performance Objectives , 1987 .

[40]  Ming Li,et al.  Game-theoretic modeling and control of a military air operation , 2001 .

[41]  William M. McEneaney,et al.  Robust control and differential games on a finite time horizon , 1995, Math. Control. Signals Syst..