Robust intensity control with multiple levels of model uncertainty and the dual risk-sensitive problem

In this paper, we consider robust intensity control of a stochastic discrete event system. We introduce the notion of generalized relative entropy and extend the classical “entropy-based” approached to stochastic robust control by allowing for different levels of model uncertainty for different parts of the model. We also introduce a new class of risk-sensitive control problems which are characterized by multiple risk-sensitivity parameters and reward sharing terms, and show that it is equivalent to the robust control problem under an appropriate choice of reward sharing rule. This extends the well know duality between robust and risk-sensitive control the the case when there are multiple levels of model uncertainty within the same model.

[1]  Andrew E. B. Lim,et al.  Robust Multi-Product Pricing , 2008 .

[2]  Andrew E. B. Lim,et al.  Relative Entropy, Exponential Utility, and Robust Dynamic Pricing , 2007, Oper. Res..

[3]  Wolfgang J. Runggaldier,et al.  Connections between stochastic control and dynamic games , 1996, Math. Control. Signals Syst..

[4]  J. Jacod Calcul stochastique et problèmes de martingales , 1979 .

[5]  P. Whittle A risk-sensitive maximum principle , 1990 .

[6]  John B. Moore,et al.  Multiple-objective risk-sensitive control and its small noise limit , 2003, Autom..

[7]  P. Whittle A risk-sensitive maximum principle: the case of imperfect state observation , 1991 .

[8]  P. Whittle Risk-sensitive linear/quadratic/gaussian control , 1981, Advances in Applied Probability.

[9]  Ian R. Petersen,et al.  Finite Horizon Minimax Optimal Control of Stochastic Partially Observed Time Varying Uncertain Systems , 1999, Math. Control. Signals Syst..

[10]  P. Brémaud Point Processes and Queues , 1981 .

[11]  P. Brémaud Point processes and queues, martingale dynamics , 1983 .

[12]  P. Dupuis,et al.  Minimax optimal control of stochastic uncertain systems with relative entropy constraints , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[13]  Rhodes,et al.  Optimal stochastic linear systems with exponential performance criteria and their relation to deterministic differential games , 1973 .

[14]  Jason J. Ford,et al.  Robust Control of Nonlinear Jump Parameter Systems Governed by Uncertain Chains , 2008, IEEE Transactions on Automatic Control.

[15]  A. Kyprianou,et al.  Relations between information theory, robustness, and statistical mechanics of stochastic systems , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[16]  Andrew E. B. Lim,et al.  A new risk-sensitive maximum principle , 2005, IEEE Transactions on Automatic Control.