On Discrete-Time Dynamic Programming in Insurance: Exponential Utility and Minimizing the Ruin Probability

This paper studies an insurance model where the risk process can be controlled by reinsurance and by investment in a financial market. The performance criterion is either the expected exponential utility of the terminal surplus or the ruin probability. It is shown that the problems can be imbedded in the framework of discrete-time stochastic dynamic programming but with some special features. A short introduction to control theory with infinite state space is provided which avoids the measure-theoretic apparatus by use of the so-called structure assumption. Moreover, in order to treat models without discount factor, a weak contraction property is derived. Explicit conditions are obtained for the optimality of employing no reinsurance.

[1]  Manfred Schäl,et al.  Markov Decision Processes in Finance and Dynamic Options , 2002 .

[2]  L. Brown,et al.  Measurable Selections of Extrema , 1973 .

[3]  J. Grandell Aspects of Risk Theory , 1991 .

[4]  R. Bellman Dynamic programming. , 1957, Science.

[5]  Michael I. Taksar,et al.  Optimal dynamic reinsurance policies for large insurance portfolios , 2003, Finance Stochastics.

[6]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[7]  R. Strauch Negative Dynamic Programming , 1966 .

[8]  S. Karlin,et al.  Mathematical Methods in the Social Sciences , 1962 .

[9]  D. Dickson,et al.  Reinsurance and ruin , 1996 .

[10]  David Lindley,et al.  How to Gamble if You Must. (Inequalities for Stochastic Processes) By Lester E. Dubins and Leonard J. Savage. Pp. xiv, 249. 102s. 1965. (McGraw-Hill Book Co.) , 1966, The Mathematical Gazette.

[11]  J. Stamler Blood Pressure and High Blood Pressure: Aspects of Risk , 1991 .

[12]  H. Scarf THE OPTIMALITY OF (S,S) POLICIES IN THE DYNAMIC INVENTORY PROBLEM , 1959 .

[13]  Michael I. Taksar,et al.  Optimal proportional reinsurance policies for diffusion models with transaction costs , 1998 .

[14]  C. Hipp,et al.  Optimal investment for insurers , 2000 .

[15]  Manfred Schäl Price systems constructed by optimal dynamic portfolios , 2000, Math. Methods Oper. Res..

[16]  Evan L. Porteus,et al.  On the Optimality of Structured Policies in Countable Stage Decision Processes. II: Positive and Negative Problems , 1977 .

[17]  Manfred SchÄl,et al.  Conditions for optimality in dynamic programming and for the limit of n-stage optimal policies to be optimal , 1975 .

[18]  Bjarne Højgaard,et al.  Optimal proportional reinsurance policies for diffusion models , 1998 .

[19]  D. Heath,et al.  Introduction to Mathematical Finance , 2000 .

[20]  T. Ferguson Betting Systems Which Minimize the Probability of Ruin , 1965 .

[21]  Howard R. Waters,et al.  Some mathematical aspects of reinsurance , 1983 .

[22]  Jean Jacod,et al.  Local martingales and the fundamental asset pricing theorems in the discrete-time case , 1998, Finance Stochastics.

[23]  Sid Browne,et al.  Optimal Investment Policies for a Firm With a Random Risk Process: Exponential Utility and Minimizing the Probability of Ruin , 1995, Math. Oper. Res..

[24]  Evan L. Porteus On the Optimality of Structured Policies in Countable Stage Decision Processes , 1975 .

[25]  D. Zagrodny,et al.  Insurer's optimal reinsurance strategies , 2000 .

[26]  Anders Martin-Löf,et al.  Lectures on the use of control theory in insurance , 1994 .

[27]  David M. Kreps,et al.  Martingales and arbitrage in multiperiod securities markets , 1979 .

[28]  Marc Goovaerts,et al.  Effective actuarial methods , 1990 .

[29]  R. C. Merton,et al.  Continuous-Time Finance , 1990 .

[30]  David J. Bartholomew Mathematical methods in social science , 1981 .

[31]  Søren Asmussen,et al.  Controlled diffusion models for optimal dividend pay-out , 1997 .

[32]  Dimitri P. Bertsekas,et al.  Necessary and sufficient conditions for existence of an optimal portfolio , 1974 .

[33]  Rina Dechter,et al.  The optimality of A , 1988 .

[34]  Hanspeter Schmidli,et al.  Optimal Proportional Reinsurance Policies in a Dynamic Setting , 2001 .

[35]  Leonard Rogers,et al.  Equivalent martingale measures and no-arbitrage , 1994 .

[36]  A. Whitehead An Introduction to Mathematics , 1949, Nature.

[37]  H. Schmidli,et al.  On minimizing the ruin probability by investment and reinsurance , 2002 .

[38]  M. Schäl On piecewise deterministic Markov control processes: Control of jumps and of risk processes in insurance , 1998 .

[39]  M. Schäl Portfolio Optimization and Martingale Measures , 2000 .