Stochastic target hitting time and the problem of early retirement

We consider a problem of optimal control of a "retirement investment fund" over a finite time horizon with a target hitting time criteria. That is, we wish to decide, at each stage, what percentage of the current retirement fund to allocate into the limited number of investment options so that a decision maker can maximize the probability that his or her wealth exceeds a target x prior to his or her retirement. We use Markov decision processes with probability criteria to model this problem and give an example based on data from certain options available in an Australian retirement fund.

[1]  D. White.  Mean, variance, and probabilistic criteria in finite Markov decision processes: A review , 1988 .

[2]  D. White.  Minimizing a Threshold Probability in Discounted Markov Decision Processes , 1993 .

[3]  P. Whittle.  Risk-Sensitive Optimal Control , 1990 .

[4]  Stella X. Yu,et al.  Optimization Models for the First Arrival Target Distribution Function in Discrete Time , 1998 .

[5]  Jacek B. Krawczyk.  A MARKOVIAN APPROXIMATED SOLUTION TO A PORTFOLIO MANAGEMENT PROBLEM , 2000 .

[6]  D. Krass,et al.  Percentile performance criteria for limiting average Markov decision processes , 1995, IEEE Trans. Autom. Control..

[7]  Congbin Wu,et al.  Minimizing risk models in Markov decision processes with policies depending on target values , 1999 .

[8]  M. J. Sobel.  The variance of discounted Markov decision processes , 1982 .

[9]  Rolando Cavazos-Cadena,et al.  Controlled Markov chains with risk-sensitive criteria: Average cost, optimality equations, and optimal solutions , 1999, Math. Methods Oper. Res..

[10]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[11]  R. Howard,et al.  Risk-Sensitive Markov Decision Processes , 1972 .

[12]  A. Stuart,et al.  Portfolio Selection: Efficient Diversification of Investments , 1959 .

[13]  M. Bouakiz,et al.  Target-level criterion in Markov decision processes , 1995 .

[14]  Siming Huang,et al.  Markov Decision Processes with Distribution Function Criterion of First-Passage Time , 2001 .

[15]  R. C. Merton,et al.  Continuous-Time Finance , 1990 .

[16]  Jerzy A. Filar,et al.  Variance-Penalized Markov Decision Processes , 1989, Math. Oper. Res..

[17]  Santanu Roy,et al.  Theory of dynamic portfolio choice for survival under uncertainty , 1995 .

[18]  Rommert Dekker,et al.  A Dynamic Policy for Grouping Maintenance Activities , 1997 .

[19]  S. C. Jaquette.  A Utility Criterion for Markov Decision Processes , 1976 .

[20]  Jerzy A. Filar,et al.  Finite Horizon Portfolio Risk Models with Probability Criterion , 2002 .