Markov Decision Processes with Applications to Finance

Preface.- 1.Introduction and First Examples.- Part I Finite Horizon Optimization Problems and Financial Markets.- 2.Theory of Finite Horizon Markov Decision Processes.- 3.The Financial Markets.- 4.Financial Optimization Problems.- Part II Partially Observable Markov Decision Problems.- 5.Partially Observable Markov Decision Processes.- 6.Partially Observable Markov Decision Problems in Finance.- Part III Infinite Horizon Optimization Problems.- 7.Theory of Infinite Horizon Markov Decision Processes.- 8.Piecewise Deterministic Markov Decision Processes.- 9.Optimization Problems in Finance and Insurance.- Part IV Stopping Problems.- 10.Theory of Optimal Stopping Problems.- 11.Stopping Problems in Finance.- Part V Appendix.- A.Tools from Analysis.- B.Tools from Probability.- C.Tools from Mathematical Finance.- References.- Index.

[1]  L. Shapley.  Stochastic Games* , 1953, Proceedings of the National Academy of Sciences.

[2]  Ronald A. Howard,et al.  Dynamic Programming and Markov Processes , 1960 .

[3]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994, Wiley Series in Probability and Statistics.

[4]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control , 1995 .

[5]  O. Hernández-Lerma,et al.  Discrete-time Markov control processes , 1999 .

[6]  Eugene A. Feinberg,et al.  Handbook of Markov Decision Processes , 2002 .

[7]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[8]  Dimitri P. Bertsekas,et al.  Approximate Dynamic Programming , 2010, Encyclopedia of Machine Learning.