Optimal Control of Markov Processes: Infinite-Horizon

[1]  Xi-Ren Cao,et al.  State Classification and Multiclass Optimization of Continuous-Time and Continuous-State Markov Processes , 2019, IEEE Transactions on Automatic Control.

[2]  Xi-Ren Cao,et al.  Optimality Conditions for Long-Run Average Rewards With Underselectivity and Nonsmooth Features , 2017, IEEE Transactions on Automatic Control.

[3]  Xi-Ren Cao,et al.  State Classification of Time-Nonhomogeneous Markov Chains and Average Reward Optimization of Multi-Chains , 2016, IEEE Transactions on Automatic Control.

[4]  Xi-Ren Cao,et al.  Optimization of Average Rewards of Time Nonhomogeneous Markov Chains , 2015, IEEE Transactions on Automatic Control.

[5]  Xianping Guo,et al.  Bias optimality for multichain continuous-time Markov decision processes , 2009, Oper. Res. Lett..

[6]  Xi-Ren Cao,et al.  Continuous-time Markov decision processes with nth-bias optimality criteria , 2009, Autom..

[7]  Onésimo Hernández-Lerma,et al.  Blackwell Optimality for Controlled Diffusion Processes , 2009, Journal of Applied Probability.

[8]  Xi-Ren Cao,et al.  The $n$th-Order Bias Optimality for Multichain Markov Decision Processes , 2008, IEEE Transactions on Automatic Control.

[9]  Xi-Ren Cao,et al.  Stochastic learning and optimization - A sensitivity-based approach , 2007, Annu. Rev. Control..

[10]  Onésimo Hernández-Lerma,et al.  The Laurent series, sensitive discount and Blackwell optimality for continuous-time controlled Markov chains , 2005, Math. Methods Oper. Res..

[11]  B. Øksendal,et al.  Applied Stochastic Control of Jump Diffusions , 2004, Universitext.

[12]  F. Klebaner Introduction To Stochastic Calculus With Applications , 1999 .

[13]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[14]  Robert L. Smith,et al.  Optimal average value convergence in nonhomogeneous Markov decision processes Yunsun Park, James C. Bean and Robert L. Smith. , 1993 .

[15]  W. Fleming,et al.  Controlled Markov processes and viscosity solutions , 1992 .

[16]  Xi-Ren Cao Convergence of parameter sensitivity estimates in a stochastic experiment , 1984, The 23rd IEEE Conference on Decision and Control.

[17]  Gerald B. Folland,et al.  Real Analysis: Modern Techniques and Their Applications , 1984 .

[18]  P. Billingsley,et al.  Probability and Measure , 1980 .

[19]  A. F. Veinott Discrete Dynamic Programming with Sensitive Discount Optimality Criteria , 1969 .

[20]  B. L. Miller Finite state continuous time Markov decision processes with an infinite planning horizon , 1968 .

[21]  A. F. Veinott ON FINDING OPTIMAL POLICIES IN DISCRETE DYNAMIC PROGRAMMING WITH NO DISCOUNTING , 1966 .

[22]  M. Bartlett,et al.  Weak ergodicity in non-homogeneous Markov chains , 1958, Mathematical Proceedings of the Cambridge Philosophical Society.

[23]  J.H.F. Linssen,et al.  continuous-time markov decision processes , 2016 .

[24]  Onésimo Hernández Lerma,et al.  Blackwell optimality for controlled diffusion processes , 2008 .

[25]  Onésimo Hernández-Lerma,et al.  Bias Optimality for Continuous-Time Controlled Markov Chains , 2006, SIAM J. Control. Optim..

[26]  Martin L. Puterman,et al.  A probabilistic analysis of bias optimality in unichain Markov decision processes , 2001, IEEE Trans. Autom. Control..

[27]  Howard M. Taylor,et al.  A laurent series for the resolvent of a strongly continuous stochastic semi-group , 1976 .

[28]  Erhan Çinlar,et al.  Introduction to stochastic processes , 1974 .

[29]  A. Einstein,et al.  The Evolution of Physics , 1938 .