Variance Minimization in Stochastic Systems

In portfolio selection, almost every investor would like to maximize his/her expected return while at the same time minimizing his/her risk that is often represented by a variance term. In dual control problems, the uncertainty, that can be characterized by a variance term, can be significantly reduced through active learning or probing. On the one hand, variance minimization problems are widely encountered in real-world applications. On the other hand, variance minimization is a notorious problem in optimization due to its associated properties of nonconvexity and nonseparability. The traditional optimal stochastic control theory concerns a sole objective of minimizing the expected value of a performance measure. There is a need to develop an efficient solution framework to deal with a general class of variance minimization problems. A novel solution approach is developed in this chapter to tackle variance minimization problems by exploring special features in variance minimization. Convexification and separation schemes are adopted to overcome the analytical and computational difficulties in variance minimization and to seek an analytical optimal feedback control law by a mathematically tractable setting.

[1]  Moshe Sniedovich A Class of Variance-Constrained Problems , 1983, Oper. Res..

[2]  Duan Li Iterative Parametric Dynamic Programming and Its Application in Reliability Optimization , 1995 .

[3]  Duan Li,et al.  Optimal Dynamic Portfolio Selection: Multiperiod Mean‐Variance Formulation , 2000 .

[4]  Peilin Fu,et al.  Variance minimization approach for a class of dual control problems , 2002, IEEE Trans. Autom. Control..

[5]  Yacov Y. Haimes,et al.  Extension of dynamic programming to nonseparable dynamic optimization problems , 1991 .

[6]  D. White Mean, variance, and probabilistic criteria in finite Markov decision processes: A review , 1988 .

[7]  A. Stuart,et al.  Portfolio Selection: Efficient Diversification of Investments , 1959 .

[8]  D. Naidu,et al.  Optimal Control Systems , 2018 .

[9]  X. Zhou,et al.  Continuous-Time Mean-Variance Portfolio Selection: A Stochastic LQ Framework , 2000 .

[10]  D. J. White Utility, probabilistic constraints, mean and variance of discounted rewards in Markov decision processes , 1987 .

[11]  M. J. Sobel The variance of discounted Markov decision processes , 1982 .

[12]  R. C. Merton,et al.  An Analytic Derivation of the Efficient Portfolio Frontier , 1972, Journal of Financial and Quantitative Analysis.

[13]  Jayant G. Deshpande,et al.  Adaptive control of linear stochastic systems , 1973 .

[14]  A. Roy Safety first and the holding of assetts , 1952 .

[15]  Moshe Sniedovich Solution strategies for variance minimization problems , 1991 .

[16]  Kenneth A. Loparo,et al.  Optimal policies for passive learning controllers , 1989, Autom..

[17]  Duan Li On general multiple linear-quadratic control problems , 1993, IEEE Trans. Autom. Control..

[18]  Y. Haimes,et al.  New approach for nonseparable dynamic programming problems , 1990 .

[19]  D. J. White Technical Note - Dynamic Programming and Probabilistic Constraints , 1974, Oper. Res..

[20]  Duan Li Multiple objectives and non-separability in stochastic dynamic programming , 1990 .