Simulation optimization of risk measures with adaptive risk levels

Optimizing risk measures such as Value-at-Risk (VaR) and Conditional Value-at-Risk (CVaR) of a general loss distribution is usually difficult, because (1) the loss function might lack structural properties such as convexity or differentiability since it is often generated via black-box simulation of a stochastic system; (2) evaluation of risk measures often requires rare-event simulation, which is computationally expensive. In this paper, we study the extension of the recently proposed gradient-based adaptive stochastic search to the optimization of risk measures VaR and CVaR. Instead of optimizing VaR or CVaR at the target risk level directly, we incorporate an adaptive updating scheme on the risk level, by initializing the algorithm at a small risk level and adaptively increasing it until the target risk level is achieved while the algorithm converges at the same time. This enables us to adaptively reduce the number of samples required to estimate the risk measure at each iteration, and thus improving the overall efficiency of the algorithm.

[1]  R. Rockafellar,et al.  Conditional Value-at-Risk for General Loss Distributions , 2001 .

[2]  R. Rockafellar,et al.  Optimization of conditional value-at risk , 2000 .

[3]  V. Borkar Stochastic Approximation: A Dynamical Systems Viewpoint , 2008 .

[4]  Jiaqiao Hu,et al.  A Model Reference Adaptive Search Method for Stochastic Global Optimization , 2008, Commun. Inf. Syst..

[5]  Eric Moulines,et al.  Inference in hidden Markov models , 2010, Springer series in statistics.

[6]  Haikady N. Nagaraja,et al.  Inference in Hidden Markov Models , 2006, Technometrics.

[7]  Jiaqiao Hu,et al.  Gradient-Based Adaptive Stochastic Search for Non-Differentiable Optimization , 2013, IEEE Transactions on Automatic Control.

[8]  Robert L. Smith,et al.  Simulated annealing for constrained global optimization , 1994, J. Glob. Optim..

[9]  Eric Moulines,et al.  Inference in Hidden Markov Models (Springer Series in Statistics) , 2005 .

[10]  Harold J. Kushner,et al.  wchastic. approximation methods for constrained and unconstrained systems , 1978 .

[11]  Philippe Artzner,et al.  Coherent Measures of Risk , 1999 .

[12]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[13]  T. Coleman,et al.  Minimizing CVaR and VaR for a portfolio of derivatives , 2006 .

[14]  Sandeep Juneja,et al.  Nested Simulation in Portfolio Risk Measurement , 2008, Manag. Sci..

[15]  H. Kushner Stochastic approximation: a survey , 2010 .

[16]  F. Downton Stochastic Approximation , 1969, Nature.

[17]  R. Rubinstein Combinatorial Optimization, Cross-Entropy, Ants and Rare Events , 2001 .

[18]  W. Kohn,et al.  Meta-control of an interacting-particle algorithm for global optimization , 2010 .

[19]  M. T. Wasan Stochastic Approximation , 1969 .

[20]  Enlu Zhou,et al.  Risk Quantification in Stochastic Simulation under Input Uncertainty , 2015, ACM Trans. Model. Comput. Simul..

[21]  Zelda B. Zabinsky,et al.  The interacting-particle algorithm with dynamic heating and cooling , 2009, J. Glob. Optim..

[22]  Alexander Shapiro,et al.  Optimization of Convex Risk Functions , 2006, Math. Oper. Res..

[23]  Marco Dorigo,et al.  Ant colony optimization theory: A survey , 2005, Theor. Comput. Sci..

[24]  Michael C. Fu,et al.  A Model Reference Adaptive Search Method for Global Optimization , 2007, Oper. Res..

[25]  H. Kushner,et al.  Stochastic Approximation and Recursive Algorithms and Applications , 2003 .

[26]  Pedro Larrañaga,et al.  Estimation of Distribution Algorithms , 2002, Genetic Algorithms and Evolutionary Computation.

[27]  Andrzej Ruszczynski,et al.  Risk-averse dynamic programming for Markov decision processes , 2010, Math. Program..