Robust and Stochastic Optimization With a Hybrid Coherent Risk Measure With an Application to Supervised Learning

This letter considers a hybrid risk measure for decision-making under uncertainties that tradeoffs between the solutions obtained from the robust optimization and the stochastic optimization techniques. In the proposed framework, the risk measure is shown to satisfy the properties of coherent risk measures. We can control the level of guaranteed robustness using a parameter. We formulate the stochastic and robust optimization problem under the proposed risk measure and show its equivalent formulation and sensitivity result. We introduce the sample approximation of our technique by combining scenario program and sample average approximation, making our framework amenable for practical usage. We present a supervised learning problem as a case study to corroborate our results and show the implications of the proposed method in machine learning.

[1]  Jean B. Lasserre,et al.  Level Sets and NonGaussian Integrals of Positively Homogeneous Functions , 2011, IGTR.

[2]  Marco C. Campi,et al.  The Exact Feasibility of Randomized Solutions of Uncertain Convex Programs , 2008, SIAM J. Optim..

[3]  A. Ruszczynski,et al.  Optimization of Risk Measures , 2006 .

[4]  Melvyn Sim,et al.  The Price of Robustness , 2004, Oper. Res..

[5]  J. Norris Appendix: probability and measure , 1997 .

[6]  Toshinao Yoshiba,et al.  Comparative Analyses of Expected Shortfall and Value-at-Risk (3): Their Validity under Market Stress , 2002 .

[7]  Daniel Kuhn,et al.  Distributionally Robust Convex Optimization , 2014, Oper. Res..

[8]  Alexander Shapiro,et al.  A Tutorial on Stochastic Programming , 2007 .

[9]  Constantine Caramanis,et al.  Theory and Applications of Robust Optimization , 2010, SIAM Rev..

[10]  Giuseppe Carlo Calafiore,et al.  Random Convex Programs , 2010, SIAM J. Optim..

[11]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .

[12]  Jean-Philippe Vial,et al.  Robust Optimization , 2021, ICORES.

[13]  Rajen B. Bhatt,et al.  User Localization in an Indoor Environment Using Fuzzy Hybrid of Particle Swarm Optimization & Gravitational Search Algorithm with Neural Networks , 2016, SocProS.

[14]  R. Tempo,et al.  On the sample complexity of randomized approaches to the analysis and design under uncertainty , 2010, Proceedings of the 2010 American Control Conference.

[15]  P. Billingsley,et al.  Probability and Measure , 1980 .

[16]  Philippe Artzner,et al.  Coherent Measures of Risk , 1999 .

[17]  Alexander Shapiro,et al.  Lectures on Stochastic Programming: Modeling and Theory , 2009 .