Better Safe Than Sorry: Risk-Aware Nonlinear Bayesian Estimation

Despite the simplicity and intuitive interpretation of minimum mean squared error (MMSE) estimators, their effectiveness in certain scenarios is questionable. Indeed, minimizing squared errors on average does not provide any form of stability, as the volatility of the estimation error is left unconstrained. When this volatility is statistically significant, the difference between the average and realized performance of the MMSE estimator can be drastically different. To address this issue, we introduce a new risk-aware MMSE formulation which trades between mean performance and risk by explicitly constraining the expected predictive variance of the involved squared error. We show that, under mild moment boundedness conditions, the corresponding risk-aware optimal solution can be evaluated explicitly, and has the form of an appropriately biased nonlinear MMSE estimator. We further illustrate the effectiveness of our approach via several numerical examples, which also showcase the advantages of risk-aware against risk-neutral MMSE estimation, especially in models involving skewed, heavy-tailed distributions.

[1]  S. Dey,et al.  Risk-sensitive filtering and smoothing via reference probability methods , 1995, Proceedings of 1995 American Control Conference - ACC'95.

[2]  Pratap Tokekar,et al.  An Approximation Algorithm for Risk-averse Submodular Optimization , 2018, WAFR.

[3]  Recursive Optimization of Convex Risk Measures: Mean-Semideviation Models , 2018, 1804.00636.

[4]  J. Speyer,et al.  Optimal stochastic estimation with exponential cost criteria , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[5]  Huan Xu,et al.  Risk-Averse Stochastic Convex Bandit , 2018, AISTATS.

[6]  P. Whittle Risk-sensitive linear/quadratic/gaussian control , 1981, Advances in Applied Probability.

[7]  Warrren B Powell,et al.  Mean-Conditional Value-at-Risk Optimal Energy Storage Operation in the Presence of Transaction Costs , 2015, IEEE Transactions on Power Systems.

[8]  Shie Mannor,et al.  Sequential Decision Making With Coherent Risk , 2017, IEEE Transactions on Automatic Control.

[9]  Alec Koppel,et al.  Nonparametric Compositional Stochastic Optimization , 2019, 1902.06011.

[10]  R. Rockafellar,et al.  Optimization of conditional value-at risk , 2000 .

[11]  George J. Pappas,et al.  Risk-Aware MMSE Estimation , 2019, ArXiv.

[12]  Stan Uryasev,et al.  Cash flow matching with risks controlled by buffered probability of exceedance and conditional value-at-risk , 2018, Ann. Oper. Res..

[13]  Alexander Schied,et al.  Convex measures of risk and trading constraints , 2002, Finance Stochastics.

[14]  Yang Liu,et al.  Risk-Averse Access Point Selection in Wireless Communication Networks , 2019, IEEE Transactions on Control of Network Systems.

[15]  Alexander Shapiro,et al.  Risk neutral and risk averse approaches to multistage renewable investment planning under uncertainty , 2016, Eur. J. Oper. Res..

[16]  Robert J. Elliott,et al.  Risk-sensitive generalizations of minimum variance estimation and control , 1997 .

[17]  Karl Henrik Johansson,et al.  Toward Wireless Control in Industrial Process Automation: A Case Study at a Paper Mill , 2019, IEEE Control Systems.

[18]  John B. Moore,et al.  Finite-dimensional risk-sensitive filters and smoothers for discrete-time nonlinear systems , 1999, IEEE Trans. Autom. Control..

[19]  Hui Xiong,et al.  Risk-Averse Classification , 2018, Annals of Operations Research.

[20]  Michael C. Fu,et al.  Risk-Sensitive Reinforcement Learning: A Constrained Optimization Viewpoint , 2018, ArXiv.

[21]  Geoffrey A. Hollinger,et al.  Risk‐aware Path Planning for Autonomous Underwater Vehicles using Predictive Ocean Models , 2013, J. Field Robotics.

[22]  Warren B. Powell,et al.  Risk-Averse Approximate Dynamic Programming with Quantile-Based Risk Measures , 2015, Math. Oper. Res..

[23]  D. Luenberger Optimization by Vector Space Methods , 1968 .

[24]  Wenjie Huang,et al.  Risk-aware Q-learning for Markov decision processes , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).