Variance-Constrained Risk Sharing in Stochastic Systems

This paper proposes a new continuous-time first best contract framework that has the ability to explicitly limit the agent's risks. This limitation of risk is achieved by formulating the contract design problem as a mean-variance constrained stochastic optimal control problem. To obtain a globally optimal contract even when system dynamics are nonlinear, we develop a dynamic programming-based solution approach. The major theoretical challenge arises from the variance inequality constraint. To overcome this difficulty, we track and limit the agent's risk using a new stochastic system, whose state value can be interpreted as the agent's remaining budget for risks. We also propose an approximately decoupled contract design approach for multiple agents to resolve the scalability issue inherent in dynamic programming. The procedures in this contract design for multiple agents can be completely parallelized. We show that this approximate contract satisfies each agent's individual rationality condition and has a provable suboptimality bound. The performance and usefulness of the proposed contract method and its application to demand response are demonstrated using data on the electric energy consumption of customers in Austin, Texas, and the locational marginal price data from the Electricity Reliability Council of Texas.

[1]  Shmuel S. Oren,et al.  Hedging quantity risks with standard power options in a competitive wholesale electricity market , 2006 .

[2]  P. Lions,et al.  User’s guide to viscosity solutions of second order partial differential equations , 1992, math/9207212.

[3]  Holger M. Müller The First-Best Sharing Rule in the Continuous-Time Principal-Agent Problem with Exponential Utility , 1998 .

[4]  Insoon Yang,et al.  Risk Management and Combinatorial Optimization for Large-Scale Demand Response and Renewable Energy Integration , 2015 .

[5]  Nizar Touzi,et al.  Stochastic Target Problems, Dynamic Programming, and Viscosity Solutions , 2002, SIAM J. Control. Optim..

[6]  Claire J. Tomlin,et al.  Indirect load control for electricity market risk management via risk-limiting dynamic contracts , 2015, 2015 American Control Conference (ACC).

[7]  Asuman E. Ozdaglar,et al.  Reducing electricity price volatility via stochastic storage control , 2016, 2016 American Control Conference (ACC).

[8]  D. L. Hanson,et al.  ON THE THEORY OF RISK AVERSION , 1970 .

[9]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[10]  Bruno Bouchard,et al.  Weak Dynamic Programming for Generalized State Constraints , 2012, SIAM J. Control. Optim..

[11]  S. Oren,et al.  Large-Scale Integration of Deferrable Demand and Renewable Energy Sources , 2014, IEEE Transactions on Power Systems.

[12]  M. Ilić,et al.  Stochastic modeling of electric power prices in a multi-market environment , 2000, 2000 IEEE Power Engineering Society Winter Meeting. Conference Proceedings (Cat. No.00CH37077).

[13]  R. C. Sonderegger Dynamic models of house heating based on equivalent thermal parameters , 1978 .

[14]  Jaksa Cvitanic,et al.  Optimal risk-sharing with effort and project choice , 2007, J. Econ. Theory.

[15]  J. Ma,et al.  Forward-Backward Stochastic Differential Equations and their Applications , 2007 .

[16]  R Bellman,et al.  DYNAMIC PROGRAMMING AND LAGRANGE MULTIPLIERS. , 1956, Proceedings of the National Academy of Sciences of the United States of America.

[17]  Sten Bay Jørgensen,et al.  Parameter estimation in stochastic grey-box models , 2004, Autom..

[18]  S. Peng,et al.  Fully Coupled Forward-Backward Stochastic Differential Equations and Applications to Optimal Control , 1999 .

[19]  Claire J. Tomlin,et al.  Dynamic contracts with partial observations: Application to indirect load control , 2014, 2014 American Control Conference.

[20]  H. Kushner Numerical Methods for Stochastic Control Problems in Continuous Time , 2000 .

[21]  Marco Pritoni,et al.  Cloudfridge: A Cloud-Based Control System for Commercial Refrigeration Systems , 2017 .

[22]  Insoon Yang,et al.  Optimal Control of Conditional Value-at-Risk in Continuous Time , 2015, SIAM J. Control. Optim..

[23]  J. Pratt RISK AVERSION IN THE SMALL AND IN THE LARGE11This research was supported by the National Science Foundation (grant NSF-G24035). Reproduction in whole or in part is permitted for any purpose of the United States Government. , 1964 .

[24]  Hui Ou-Yang,et al.  Optimal Contracts in a Continuous-Time Delegated Portfolio Management Problem , 2003 .

[25]  R. E. Kalman,et al.  New Results in Linear Filtering and Prediction Theory , 1961 .

[26]  Severin Borenstein,et al.  Customer Risk from Real-Time Retail Electricity Pricing: Bill Volatility and Hedgability , 2006 .

[27]  Rakesh K. Sarin,et al.  RELATIVE RISK AVERSION. , 1982 .

[28]  Yuliy Sannikov A Continuous-Time Version of the Principal-Agent , 2005 .

[29]  Simon M. J. Lyons Introduction to stochastic differential equations , 2011 .

[30]  S. Shreve,et al.  Optimal portfolio and consumption decisions for a “small investor” on a finite horizon , 1987 .

[31]  H. M. Markowitz Approximating Expected Utility by a Function of Mean and Variance , 2016 .

[32]  Stanley R. Pliska,et al.  A Stochastic Calculus Model of Continuous Trading: Optimal Portfolios , 1986, Math. Oper. Res..

[33]  S. Peng A general stochastic maximum principle for optimal control problems , 1990 .

[34]  Bruno Bouchard,et al.  Optimal Control under Stochastic Target Constraints , 2009, SIAM J. Control. Optim..

[35]  J. Bismut An Introductory Approach to Duality in Optimal Stochastic Control , 1978 .

[36]  S. Deng,et al.  Stochastic Models of Energy Commodity Prices and Their Applications : Mean-reversion with Jumps and Spikes , 1998 .

[37]  Pravin Varaiya,et al.  Stochastic Systems: Estimation, Identification, and Adaptive Control , 1986 .

[38]  Claire J. Tomlin,et al.  Direct load control for electricity market risk management via risk-limiting dynamic contracts , 2014, 2014 52nd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[39]  G. Barles,et al.  Convergence of approximation schemes for fully nonlinear second order equations , 1990, 29th IEEE Conference on Decision and Control.

[40]  F. Antonelli,et al.  Backward-Forward Stochastic Differential Equations , 1993 .