Data-driven decision making in power systems with probabilistic guarantees: Theory and applications of chance-constrained optimization

Abstract Uncertainties from deepening penetration of renewable energy resources have posed critical challenges to the secure and reliable operations of future electric grids. Among various approaches for decision making in uncertain environments, this paper focuses on chance-constrained optimization, which provides explicit probabilistic guarantees on the feasibility of optimal solutions. Although quite a few methods have been proposed to solve chance-constrained optimization problems, there is a lack of comprehensive review and comparative analysis of the proposed methods. We first review three categories of existing methods to chance-constrained optimization: (1) scenario approach; (2) sample average approximation; and (3) robust optimization based methods. Data-driven methods, which are not constrained by any particular distributions of the underlying uncertainties, are of particular interest. Key results of the analytical reformulation approach for specific distributions are briefly discussed. We then provide a comprehensive review on the applications of chance-constrained optimization in power systems. Finally, this paper provides a critical comparison of existing methods based on numerical simulations, which are conducted on standard power system test cases.

[1]  András Prékopa,et al.  Uniform quasi-concavity in probabilistic constrained stochastic programming , 2011, Oper. Res. Lett..

[2]  Sergio Grammatico,et al.  On the sample size of random convex programs with structured dependence on the uncertainty , 2015, Autom..

[3]  Daniel K. Molzahn,et al.  Examining the limits of the application of semidefinite programming to power flow problems , 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[4]  Yongpei Guan,et al.  Price-Based Unit Commitment With Wind Power Utilization Constraints , 2013, IEEE Transactions on Power Systems.

[5]  Alexander Shapiro,et al.  Lectures on Stochastic Programming: Modeling and Theory , 2009 .

[6]  Giuseppe Carlo Calafiore,et al.  The scenario approach to robust control design , 2006, IEEE Transactions on Automatic Control.

[7]  Maria Vrakopoulou,et al.  Risk-Based Optimal Power Flow with Probabilistic Guarantees , 2015 .

[8]  Bri-Mathias Hodge,et al.  Wind power forecasting error distributions over multiple timescales , 2011, 2011 IEEE Power and Energy Society General Meeting.

[9]  Marco C. Campi,et al.  A Sampling-and-Discarding Approach to Chance-Constrained Optimization: Feasibility and Optimality , 2011, J. Optim. Theory Appl..

[10]  Bo Zeng,et al.  Chance Constrained Mixed Integer Program: Bilinear and Linear Formulations, and Benders Decomposition , 2014, 1403.7875.

[11]  Arkadi Nemirovski,et al.  Robust Convex Optimization , 1998, Math. Oper. Res..

[12]  Marco C. Campi,et al.  Wait-and-judge scenario optimization , 2016, Mathematical Programming.

[13]  Arkadi Nemirovski,et al.  On safe tractable approximations of chance constraints , 2012, Eur. J. Oper. Res..

[14]  Andrzej Ruszczynski,et al.  Probabilistic programming with discrete distributions and precedence constrained knapsack polyhedra , 2002, Math. Program..

[15]  Le Xie,et al.  Data-driven Decision Making with Probabilistic Guarantees (Part 2): Applications of Chance-constrained Optimization in Power Systems , 2019 .

[16]  Yongpei Guan,et al.  Expected Value and Chance Constrained Stochastic Unit Commitment Ensuring Wind Power Utilization , 2014, IEEE Transactions on Power Systems.

[17]  Gabriela Hug,et al.  Convex Relaxations of Chance Constrained AC Optimal Power Flow , 2017, 2018 IEEE Power & Energy Society General Meeting (PESGM).

[18]  Xu Andy Sun,et al.  Adaptive Robust Optimization for the Security Constrained Unit Commitment Problem , 2013, IEEE Transactions on Power Systems.

[19]  Suvrajeet Sen Relaxations for probabilistically constrained programs with discrete random variables , 1992, Oper. Res. Lett..

[20]  Chiranjib Bhattacharyya,et al.  Chance constrained uncertain classification via robust optimization , 2011, Math. Program..

[21]  Alexander Shapiro,et al.  Convex Approximations of Chance Constrained Programs , 2006, SIAM J. Optim..

[22]  James R. Luedtke,et al.  A Sample Approximation Approach for Optimization with Probabilistic Constraints , 2008, SIAM J. Optim..

[23]  Arkadi Nemirovski,et al.  Robust solutions of uncertain linear programs , 1999, Oper. Res. Lett..

[24]  Maria Polukarov,et al.  The minmax multidimensional knapsack problem with application to a chance‐constrained problem , 2007 .

[25]  Michael Chertkov,et al.  Optimal Power Flow with Weighted chance constraints and general policies for generation control , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[26]  Zechun Hu,et al.  Chance-Constrained Two-Stage Unit Commitment Under Uncertain Load and Wind Power Output Using Bilinear Benders Decomposition , 2016, IEEE Transactions on Power Systems.

[27]  J Figueira,et al.  Stochastic Programming , 1998, J. Oper. Res. Soc..

[28]  Andrew Morrison,et al.  Optimized risk limits for stochastic optimal power flow , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[29]  Fushuan Wen,et al.  A chance constrained programming approach to transmission system expansion planning , 2005 .

[30]  H. Föllmer,et al.  Stochastic Finance: An Introduction in Discrete Time , 2002 .

[31]  A. Prékopa,et al.  Programming Under Probabilistic Constraint with Discrete Random Variable , 1998 .

[32]  L. Khachiyan COMMUNICATIONS OF THE MOSCOW MATHEMATICAL SOCIETY: The problem of calculating the volume of a polyhedron is enumerably hard , 1989 .

[33]  Ruben Romero,et al.  Robust Multi-Stage Substation Expansion Planning Considering Stochastic Demand , 2016, IEEE Transactions on Power Systems.

[34]  János D. Pintér,et al.  Deterministic approximations of probability inequalities , 1989, ZOR Methods Model. Oper. Res..

[35]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[36]  Michael Chertkov,et al.  Robust modeling of probabilistic uncertainty in smart Grids: Data ambiguous Chance Constrained Optimum Power Flow , 2013, 52nd IEEE Conference on Decision and Control.

[37]  Simge Küçükyavuz,et al.  On mixing sets arising in chance-constrained programming , 2012, Math. Program..

[38]  Shie Mannor,et al.  Robust Regression and Lasso , 2008, IEEE Transactions on Information Theory.

[39]  David Pozo,et al.  A convex chance-constrained model for reactive power planning , 2015 .

[40]  Mohamed Shaaban,et al.  A Hybrid Stochastic/Deterministic Unit Commitment Based on Projected Disjunctive MILP Reformulation , 2016, IEEE Transactions on Power Systems.

[41]  Lewis Ntaimo,et al.  IIS branch-and-cut for joint chance-constrained stochastic programs and application to optimal vaccine allocation , 2010, Eur. J. Oper. Res..

[42]  Peng Sun,et al.  A Robust Optimization Perspective on Stochastic Programming , 2007, Oper. Res..

[43]  Goran Andersson,et al.  Analytical reformulation of security constrained optimal power flow with probabilistic constraints , 2013, 2013 IEEE Grenoble Conference.

[44]  Michael Chertkov,et al.  Chance-Constrained Optimal Power Flow: Risk-Aware Network Control under Uncertainty , 2012, SIAM Rev..

[45]  Bowen Li,et al.  Chance Constrained Reserve Scheduling Using Uncertain Controllable Loads Part I: Formulation and Scenario-Based Analysis , 2019, IEEE Transactions on Smart Grid.

[46]  M. Yaari,et al.  Uncertain lifetime, life insurance, and the theory of the consumer , 1965 .

[47]  Jianxue Wang,et al.  Chance-constrained transmission expansion planning with guaranteed wind power utilization , 2017, 2017 IEEE Power & Energy Society General Meeting.

[48]  A. Charnes,et al.  Chance-Constrained Programming , 1959 .

[49]  Stephen J. Wright,et al.  Optimization for Machine Learning , 2013 .

[50]  G. Calafiore,et al.  On Distributionally Robust Chance-Constrained Linear Programs , 2006 .

[51]  Bruce H. Krogh,et al.  Wind Integration in Power Systems: Operational Challenges and Possible Solutions , 2011, Proceedings of the IEEE.

[52]  Pu Li,et al.  Stochastic Optimization for Operating Chemical Processes under Uncertainty , 2001 .

[53]  Johanna L. Mathieu,et al.  Analytical reformulation of chance-constrained optimal power flow with uncertain load control , 2015, 2015 IEEE Eindhoven PowerTech.

[54]  Javier Contreras,et al.  A Chance-Constrained Unit Commitment With an $n-K$ Security Criterion and Significant Wind Generation , 2013, IEEE Transactions on Power Systems.

[55]  Giuseppe Carlo Calafiore,et al.  Random Convex Programs , 2010, SIAM J. Optim..

[56]  Goran Andersson,et al.  Probabilistic N−1 security assessment incorporating dynamic line ratings , 2013, 2013 IEEE Power & Energy Society General Meeting.

[57]  P. R. Kumar,et al.  Scenario-Based Economic Dispatch With Tunable Risk Levels in High-Renewable Power Systems , 2019, IEEE Transactions on Power Systems.

[58]  Melvyn Sim,et al.  The Price of Robustness , 2004, Oper. Res..

[59]  R D Zimmerman,et al.  MATPOWER: Steady-State Operations, Planning, and Analysis Tools for Power Systems Research and Education , 2011, IEEE Transactions on Power Systems.

[60]  Ruiwei Jiang,et al.  Robust Unit Commitment With Wind Power and Pumped Storage Hydro , 2012, IEEE Transactions on Power Systems.

[61]  Cécile Murat,et al.  Recent advances in robust optimization: An overview , 2014, Eur. J. Oper. Res..

[62]  Kees Roos,et al.  Robust Solutions of Uncertain Quadratic and Conic-Quadratic Problems , 2002, SIAM J. Optim..

[63]  Wim van Ackooij,et al.  Eventual convexity of chance constrained feasible sets , 2015 .

[64]  Johanna L. Mathieu,et al.  Distributionally Robust Chance-Constrained Optimal Power Flow With Uncertain Renewables and Uncertain Reserves Provided by Loads , 2017, IEEE Transactions on Power Systems.

[65]  Alexander Shapiro,et al.  Sample Average Approximation Method for Chance Constrained Programming: Theory and Applications , 2009, J. Optimization Theory and Applications.

[66]  Kyri Baker,et al.  Chance-Constrained AC Optimal Power Flow for Distribution Systems With Renewables , 2017, IEEE Transactions on Power Systems.

[67]  A. Charnes,et al.  Deterministic Equivalents for Optimizing and Satisficing under Chance Constraints , 1963 .

[68]  A. Shapiro,et al.  Solving Chance-Constrained Stochastic Programs via Sampling and Integer Programming , 2008 .

[69]  Jianhui Wang,et al.  Stochastic Optimization for Unit Commitment—A Review , 2015, IEEE Transactions on Power Systems.

[70]  Feng Liu,et al.  Chance-Constrained Economic Dispatch With Non-Gaussian Correlated Wind Power Uncertainty , 2017, IEEE Transactions on Power Systems.

[71]  Le Xie,et al.  Scenario-Based Economic Dispatch With Uncertain Demand Response , 2017, IEEE Transactions on Smart Grid.

[72]  John Lygeros,et al.  Stochastic unit commitment and reserve scheduling: A tractable formulation with probabilistic certificates , 2013, 2013 European Control Conference (ECC).

[73]  Nikolaos V. Sahinidis,et al.  Optimization under uncertainty: state-of-the-art and opportunities , 2004, Comput. Chem. Eng..

[74]  Lorenzo Fagiano,et al.  Randomized Solutions to Convex Programs with Multiple Chance Constraints , 2012, SIAM J. Optim..

[75]  Patrizia Beraldi,et al.  The Probabilistic Set-Covering Problem , 2002, Oper. Res..

[76]  Maria Vrakopoulou,et al.  Risk-constrained optimal power flow with probabilistic guarantees , 2014 .

[77]  Melvyn Sim,et al.  From CVaR to Uncertainty Set: Implications in Joint Chance-Constrained Optimization , 2010, Oper. Res..

[78]  Wei-Jen Lee,et al.  Studies on stochastic unit commitment formulation with flexible generating units , 2010 .

[79]  M. Shahidehpour,et al.  Stochastic Security-Constrained Unit Commitment , 2007, IEEE Transactions on Power Systems.

[80]  William Rosehart,et al.  Sensitivity-based chance-constrained Generation Expansion Planning , 2015 .

[81]  Yongpei Guan,et al.  A Chance-Constrained Two-Stage Stochastic Program for Unit Commitment With Uncertain Wind Power Output , 2012 .

[82]  Arun P. Sanghvi,et al.  Strategic Planning for Power System Reliability and Vulnerability: an Optimization Model for Resource Planning Under Uncertainty , 1982, IEEE Power Engineering Review.

[83]  Le Xie,et al.  Data-driven Decision Making with Probabilistic Guarantees (Part 1): A Schematic Overview of Chance-constrained Optimization , 2019, 1903.10621.

[84]  John Lygeros,et al.  A Probabilistic Framework for Reserve Scheduling and ${\rm N}-1$ Security Assessment of Systems With High Wind Power Penetration , 2013, IEEE Transactions on Power Systems.

[85]  John Lygeros,et al.  Probabilistic security-constrained AC optimal power flow , 2013, 2013 IEEE Grenoble Conference.

[86]  Zhao Yang Dong,et al.  A Risk-Based Approach to Multi-Stage Probabilistic Transmission Network Planning , 2016, IEEE Transactions on Power Systems.

[87]  Maria Vrakopoulou,et al.  Stochastic security constrained unit commitment and non-spinning reserve allocation with performance guarantees , 2015 .

[88]  S. Kataoka A Stochastic Programming Model , 1963 .

[89]  Veit Hagenmeyer,et al.  Solving optimal power flow with non-Gaussian uncertainties via polynomial chaos expansion , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[90]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[91]  B. Norman,et al.  A solution to the stochastic unit commitment problem using chance constrained programming , 2004 .

[92]  Rabih A. Jabr,et al.  Adjustable Robust OPF With Renewable Energy Sources , 2013, IEEE Transactions on Power Systems.

[93]  Meysam Doostizadeh,et al.  Energy and Reserve Scheduling Under Wind Power Uncertainty: An Adjustable Interval Approach , 2016, IEEE Transactions on Smart Grid.

[94]  Melvyn Sim,et al.  Goal-Driven Optimization , 2009, Oper. Res..

[95]  M. Mazadi,et al.  Modified Chance-Constrained Optimization Applied to the Generation Expansion Problem , 2009, IEEE Transactions on Power Systems.

[96]  Ruiwei Jiang,et al.  Cutting planes for the multistage stochastic unit commitment problem , 2016, Math. Program..

[97]  Giuseppe Carlo Calafiore,et al.  Uncertain convex programs: randomized solutions and confidence levels , 2005, Math. Program..

[98]  Constantino Lagoa,et al.  On the convexity of probabilistically constrained linear programs , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[99]  Miles Lubin,et al.  A Robust Approach to Chance Constrained Optimal Power Flow With Renewable Generation , 2015, IEEE Transactions on Power Systems.

[100]  Goran Andersson,et al.  Corrective Control to Handle Forecast Uncertainty: A Chance Constrained Optimal Power Flow , 2017 .

[101]  Mohammad Shahidehpour,et al.  The IEEE Reliability Test System-1996. A report prepared by the Reliability Test System Task Force of the Application of Probability Methods Subcommittee , 1999 .

[102]  Georgios B. Giannakis,et al.  Robust optimal power flow with wind integration using conditional value-at-risk , 2013, 2013 IEEE International Conference on Smart Grid Communications (SmartGridComm).

[103]  Melvyn Sim,et al.  Tractable Approximations to Robust Conic Optimization Problems , 2006, Math. Program..

[104]  John R. Birge,et al.  A stochastic model for the unit commitment problem , 1996 .

[105]  Göran Andersson,et al.  Chance-Constrained AC Optimal Power Flow: Reformulations and Efficient Algorithms , 2017, IEEE Transactions on Power Systems.

[106]  John Lygeros,et al.  Stochastic optimal power flow based on conditional value at risk and distributional robustness , 2015 .

[107]  René Henrion,et al.  Convexity of chance constraints with independent random variables , 2008, Comput. Optim. Appl..

[108]  Maria Gabriela Martinez,et al.  A Risk-Averse Optimization Model for Unit Commitment Problems , 2015, 2015 48th Hawaii International Conference on System Sciences.

[109]  Laurence A. Wolsey,et al.  Covering Linear Programming with Violations , 2014, INFORMS J. Comput..

[110]  M. Campi,et al.  The scenario approach for systems and control design , 2008 .

[111]  Yuanxiong Guo,et al.  Data-driven chance-constrained stochastic unit commitment under wind power uncertainty , 2017, 2017 IEEE Power & Energy Society General Meeting.

[112]  Bowen Li,et al.  Chance Constrained Reserve Scheduling Using Uncertain Controllable Loads Part II: Analytical Reformulation , 2019, IEEE Transactions on Smart Grid.

[113]  Vishal Gupta,et al.  Data-driven robust optimization , 2013, Math. Program..

[114]  René Henrion,et al.  Convexity of Chance Constraints with Dependent Random Variables: The Use of Copulae , 2011 .

[115]  Manfred Morari,et al.  Stochastic optimal power flow based on convex approximations of chance constraints , 2014, 2014 Power Systems Computation Conference.

[116]  John Lygeros,et al.  Probabilistic guarantees for the N-1 security of systems with wind power generation , 2013 .

[117]  Wei Tian,et al.  Chance-Constrained Day-Ahead Scheduling in Stochastic Power System Operation , 2014, IEEE Transactions on Power Systems.

[118]  Marco C. Campi,et al.  The Exact Feasibility of Randomized Solutions of Uncertain Convex Programs , 2008, SIAM J. Optim..

[119]  B. L. Miller,et al.  Chance Constrained Programming with Joint Constraints , 1965 .

[120]  Tamás Szántai,et al.  Stochastic programming in water management: A case study and a comparison of solution techniques , 1991 .

[121]  Arye Nehorai,et al.  Joint Optimization of Hybrid Energy Storage and Generation Capacity With Renewable Energy , 2013, IEEE Transactions on Smart Grid.

[122]  V. Quintana,et al.  Generation and Transmission Expansion Under Risk Using Stochastic Programming , 2007, IEEE Transactions on Power Systems.

[123]  Constantine Caramanis,et al.  Theory and Applications of Robust Optimization , 2010, SIAM Rev..

[124]  Russell Bent,et al.  Synchronization-aware and algorithm-efficient chance constrained optimal power flow , 2013, 2013 IREP Symposium Bulk Power System Dynamics and Control - IX Optimization, Security and Control of the Emerging Power Grid.

[125]  Xiao-Ping Zhang,et al.  A Solution to the Chance-Constrained Two-Stage Stochastic Program for Unit Commitment With Wind Energy Integration , 2016, IEEE Transactions on Power Systems.

[126]  Johan Löfberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004 .

[127]  Roy Billinton,et al.  Reliability evaluation of power systems , 1984 .

[128]  Johan Löfberg,et al.  Automatic robust convex programming , 2012, Optim. Methods Softw..

[129]  R. Rockafellar,et al.  Optimization of conditional value-at risk , 2000 .

[130]  Simone Garatti,et al.  A General Scenario Theory for Nonconvex Optimization and Decision Making , 2018, IEEE Transactions on Automatic Control.

[131]  C. Chung,et al.  A Novel Probabilistic Optimal Power Flow Model With Uncertain Wind Power Generation Described by Customized Gaussian Mixture Model , 2016, IEEE Transactions on Sustainable Energy.

[132]  George L. Nemhauser,et al.  An integer programming approach for linear programs with probabilistic constraints , 2010, Math. Program..

[133]  Johanna L. Mathieu,et al.  Data-driven optimization approaches for optimal power flow with uncertain reserves from load control , 2015, 2015 American Control Conference (ACC).

[134]  A. Charnes,et al.  Cost Horizons and Certainty Equivalents: An Approach to Stochastic Programming of Heating Oil , 1958 .