On the complexity of energy storage problems

Abstract We analyze the computational complexity of the problem of optimally managing a storage device connected to a source of renewable energy, the power grid, and a household (or some other form of energy demand) in the presence of uncertainty. We provide a mathematical formulation for the problem as a Markov decision process following other models appearing in the literature, and study the complexity of determining a policy to achieve the maximum profit that can be attained over a finite time horizon, or simply the value of such profit. We show that if the problem is deterministic, i.e. there is no uncertainty on prices, energy production, or demand, the problem can be solved in strongly polynomial time. This is also the case in the stochastic setting if energy can be sold and bought for the same price on the spot market. If the sale and buying price are allowed to be different, the stochastic version of the problem is #P-hard, even if we are only interested in determining whether there exists a policy that achieves positive profit. Furthermore, no constant-factor approximation algorithm is possible in general unless P = NP. However, we provide a Fully Polynomial-Time Approximation Scheme (FPTAS) for the variant of the problem in which energy can only be bought from the grid, which is #P-hard.

[1]  James B. Orlin A Faster Strongly Polynomial Minimum Cost Flow Algorithm , 1993, Oper. Res..

[2]  Leslie G. Valiant,et al.  The Complexity of Computing the Permanent , 1979, Theor. Comput. Sci..

[3]  David Simchi-Levi,et al.  Fully polynomial time approximation schemes for stochastic dynamic programs , 2008, SODA '08.

[4]  M. Dahleh,et al.  Optimal Management and Sizing of Energy Storage Under Dynamic Pricing for the Efficient Integration of Renewable Energy , 2015, IEEE Transactions on Power Systems.

[5]  Kazuo Murota,et al.  Discrete convex analysis , 1998, Math. Program..

[6]  David Simchi-Levi,et al.  Approximating the Nonlinear Newsvendor and Single-Item Stochastic Lot-Sizing Problems When Data Is Given by an Oracle , 2012, Oper. Res..

[7]  James B. Orlin,et al.  A Computationally Efficient FPTAS for Convex Stochastic Dynamic Programs , 2013, ESA.

[8]  Warren B. Powell,et al.  A comparison of approximate dynamic programming techniques on benchmark energy storage problems: Does anything work? , 2014, 2014 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL).

[9]  Paul H. Zipkin,et al.  Foundations of Inventory Management , 2000 .

[10]  Nicola Secomandi,et al.  Is it More Valuable to Store or Destroy Electricity Surpluses? , 2012 .

[11]  Diego Klabjan,et al.  A Fully Polynomial Time Approximation Scheme for Single-item Stochastic Inventory Control with Discrete Demand , 2022 .

[12]  Warrren B Powell,et al.  Mean-Conditional Value-at-Risk Optimal Energy Storage Operation in the Presence of Transaction Costs , 2015, IEEE Transactions on Power Systems.

[13]  A. Charnes,et al.  Decision and horizon rules for stochastic planning problems : a linear example , 1966 .

[14]  T. Jenkin,et al.  Opportunities for Electricity Storage in Deregulating Markets , 1999 .

[15]  Sandia Report,et al.  Energy Storage for the Electricity Grid: Benefits and Market Potential Assessment Guide A Study for the DOE Energy Storage Systems Program , 2010 .

[16]  P. Favati Convexity in nonlinear integer programming , 1990 .

[17]  Seinosuke Toda,et al.  PP is as Hard as the Polynomial-Time Hierarchy , 1991, SIAM J. Comput..

[18]  Natarajan Gautam,et al.  Meeting Inelastic Demand in Systems With Storage and Renewable Sources , 2017, IEEE Trans. Smart Grid.

[19]  Juliana M. Nascimento,et al.  Approximate dynamic programming for complex storage problems , 2008 .

[20]  Stephen F. Smith,et al.  Electricity Trading and Negative Prices: Storage vs. Disposal , 2016 .

[21]  R. Rempała Optimal strategy in a trading problem with stochastic prices , 1993, System Modelling and Optimization.

[22]  Nir Halman,et al.  Provably Near-Optimal Approximation Schemes for Implicit Stochastic and Sample-Based Dynamic Programs , 2020, INFORMS J. Comput..

[23]  Jean C. Walrand,et al.  Optimal demand response with energy storage management , 2012, 2012 IEEE Third International Conference on Smart Grid Communications (SmartGridComm).

[24]  Warren B. Powell,et al.  An Optimal Approximate Dynamic Programming Algorithm for Concave, Scalar Storage Problems With Vector-Valued Controls , 2013, IEEE Transactions on Automatic Control.

[25]  J. Iannucci,et al.  Energy Storage Benefits and Market Analysis Handbook A Study for the DOE Energy Storage Systems Program , 2004 .

[26]  Daniel F. Salas,et al.  Benchmarking a Scalable Approximate Dynamic Programming Algorithm for Stochastic Control of Multidimensional Energy Storage Problems , 2013 .

[27]  Stephen F. Smith,et al.  Managing Wind-Based Electricity Generation in the Presence of Storage and Transmission Capacity , 2018, Production and Operations Management.

[28]  G. Nannicini,et al.  Fully Polynomial Time ( ; ) -Approximation Schemes for Continuous Stochastic Convex Dynamic Programs , 2015 .

[29]  Kazuo Murota,et al.  Relationship of M-/L-convex functions with discrete convex functions by Miller and Favati-Tardella , 2001, Discret. Appl. Math..

[30]  Nicola Secomandi,et al.  Optimal Commodity Trading with a Capacitated Storage Asset , 2010, Manag. Sci..

[31]  Evan L. Porteus Foundations of Stochastic Inventory Theory , 2002 .