Pareto Optimal Operation of Distributed Battery Energy Storage Systems for Energy Arbitrage under Dynamic Pricing

The optimal operation of a distributed battery energy storage system (BESS) for energy arbitrage under dynamic pricing is studied in this paper, and the Pareto optimal arbitrage policy that balances the economic value and lifetime tradeoff of the BESS is obtained. Specifically, the lifetime performance of the BESS is represented by its average lifetime, i.e., the average operational duration within which its capacity stays above a certain threshold, and the value performance of the BESS is defined as the total average arbitrage value within its entire lifetime. We propose a constrained stochastic shortest path (CSSP) model to characterize the optimal value-lifetime performance pair. By exploiting the hidden structure of this CSSP problem, an efficient parallel algorithm is proposed to compute the optimal policy. We further prove the condition under which the optimal policy is Pareto optimal. This implies that the achievable optimal value-lifetime performance pair is globally optimal as long as the system-wide utility is monotonically increasing in both the value performance and the lifetime performance. We validate our proposed model and algorithm via real battery specifications and electricity market data, and the results show promising insights for both infrastructure planning and operational management of BESSs in practice.

[1]  Munther A. Dahleh,et al.  Robust and Optimal Consumption Policies for Deadline-Constrained Deferrable Loads , 2014, IEEE Transactions on Smart Grid.

[2]  Saswati Sarkar,et al.  A framework for optimal battery management for wireless nodes , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[3]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[4]  E. Altman Constrained Markov Decision Processes , 1999 .

[5]  Farrokh Albuyeh,et al.  Grid of the future , 2009, IEEE Power and Energy Magazine.

[6]  Miao Pan,et al.  Optimal Power Management of Residential Customers in the Smart Grid , 2012, IEEE Transactions on Parallel and Distributed Systems.

[7]  Yuan Wu,et al.  Optimal energy trading with battery energy storage under dynamic pricing , 2014, 2014 IEEE International Conference on Smart Grid Communications (SmartGridComm).

[8]  Lang Tong,et al.  On the operation and value of storage in consumer demand response , 2014, 53rd IEEE Conference on Decision and Control.

[9]  Yuan Wu,et al.  Economic analysis of lifetime-constrained battery storage under dynamic pricing , 2013, 2013 IEEE International Conference on Smart Grid Communications (SmartGridComm).

[10]  Zhu Han,et al.  Distributed Demand Side Management with Energy Storage in Smart Grid , 2015, IEEE Transactions on Parallel and Distributed Systems.

[11]  Yvonne Freeh,et al.  Handbook Of Batteries , 2016 .

[12]  Andrea Zanella,et al.  Optimal and Compact Control Policies for Energy Storage Units With Single and Multiple Batteries , 2014, IEEE Transactions on Smart Grid.

[13]  Laurent Massoulié,et al.  Optimal Control of End-User Energy Storage , 2012, IEEE Transactions on Smart Grid.

[14]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[15]  James F. Manwell,et al.  Lifetime Modelling of Lead Acid Batteries , 2005 .

[16]  B. Nordstrom FINITE MARKOV CHAINS , 2005 .

[17]  Vincent K. N. Lau,et al.  Energy-Efficient Delay-Constrained Transmission and Sensing for Cognitive Radio Systems , 2012, IEEE Transactions on Vehicular Technology.

[18]  J. Apt,et al.  Economics of electric energy storage for energy arbitrage and regulation in New York , 2007 .

[19]  Yuguang Fang,et al.  Optimal Threshold Policy for In-Home Smart Grid with Renewable Generation Integration , 2015, IEEE Transactions on Parallel and Distributed Systems.

[20]  G. Gutierrez-Alcaraz,et al.  Electricity market price dynamics: Markov process analysis , 2004, 2004 International Conference on Probabilistic Methods Applied to Power Systems.

[21]  Saswati Sarkar,et al.  A framework for optimal battery management for wireless nodes , 2003, IEEE J. Sel. Areas Commun..

[22]  Pedram Mokrian,et al.  A Stochastic Programming Framework for the Valuation of Electricity Storage , 2022 .

[23]  Munther A. Dahleh,et al.  On the value and price-responsiveness of ramp-constrained storage , 2013 .

[24]  M. Dahleh,et al.  Optimal Management and Sizing of Energy Storage Under Dynamic Pricing for the Efficient Integration of Renewable Energy , 2015, IEEE Transactions on Power Systems.

[25]  L. Soder,et al.  Modeling Real-Time Balancing Power Market Prices Using Combined SARIMA and Markov Processes , 2008, IEEE Transactions on Power Systems.

[26]  Hui Li,et al.  Sizing Strategy of Distributed Battery Storage System With High Penetration of Photovoltaic for Voltage Regulation and Peak Load Shaving , 2014, IEEE Transactions on Smart Grid.

[27]  Han-I Su,et al.  Modeling and Analysis of the Role of Energy Storage for Renewable Integration: Power Balancing , 2013, IEEE Transactions on Power Systems.