Optimal operation for energy storage with wind power generation using adaptive dynamic programming

Due to the increasing of intermittent power generation from renewable energy in the smart grid, such as wind power, the unbalance between generation and load demand becomes a critical problem for the power system optimal economic operation. Fortunately, the incorporation of large energy storage device (ESD) into power system operation management could address this problem. In this paper, the energy storage (ES) optimal operation/allocation for smart grid with stochastic wind power generation is investigated. By using adaptive dynamic programming (ADP), five types of real-world ES system, such as electrochemical-based, electrical-based and mechanical-based, with different capacity, charing/discharing rates and efficiency are compared under benchmark energy storage problems with simulation analysis. Moreover, we compare two important parameters (i.e., capacity and charging/dischanrging rates) on average over all storage benchmarks to further investigate the influence on the total profit. Based on the simulation results, we demonstrate that the investigated parameters of the storage device have large influence on the profit.

[1]  Haibo He,et al.  Power System Stability Control for a Wind Farm Based on Adaptive Dynamic Programming , 2015, IEEE Transactions on Smart Grid.

[2]  Stefan Minner,et al.  Optimizing Trading Decisions for Hydro Storage Systems Using Approximate Dual Dynamic Programming , 2013, Oper. Res..

[3]  John N. Tsitsiklis,et al.  Asynchronous stochastic approximation and Q-learning , 1994, Mach. Learn..

[4]  S. Minner,et al.  Optimal day-ahead trading and storage of renewable energies—an approximate dynamic programming approach , 2010 .

[5]  Jinyu Wen,et al.  Energy-Storage-Based Low-Frequency Oscillation Damping Control Using Particle Swarm Optimization and Heuristic Dynamic Programming , 2014, IEEE Transactions on Power Systems.

[6]  K. C. Divya,et al.  Battery Energy Storage Technology for power systems-An overview , 2009 .

[7]  Daniel F. Salas.  Approximate Dynamic Programming Algorithms for the Control of Grid-Level Storage in the Presence of Renewable Generation , 2014 .

[8]  Haibo He,et al.  Comparative study between HDP and PSS on DFIG damping control , 2013, 2013 IEEE Computational Intelligence Applications in Smart Grid (CIASG).

[9]  Warren B. Powell,et al.  A dynamic model for the failure replacement of aging high-voltage transformers , 2010 .

[10]  Jiaqi Liang,et al.  Intelligent Local Area Signals Based Damping of Power System Oscillations Using Virtual Generators and Approximate Dynamic Programming , 2013, IEEE Transactions on Smart Grid.

[11]  Warren B. Powell,et al.  A comparison of approximate dynamic programming techniques on benchmark energy storage problems: Does anything work? , 2014, 2014 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL).

[12]  David B. Dunson,et al.  Approximate Dynamic Programming for Storage Problems , 2011, ICML.

[13]  Valentin A. Boicea,et al.  Energy Storage Technologies: The Past and the Present , 2014, Proceedings of the IEEE.

[14]  Warrren B Powell,et al.  Mean-Conditional Value-at-Risk Optimal Energy Storage Operation in the Presence of Transaction Costs , 2015, IEEE Transactions on Power Systems.

[15]  Warren B. Powell,et al.  Optimal Energy Commitments with Storage and Intermittent Supply , 2011, Oper. Res..

[16]  Warren B. Powell,et al.  An Approximate Dynamic Programming Algorithm for Monotone Value Functions , 2014, Oper. Res..

[17]  Haibo He,et al.  Reactive power control of grid-connected wind farm based on adaptive dynamic programming , 2014, Neurocomputing.

[18]  Warren B. Powell,et al.  Optimal Hour-Ahead Bidding in the Real-Time Electricity Market with Battery Storage Using Approximate Dynamic Programming , 2014, INFORMS J. Comput..

[19]  Daniel F. Salas,et al.  Benchmarking a Scalable Approximate Dynamic Programming Algorithm for Stochastic Control of Multidimensional Energy Storage Problems , 2013 .

[20]  Warren B. Powell,et al.  An Optimal Approximate Dynamic Programming Algorithm for Concave, Scalar Storage Problems With Vector-Valued Controls , 2013, IEEE Transactions on Automatic Control.

[21]  G. Kariniotakis,et al.  Management of Energy Storage Coordinated with Wind Power under Electricity Market Conditions , 2008, Proceedings of the 10th International Conference on Probablistic Methods Applied to Power Systems.

[22]  Haibo He,et al.  Frequency control using on-line learning method for island smart grid with EVs and PVs , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[23]  Jiaqi Liang,et al.  Wide-Area Measurement Based Dynamic Stochastic Optimal Power Flow Control for Smart Grids With High Variability and Uncertainty , 2012, IEEE Transactions on Smart Grid.

[24]  Warren B. Powell,et al.  Approximate Dynamic Programming - Solving the Curses of Dimensionality , 2007 .

[25]  Warren B. Powell,et al.  Handbook of Learning and Approximate Dynamic Programming , 2006, IEEE Transactions on Automatic Control.