Risk-averse real-time dispatch of integrated electricity and heat system using a modified approximate dynamic programming approach

Coordinated operation of integrated electricity and heat system can improve operation flexibility and reduce cost. However, multiple uncertainties challenge its optimal operation. This paper aims at developing a risk-averse and computationally efficient policy for real-time stochastic dispatch of integrated electricity and heat system, which improves the economy as well as avoiding the risk of high costs in critical scenarios. First, real-time dispatch of integrated electricity and heat system is formulated as a multistage risk-averse stochastic sequential optimization problem with dynamic risk measure, where combined heat and power unit, energy storage, flexible electricity and heat load are jointly utilized to minimize the risk-adjusted total costs. Next, a risk-averse dynamic programming formulation of the original problem is presented, upon which a data-driven risk-averse approximate dynamic programming is employed to address computational challenge, and develop almost optimal and computationally efficient policy. By exploiting information from training samples in off-line learning, the proposed algorithm can efficiently responses to the stochastic exogenous information. Comparative simulations with different risk-aversion preferences and different methods verify the effectiveness of the proposed algorithm.

[1]  Jun Dong,et al.  Robust sliding-mode control of wind energy conversion systems for optimal power extraction via nonlinear perturbation observers , 2018 .

[2]  Pierluigi Mancarella,et al.  Modelling, assessment and Sankey diagrams of integrated electricity-heat-gas networks in multi-vector district energy systems , 2016 .

[3]  Hossein Salehfar,et al.  Efficiency Improvements through Combined Heat and Power for On-site Distributed Generation Technologies , 2006, Distributed Generation & Alternative Energy Journal.

[4]  Sanna Syri,et al.  The role of heat storages in facilitating the adaptation of district heating systems to large amount of variable renewable electricity , 2017 .

[5]  Hongbin Sun,et al.  Coordinated Dispatch of Integrated Electric and District Heating Systems Using Heterogeneous Decomposition , 2020, IEEE Transactions on Sustainable Energy.

[6]  Wei Wei,et al.  Adaptive robust energy and reserve co-optimization of integrated electricity and heating system considering wind uncertainty , 2020 .

[7]  R. Bellman Dynamic programming. , 1957, Science.

[8]  Zhao Yang Dong,et al.  Optimal Dispatch of Coupled Electricity and Heat System With Independent Thermal Energy Storage , 2019, IEEE Transactions on Power Systems.

[9]  R. Rockafellar,et al.  Optimization of conditional value-at risk , 2000 .

[10]  Canbing Li,et al.  Network constrained economic dispatch of integrated heat and electricity systems through mixed integer conic programming , 2019, Energy.

[11]  Arye Nehorai,et al.  Joint Optimization of Hybrid Energy Storage and Generation Capacity With Renewable Energy , 2013, IEEE Transactions on Smart Grid.

[12]  Tao Yu,et al.  Grouped grey wolf optimizer for maximum power point tracking of doubly-fed induction generator based wind turbine , 2017 .

[13]  C. Gentile,et al.  Tighter Approximated MILP Formulations for Unit Commitment Problems , 2009, IEEE Transactions on Power Systems.

[14]  Lingfeng Wang,et al.  Real-Time Rolling Horizon Energy Management for the Energy-Hub-Coordinated Prosumer Community From a Cooperative Perspective , 2019, IEEE Transactions on Power Systems.

[15]  Shengwei Mei,et al.  Participation of an Energy Hub in Electricity and Heat Distribution Markets: An MPEC Approach , 2019, IEEE Transactions on Smart Grid.

[16]  Vitor L. de Matos,et al.  Dynamic sampling algorithms for multi-stage stochastic programs with risk aversion , 2012, Eur. J. Oper. Res..

[17]  Tao Yu,et al.  Dynamic leader based collective intelligence for maximum power point tracking of PV systems affected by partial shading condition , 2019, Energy Conversion and Management.

[18]  Andrzej Ruszczynski,et al.  Risk-averse dynamic programming for Markov decision processes , 2010, Math. Program..

[19]  Tao Yu,et al.  Passivity-based sliding-mode control design for optimal power extraction of a PMSG based variable speed wind turbine , 2018 .

[20]  Bo Yang,et al.  Real-time stochastic optimal scheduling of large-scale electric vehicles: A multidimensional approximate dynamic programming approach , 2020 .

[21]  Warren B. Powell,et al.  An Optimal Approximate Dynamic Programming Algorithm for Concave, Scalar Storage Problems With Vector-Valued Controls , 2013, IEEE Transactions on Automatic Control.

[22]  Jinyu Wen,et al.  Stochastic Optimization of Economic Dispatch for Microgrid Based on Approximate Dynamic Programming , 2019, IEEE Transactions on Smart Grid.

[23]  Zhiwei Xu,et al.  Risk-Averse Optimal Bidding Strategy for Demand-Side Resource Aggregators in Day-Ahead Electricity Markets Under Uncertainty , 2017, IEEE Transactions on Smart Grid.

[24]  Aie,et al.  World Energy Outlook 2011 , 2001 .

[25]  Hongbin Sun,et al.  Feasible region method based integrated heat and electricity dispatch considering building thermal inertia , 2017 .

[26]  Xue Li,et al.  Collaborative scheduling and flexibility assessment of integrated electricity and district heating systems utilizing thermal inertia of district heating network and aggregated buildings , 2020 .

[27]  Daniele Testi,et al.  Thermodynamic and economic analysis of the integration of high-temperature heat pumps in trigeneration systems , 2019, Applied Energy.

[28]  W. Yao,et al.  Comprehensive overview of meta-heuristic algorithm applications on PV cell parameter identification , 2020 .

[29]  Alexander Shapiro,et al.  Risk neutral and risk averse Stochastic Dual Dynamic Programming method , 2013, Eur. J. Oper. Res..

[30]  Warren B. Powell,et al.  Tutorial on Stochastic Optimization in Energy—Part I: Modeling and Policies , 2016, IEEE Transactions on Power Systems.

[31]  Hongbin Sun,et al.  A generalized quasi-dynamic model for electric-heat coupling integrated energy system with distributed energy resources , 2019, Applied Energy.

[32]  Qinghua Wu,et al.  Nonlinear maximum power point tracking control and modal analysis of DFIG based wind turbine , 2016 .

[33]  Qinghua Wu,et al.  Modelling and operation optimization of an integrated energy based direct district water-heating system , 2014 .

[34]  Zhao Yang Dong,et al.  Robustly Coordinated Operation of a Multi-Energy Microgrid With Flexible Electric and Thermal Loads , 2019, IEEE Transactions on Smart Grid.

[35]  Tao Yu,et al.  Novel bio-inspired memetic salp swarm algorithm and application to MPPT for PV systems considering partial shading condition , 2019, Journal of Cleaner Production.

[36]  Mohammad Shahidehpour,et al.  Combined Heat and Power Dispatch Considering Pipeline Energy Storage of District Heating Network , 2016, IEEE Transactions on Sustainable Energy.

[37]  Somayeh Moazeni,et al.  A Risk-Averse Stochastic Dynamic Programming Approach to Energy Hub Optimal Dispatch , 2019, IEEE Transactions on Power Systems.

[38]  Dan Wang,et al.  Integrated demand response in district electricity-heating network considering double auction retail energy market based on demand-side energy stations , 2019, Applied Energy.

[39]  Jinbo Huang,et al.  Coordinated dispatch of electric power and district heating networks: A decentralized solution using optimality condition decomposition , 2017 .