Energy Hub optimal sizing in the smart grid; machine learning approach

The interests in “Energy Hub” (EH) and “Smart Grid” (SG) concepts have been increasing, in recent years. The synergy effect of the coupling between electricity and natural gas grids and utilizing intelligent technologies for communicating, may change energy management in the future. A new solution entitling “Smart Energy Hub” (S. E. Hub) that models a multi-carrier energy system in a SG environment studied in this paper. Moreover, the optimal size of CHP, auxiliary boiler, absorption chiller, and also transformer unit as main elements of a S. E. Hub is determined. Authors proposed a comprehensive cost and benefit analysis to optimize these elements and apply Reinforcement Learning (RL) algorithm for solving the optimization problem. To confirm the proposed method, a residential customer has been investigated as an S. E. Hub in a dynamic electricity pricing market.

[1]  Martin Kumar Patel,et al.  District heating in the Netherlands today: A techno-economic assessment for NGCC-CHP (Natural Gas Combined Cycle combined heat and power) , 2013 .

[2]  H. Ghasemi,et al.  IRAN's electricity and natural gas networks modeling by means of energy hubs , 2012, 2012 11th International Conference on Environment and Electrical Engineering.

[3]  G. Andersson,et al.  Energy hubs for the future , 2007, IEEE Power and Energy Magazine.

[4]  Stuart J. Galloway,et al.  Outline for an integrated multiple energy carrier model of the UK energy infrastructure , 2009, 2009 44th International Universities Power Engineering Conference (UPEC).

[5]  Tommi S. Jaakkola,et al.  Convergence Results for Single-Step On-Policy Reinforcement-Learning Algorithms , 2000, Machine Learning.

[6]  Kankar Bhattacharya,et al.  Optimal Operation of Residential Energy Hubs in Smart Grids , 2012, IEEE Transactions on Smart Grid.

[7]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[8]  Florian Kienzle,et al.  Valuing Investments in Multi-Energy Conversion, Storage, and Demand-Side Management Systems Under Uncertainty , 2011, IEEE Transactions on Sustainable Energy.

[9]  Ford Lumban Gaol,et al.  Game Artificial Intelligence Based Using Reinforcement Learning , 2012 .

[10]  Frank L. Lewis,et al.  Reinforcement learning and optimal adaptive control: An overview and implementation examples , 2012, Annu. Rev. Control..

[11]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[12]  Maryam Shokri,et al.  Knowledge of opposite actions for reinforcement learning , 2011, Appl. Soft Comput..

[13]  Mohammad Hassan Moradi,et al.  An energy management system (EMS) strategy for combined heat and power (CHP) systems based on a hybrid optimization method employing fuzzy programming , 2013 .

[14]  Bart De Schutter,et al.  Model-based predictive control applied to multi-carrier energy systems , 2009, 2009 IEEE Power & Energy Society General Meeting.

[15]  Goran Andersson,et al.  Modeling interconnected national energy systems using an energy hub approach , 2011, 2011 IEEE Trondheim PowerTech.

[16]  Tao Yu,et al.  Distributed multi-step Q(λ) learning for Optimal Power Flow of large-scale power grids , 2012 .

[17]  Ali Mohammad Ranjbar,et al.  Financial analysis and optimal size and operation for a multicarrier energy system , 2012 .

[18]  Shahab Bahrami,et al.  A Financial Approach to Evaluate an Optimized Combined Cooling, Heat and Power System , 2013 .

[19]  Majid Nili Ahmadabadi,et al.  Exploration and exploitation balance management in fuzzy reinforcement learning , 2010, Fuzzy Sets Syst..

[20]  Shigenobu Kobayashi,et al.  k-Certainty Exploration Method: An Action Selector to Identify the Environment in Reinforcement Learning , 1997, Artif. Intell..

[21]  Carmen Del Vecchio,et al.  Robust Optimization of operations in energy hub , 2011, IEEE Conference on Decision and Control and European Control Conference.

[22]  B. De Schutter,et al.  Distributed control applied to combined electricity and natural gas infrastructures , 2008, 2008 First International Conference on Infrastructure Systems and Services: Building Networks for a Brighter Future (INFRA).

[23]  Ali Mohammad Ranjbar,et al.  Optimal Operation and Size for an Energy Hub with CCHP , 2011 .

[24]  Ah-Hwee Tan,et al.  Self-Regulating Action Exploration in Reinforcement Learning , 2012, INNS-WC.

[25]  Matteo Manera,et al.  Modelling the Load Curve of Aggregate Electricity Consumption Using Principal Components , 2003, Environ. Model. Softw..

[26]  Graham Leedham,et al.  Reinforcement learning combined with a fuzzy adaptive learning control network (FALCON-R) for pattern classification , 2005, Pattern Recognit..