LSTM-based Energy Management for Electric Vehicle Charging in Commercial-building Prosumers

As typical prosumers, commercial buildings equipped with electric vehicle (EV) charging piles and solar photovoltaic panels require effective energy management method. However, the conventional optimization model-based building energy management system faces significant challenges regarding prediction and calculation in online execution. To address this issue, a long short-term memory (LSTM) recurrent neural network-based machine learning algorithm is proposed in this study to schedule the charging and discharging of numerous EVs in commercial building prosumers. Under the proposed system control structure, the LSTM algorithm can be separated into an offline and online stage. In the offline stage, the LSTM is used to map states (inputs) to decisions (outputs) based on the network training. In the online stage, once the current state is input, the LSTM can quickly generate a solution without any additional prediction. A preliminary data processing rule and an additional output filtering procedure are designed to improve the decision performance of LSTM network. The simulation results demonstrate that the LSTM algorithm can generate near-optimal solutions in milliseconds and significantly reduce the prediction and calculation pressure compared to the conventional optimization algorithm.

[1]  Ronnie Belmans,et al.  Demand response of a heterogeneous cluster of electric water heaters using batch reinforcement learning , 2014, 2014 Power Systems Computation Conference.

[2]  Yan Xu,et al.  A Multi-Agent Reinforcement Learning-Based Data-Driven Method for Home Energy Management , 2020, IEEE Transactions on Smart Grid.

[3]  Pankaj K. Sen,et al.  Estimation of electricity consumption in commercial buildings , 2011, 2011 North American Power Symposium.

[4]  Antonio Liotta,et al.  On-Line Building Energy Optimization Using Deep Reinforcement Learning , 2017, IEEE Transactions on Smart Grid.

[5]  Xinghuo Yu,et al.  Beyond Smart Grid - Cyber-Physical-Social System in Energy Future , 2017, Proc. IEEE.

[6]  Goran Strbac,et al.  Optimization methods and advanced applications for smart energy systems considering grid-interactive demand response , 2020 .

[7]  Jianhui Wang,et al.  Coordinated control for large-scale EV charging facilities and energy storage devices participating in frequency regulation , 2014 .

[8]  Pedro Faria,et al.  Intelligent energy resource management considering vehicle-to-grid: A Simulated Annealing approach , 2012, 2012 IEEE Power and Energy Society General Meeting.

[9]  Gerard LEDWICH,et al.  Enhancing scalability of peer-to-peer energy markets using adaptive segmentation method , 2019, Journal of Modern Power Systems and Clean Energy.

[10]  Karl Henrik Johansson,et al.  Energy and CO2 efficient scheduling of smart appliances in active houses equipped with batteries , 2014, 2014 IEEE International Conference on Automation Science and Engineering (CASE).

[11]  Hongbin Sun,et al.  Storage-like devices in load leveling: Complementarity constraints and a new and exact relaxation method , 2015 .

[12]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[13]  Anna Helena Reali Costa,et al.  Batch Reinforcement Learning for Smart Home Energy Management , 2015, IJCAI.

[14]  Karl Henrik Johansson,et al.  Scheduling smart home appliances using mixed integer linear programming , 2011, IEEE Conference on Decision and Control and European Control Conference.

[15]  Ram Rajagopal,et al.  Incentive mechanism for sharing distributed energy resources , 2019, Journal of Modern Power Systems and Clean Energy.

[16]  Hu Chang-ying Exactness of Penalty Functions for Solving MPEC Model of the Transportation Network Optimization Problems with User Equilibrium Constraints , 2006, 2006 International Conference on Management Science and Engineering.

[17]  Gregor Verbic,et al.  A plug-and-play home energy management algorithm using optimization and machine learning techniques , 2018, 2018 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm).

[18]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[19]  Canbing Li,et al.  Transactive Real-Time Electric Vehicle Charging Management for Commercial Buildings With PV On-Site Generation , 2019, IEEE Transactions on Smart Grid.

[20]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[21]  Zhongyi Hu,et al.  Multi-step-ahead time series prediction using multiple-output support vector regression , 2014, Neurocomputing.

[22]  Archie C. Chapman,et al.  Energy Management of PV-Storage Systems: Policy Approximations Using Machine Learning , 2019, IEEE Transactions on Industrial Informatics.

[23]  Abouzar SAMIMI,et al.  Complete active-reactive power resource scheduling of smart distribution system with high penetration of distributed energy resources , 2017 .

[24]  Iain MacGill,et al.  Coordinated Scheduling of Residential Distributed Energy Resources to Optimize Smart Home Energy Services , 2010, IEEE Transactions on Smart Grid.

[25]  Shaorong Wang,et al.  Deep Reinforcement Learning Method for Demand Response Management of Interruptible Load , 2020, IEEE Transactions on Smart Grid.

[26]  M. Fukushima,et al.  Smoothing methods for mathematical programs with equilibrium constraints , 2004, International Conference on Informatics Research for Development of Knowledge Society Infrastructure, 2004. ICKS 2004..