A Deep Reinforcement Learning Based Approach for Home Energy Management System

Home energy management system (HEMS) enables residents to actively participate in demand response (DR) programs. It can autonomously optimize the electricity usage of home appliances to reduce the electricity cost based on time-varying electricity prices. However, due to the existence of randomness in the pricing process of the utility and resident's activities, developing an efficient HEMS is challenging. To address this issue, we propose a novel home energy management method for optimal scheduling of different kinds of home appliances based on deep reinforcement learning (DRL). Specifically, we formulate the home energy management problem as an MDP considering the randomness of real-time electricity prices and resident's activities. A DRL approach based on proximal policy optimization (PPO) is developed to determine the optimal DR scheduling strategy. The proposed approach does not need any information on the appliances' models and distribution knowledge of the randomness. Simulation results verify the effectiveness of our proposed approach.

[1]  Zheng Wen,et al.  Optimal Demand Response Using Device-Based Reinforcement Learning , 2014, IEEE Transactions on Smart Grid.

[2]  Seung Ho Hong,et al.  Demand Response for Home Energy Management Using Reinforcement Learning and Artificial Neural Network , 2019, IEEE Transactions on Smart Grid.

[3]  Lin Jiang,et al.  A Robust Optimization Approach for Demand Side Scheduling Considering Uncertainty of Manually Operated Appliances , 2018, IEEE Transactions on Smart Grid.

[4]  Lei Wang,et al.  Chance Constrained Optimization in a Home Energy Management System , 2018, IEEE Transactions on Smart Grid.

[5]  Haibo He,et al.  Model-Free Real-Time EV Charging Scheduling Based on Deep Reinforcement Learning , 2019, IEEE Transactions on Smart Grid.

[6]  Yonghong Kuang,et al.  Smart home energy management systems: Concept, configurations, and scheduling strategies , 2016 .

[7]  Haibo He,et al.  Robot-Assisted Pedestrian Regulation Based on Deep Reinforcement Learning , 2020, IEEE Transactions on Cybernetics.

[8]  Benjamin Müller,et al.  The SCIP Optimization Suite 5.0 , 2017, 2112.08872.

[9]  Zhi Chen,et al.  Real-Time Price-Based Demand Response Management for Residential Appliances via Stochastic Optimization and Robust Optimization , 2012, IEEE Transactions on Smart Grid.

[10]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[11]  Jianwei Huang,et al.  An Online Learning Algorithm for Demand Response in Smart Grid , 2018, IEEE Transactions on Smart Grid.

[12]  Archie C. Chapman,et al.  A Fast Technique for Smart Home Management: ADP With Temporal Difference Learning , 2018, IEEE Transactions on Smart Grid.

[13]  Bart De Schutter,et al.  Residential Demand Response of Thermostatically Controlled Loads Using Batch Reinforcement Learning , 2017, IEEE Transactions on Smart Grid.