Energy Management in Smart Cities Based on Internet of Things: Peak Demand Reduction and Energy Savings

Around the globe, innovation with integrating information and communication technologies (ICT) with physical infrastructure is a top priority for governments in pursuing smart, green living to improve energy efficiency, protect the environment, improve the quality of life, and bolster economy competitiveness. Cities today faces multifarious challenges, among which energy efficiency of homes and residential dwellings is a key requirement. Achieving it successfully with the help of intelligent sensors and contextual systems would help build smart cities of the future. In a Smart home environment Home Energy Management plays a critical role in finding a suitable and reliable solution to curtail the peak demand and achieve energy conservation. In this paper, a new method named as Home Energy Management as a Service (HEMaaS) is proposed which is based on neural network based Q-learning algorithm. Although several attempts have been made in the past to address similar problems, the models developed do not cater to maximize the user convenience and robustness of the system. In this paper, authors have proposed an advanced Neural Fitted Q-learning method which is self-learning and adaptive. The proposed method provides an agile, flexible and energy efficient decision making system for home energy management. A typical Canadian residential dwelling model has been used in this paper to test the proposed method. Based on analysis, it was found that the proposed method offers a fast and viable solution to reduce the demand and conserve energy during peak period. It also helps reducing the carbon footprint of residential dwellings. Once adopted, city blocks with significant residential dwellings can significantly reduce the total energy consumption by reducing or shifting their energy demand during peak period. This would definitely help local power distribution companies to optimize their resources and keep the tariff low due to curtailment of peak demand.

[1]  Luis A. Hernández Gómez,et al.  A Ubiquitous Sensor Network Platform for Integrating Smart Devices into the Semantic Sensor Web , 2014, Sensors.

[2]  Yonghong Kuang,et al.  Smart home energy management systems: Concept, configurations, and scheduling strategies , 2016 .

[3]  Michele Magno,et al.  A Low Cost, Highly Scalable Wireless Sensor Network Solution to Achieve Smart LED Light Control for Green Buildings , 2015, IEEE Sensors Journal.

[4]  Peng-Yu Chen,et al.  ROSA: Resource-Oriented Service Management Schemes for Web of Things in a Smart Home , 2017, Sensors.

[5]  Gerhard P. Hancke,et al.  An Energy-Efficient Smart Comfort Sensing System Based on the IEEE 1451 Standard for Green Buildings , 2014, IEEE Sensors Journal.

[6]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[7]  Shuhui Li,et al.  Integrating Home Energy Simulation and Dynamic Electricity Price for Demand Response Study , 2014, IEEE Transactions on Smart Grid.

[8]  Hong Linh Truong,et al.  MQTT-S — A publish/subscribe protocol for Wireless Sensor Networks , 2008, 2008 3rd International Conference on Communication Systems Software and Middleware and Workshops (COMSWARE '08).

[9]  Frank L. Lewis,et al.  Error-Tolerant Iterative Adaptive Dynamic Programming for Optimal Renewable Home Energy Scheduling and Battery Management , 2017, IEEE Transactions on Industrial Electronics.

[10]  Ronnie Belmans,et al.  Demand response of a heterogeneous cluster of electric water heaters using batch reinforcement learning , 2014, 2014 Power Systems Computation Conference.

[11]  Allan Melvin Andrew,et al.  Multi-Stage Feature Selection Based Intelligent Classifier for Classification of Incipient Stage Fire in Building , 2016, Sensors.

[12]  S. Ali Pourmousavi,et al.  Real-time central demand response for primary frequency regulation in microgrids , 2013, 2013 IEEE PES Innovative Smart Grid Technologies Conference (ISGT).

[13]  Victor R. L. Shen,et al.  A smart home management system with hierarchical behavior suggestion and recovery mechanism , 2015, Comput. Stand. Interfaces.

[14]  Michael Chertkov,et al.  Smart finite state devices: A modeling framework for demand response technologies , 2011, IEEE Conference on Decision and Control and European Control Conference.

[15]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[16]  F. Ciancetta,et al.  Plug-n-Play Smart Sensor Based on Web Service , 2007, IEEE Sensors Journal.

[17]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[18]  Saifur Rahman,et al.  Architecture of web services interface for a Home Energy Management system , 2014, ISGT 2014.

[19]  Alagan Anpalagan,et al.  Efficient Energy Management for the Internet of Things in Smart Cities , 2017, IEEE Communications Magazine.

[20]  Peter Palensky,et al.  Demand Side Management: Demand Response, Intelligent Energy Systems, and Smart Loads , 2011, IEEE Transactions on Industrial Informatics.

[21]  Ying-Tsung Lee,et al.  An integrated cloud-based smart home management system with community hierarchy , 2016, IEEE Transactions on Consumer Electronics.

[22]  Joao P. S. Catalao,et al.  Smart Home Communication Technologies and Applications: Wireless Protocol Assessment for Home Area Network Resources , 2015 .

[23]  S. Borenstein,et al.  Dynamic Pricing, Advanced Metering, and Demand Response in Electricity Markets , 2002 .

[24]  Cornel Klein,et al.  From Smart Homes to Smart Cities: Opportunities and Challenges from an Industrial Perspective , 2008, NEW2AN.

[25]  Pierre Geurts,et al.  Tree-Based Batch Mode Reinforcement Learning , 2005, J. Mach. Learn. Res..

[26]  Yu-Liang Hsu,et al.  Design and Implementation of a Smart Home System Using Multisensor Data Fusion Technology , 2017, Sensors.

[27]  Martin A. Riedmiller.  Neural Fitted Q Iteration - First Experiences with a Data Efficient Neural Reinforcement Learning Method , 2005, ECML.

[28]  S. Ali Pourmousavi,et al.  Real-Time Central Demand Response for Primary Frequency Regulation in Microgrids , 2012, IEEE Transactions on Smart Grid.

[29]  Marco Levorato,et al.  Residential Demand Response Using Reinforcement Learning , 2010, 2010 First IEEE International Conference on Smart Grid Communications.

[30]  H. Farhangi,et al.  The path of the smart grid , 2010, IEEE Power and Energy Magazine.

[31]  Sneha A. Dalvi,et al.  Internet of Things for Smart Cities , 2017 .

[32]  Vincent W. S. Wong,et al.  Autonomous Demand-Side Management Based on Game-Theoretic Energy Consumption Scheduling for the Future Smart Grid , 2010, IEEE Transactions on Smart Grid.

[33]  Jianhui Wang,et al.  MPC-Based Appliance Scheduling for Residential Building Energy Management Controller , 2013, IEEE Transactions on Smart Grid.

[34]  Joao P. S. Catalao,et al.  Experimental Results on a Wireless Wattmeter Device for the Integration in Home Energy Management Systems , 2017 .

[35]  Shusen Yang,et al.  A survey on the ietf protocol suite for the internet of things: standards, challenges, and opportunities , 2013, IEEE Wireless Communications.

[36]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[37]  Soummya Kar,et al.  Using smart devices for system-level management and control in the smart grid: A reinforcement learning framework , 2012, 2012 IEEE Third International Conference on Smart Grid Communications (SmartGridComm).

[38]  Kaveh Dehghanpour,et al.  Agent-Based Modeling of Retail Electrical Energy Markets With Demand Response , 2018, IEEE Transactions on Smart Grid.

[39]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..