Solar Power driven EV Charging Optimization with Deep Reinforcement Learning

Power sector decarbonization plays a vital role in the upcoming energy transition towards a more sustainable future. Decentralized energy resources, such as Electric Vehicles (EV) and solar photovoltaic systems (PV), are continuously integrated in residential power systems, increasing the risk of bottlenecks in power distribution networks. This paper aims to address the challenge of domestic EV charging while prioritizing clean, solar energy consumption. Real Time-of-Use tariffs are treated as a price-based Demand Response (DR) mechanism that can incentivize end-users to optimally shift EV charging load in hours of high solar PV generation with the use of Deep Reinforcement Learning (DRL). Historical measurements from the Pecan Street dataset are analyzed to shape a flexibility potential reward to describe end-user charging preferences. Experimental results show that the proposed DQN EV optimal charging policy is able to reduce electricity bills by an average 11.5% by achieving an average utilization of solar power 88.4%.

[1]  Yasin Yılmaz,et al.  Home Energy Recommendation System (HERS): A Deep Reinforcement Learning Method Based on Residents’ Feedback and Activity , 2022, IEEE Transactions on Smart Grid.

[2]  Dataport , 2022, Computer.

[3]  A. Doulamis,et al.  ELECTRIcity: An Efficient Transformer for Non-Intrusive Load Monitoring , 2022, Sensors.

[4]  I. Lamprinos,et al.  Particle Swarm Optimization in Residential Demand-Side Management: A Review on Scheduling and Control Algorithms for Demand Response Provision , 2022, Energies.

[5]  L. Fu,et al.  A real-time demand-side management system considering user preference with adaptive deep Q learning in home area network , 2021, Sustainable Energy, Grids and Networks.

[6]  Zhile Yang,et al.  A novel forecasting based scheduling method for household energy management system based on deep reinforcement learning , 2021, Sustainable Cities and Society.

[7]  Marthinus J. Booysen,et al.  Sustainability matchmaking: Linking renewable sources to electric water heating through machine learning , 2021 .

[8]  Enda Barrett,et al.  Deep reinforcement learning for home energy management system control , 2021 .

[9]  David Flynn,et al.  Artificial intelligence and machine learning approaches to energy demand-side response: A systematic review , 2020, Renewable and Sustainable Energy Reviews.

[10]  Wayes Tushar,et al.  A Survey of Computational Intelligence Techniques for Air-Conditioners Energy Management , 2020, IEEE Transactions on Emerging Topics in Computational Intelligence.

[11]  Haibo He,et al.  Constrained EV Charging Scheduling Based on Safe Deep Reinforcement Learning , 2020, IEEE Transactions on Smart Grid.

[12]  H. Gooi,et al.  Optimization strategy based on deep reinforcement learning for home energy management , 2020 .

[13]  Zhiqiang Wan,et al.  Real-Time Residential Demand Response , 2020, IEEE Transactions on Smart Grid.

[14]  Haibo He,et al.  Model-Free Real-Time EV Charging Scheduling Based on Deep Reinforcement Learning , 2019, IEEE Transactions on Smart Grid.

[15]  José R. Vázquez-Canteli,et al.  Reinforcement learning for demand response: A review of algorithms and modeling techniques , 2019, Applied Energy.

[16]  Adriana Chis,et al.  Reinforcement Learning-Based Plug-in Electric Vehicle Charging With Forecasted Price , 2017, IEEE Transactions on Vehicular Technology.

[17]  Alex Graves,et al.  Playing Atari with Deep Reinforcement Learning , 2013, ArXiv.

[18]  Peter Stone,et al.  Reinforcement learning , 2019, Scholarpedia.