Demand-Side Management Using Deep Learning for Smart Charging of Electric Vehicles

The use of electric vehicles (EVs) load management is relevant to support electricity demand softening, making the grid more economic, efficient, and reliable. However, the absence of flexible strategies reflecting the self-interests of EV users may reduce their participation in this kind of initiative. In this paper, we are proposing an intelligent charging strategy using machine learning (ML) tools, to determine when to charge the EV during connection sessions. This is achieved by making real-time charging decisions based on various auxiliary data, including driving, environment, pricing, and demand time series, in order to minimize the overall vehicle energy cost. The first step of the approach is to calculate the optimal solution of historical connection sessions using dynamic programming. Then, from these optimal decisions and other historical data, we train ML models to learn how to make the right decisions in real time, without knowledge of future energy prices and car usage. We demonstrated that a properly trained deep neural network is able to reduce charging costs significantly, often close to the optimal charging costs computed in a retrospective fashion.

[1]  Changsun Ahn,et al.  Optimal decentralized charging control algorithm for electrified vehicles connected to smart grid , 2011 .

[2]  C. Fitzpatrick,et al.  Demand side management of electric car charging: Benefits for consumer and grid , 2012 .

[3]  Ufuk Topcu,et al.  Optimal decentralized protocol for electric vehicle charging , 2011, IEEE Transactions on Power Systems.

[4]  Inmaculada Zamora,et al.  Plug-in electric vehicles in electric distribution networks: A review of smart charging approaches , 2014 .

[5]  Alireza Khaligh,et al.  Minimum charging-cost tracking based optimization algorithm with dynamic programming technique for plug-in hybrid electric vehicles , 2011, 2011 IEEE Vehicle Power and Propulsion Conference.

[6]  Christian Gagné,et al.  Training subset selection in Hourly Ontario Energy Price forecasting using time series clustering-based stratification , 2015, Neurocomputing.

[7]  Siyamak Sarabi,et al.  Electric vehicle charging strategy based on a dynamic programming algorithm , 2014, 2014 IEEE International Conference on Intelligent Energy and Power Systems (IEPS).

[8]  Amit Kumar Tamang Coordinated Charging of Plug-in Hybrid Electric Vehicles to Minimize Distribution System Losses , 2013 .

[9]  Alexander Schuller,et al.  Charging Coordination Paradigms of Electric Vehicles , 2015 .

[10]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[11]  Hongseok Kim,et al.  Deep Neural Network Based Demand Side Short Term Load Forecasting , 2016 .

[12]  Tim Oates,et al.  Time series classification from scratch with deep neural networks: A strong baseline , 2016, 2017 International Joint Conference on Neural Networks (IJCNN).

[13]  Santiago Zazo,et al.  Robust Worst-Case Analysis of Demand-Side Management in Smart Grids , 2016, IEEE Transactions on Smart Grid.

[14]  Arobinda Gupta,et al.  A mobility aware scheduler for low cost charging of electric vehicles in smart grid , 2014, 2014 Sixth International Conference on Communication Systems and Networks (COMSNETS).

[15]  Saifur Rahman,et al.  Grid Integration of Electric Vehicles and Demand Response With Customer Choice , 2012, IEEE Transactions on Smart Grid.

[16]  Yiyu Shi,et al.  A universal state-of-charge algorithm for batteries , 2010, Design Automation Conference.

[17]  Panagiotis Papadopoulos,et al.  Management of electric vehicle battery charging in distribution networks with multi-agent systems , 2014 .

[18]  Nikolaus Hansen,et al.  The CMA Evolution Strategy: A Comparing Review , 2006, Towards a New Evolutionary Computation.

[19]  M. Ilic,et al.  Optimal Charge Control of Plug-In Hybrid Electric Vehicles in Deregulated Electricity Markets , 2011, IEEE Transactions on Power Systems.

[20]  Tom Molinski,et al.  PEV Charging Profile Prediction and Analysis Based on Vehicle Usage Data , 2012, IEEE Transactions on Smart Grid.

[21]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[22]  Hao Xing,et al.  Decentralized Optimal Demand-Side Management for PHEV Charging in a Smart Grid , 2015, IEEE Transactions on Smart Grid.

[23]  Shuo Pang,et al.  Battery state-of-charge estimation , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[24]  Hong-Guang Ma,et al.  Selection of Embedding Dimension and Delay Time in Phase Space Reconstruction , 2006 .

[25]  Pierluigi Siano,et al.  Electric Vehicles integration in demand response programs , 2014, 2014 International Symposium on Power Electronics, Electrical Drives, Automation and Motion.

[26]  C. Binding,et al.  Optimization Methods to Plan the Charging of Electric Vehicle Fleets , 2010 .

[27]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[28]  Madeleine Gibescu,et al.  Deep learning for estimating building energy consumption , 2016 .

[29]  Zhong Fan,et al.  A Distributed Demand Response Algorithm and Its Application to PHEV Charging in Smart Grids , 2012, IEEE Transactions on Smart Grid.

[30]  Ling Guan,et al.  Optimal Scheduling for Charging and Discharging of Electric Vehicles , 2012, IEEE Transactions on Smart Grid.

[31]  Le Zhang,et al.  Ensemble deep learning for regression and time series forecasting , 2014, 2014 IEEE Symposium on Computational Intelligence in Ensemble Learning (CIEL).

[32]  Xue Liu,et al.  Smart Charging for Electric Vehicles: A Survey From the Algorithmic Perspective , 2016, IEEE Communications Surveys & Tutorials.

[33]  Lang Tong,et al.  Dynamic Pricing and Distributed Energy Management for Demand Response , 2016, IEEE Transactions on Smart Grid.