Fair Energy Scheduling for Vehicle-to-Grid Networks Using Adaptive Dynamic Programming

Research on the smart grid is being given enormous supports worldwide due to its great significance in solving environmental and energy crises. Electric vehicles (EVs), which are powered by clean energy, are adopted increasingly year by year. It is predictable that the huge charge load caused by high EV penetration will have a considerable impact on the reliability of the smart grid. Therefore, fair energy scheduling for EV charge and discharge is proposed in this paper. By using the vehicle-to-grid technology, the scheduler controls the electricity loads of EVs considering fairness in the residential distribution network. We propose contribution-based fairness, in which EVs with high contributions have high priorities to obtain charge energy. The contribution value is defined by both the charge/discharge energy and the timing of the action. EVs can achieve higher contribution values when discharging during the load peak hours. However, charging during this time will decrease the contribution values seriously. We formulate the fair energy scheduling problem as an infinite-horizon Markov decision process. The methodology of adaptive dynamic programming is employed to maximize the long-term fairness by processing online network training. The numerical results illustrate that the proposed EV energy scheduling is able to mitigate and flatten the peak load in the distribution network. Furthermore, contribution-based fairness achieves a fast recovery of EV batteries that have deeply discharged and guarantee fairness in the full charge time of all EVs.

[1]  Ting Wu,et al.  Coordinated Energy Dispatching in Microgrid With Wind Power Generation and Plug-in Electric Vehicles , 2013, IEEE Transactions on Smart Grid.

[2]  Sunil K. Vuppala,et al.  Incorporating fairness within Demand response programs in smart grid , 2011, ISGT 2011.

[3]  A. Brooks Integration of electric drive vehicles with the power grid-a new application for vehicle batteries , 2002, Seventeenth Annual Battery Conference on Applications and Advances. Proceedings of Conference (Cat. No.02TH8576).

[4]  Shengli Xie,et al.  QoS Differentiated and Fair Packet Scheduling in Broadband Wireless Access Networks , 2009, EURASIP J. Wirel. Commun. Netw..

[5]  Sekyung Han,et al.  Development of an Optimal Vehicle-to-Grid Aggregator for Frequency Regulation , 2010, IEEE Transactions on Smart Grid.

[6]  A. Keane,et al.  Optimal Charging of Electric Vehicles in Low-Voltage Distribution Systems , 2012, IEEE Transactions on Power Systems.

[7]  Dong Wei,et al.  Neighborhood-level collaborative fair charging scheme for electric vehicles , 2014, ISGT 2014.

[8]  W. H. Kersting,et al.  Radial distribution test feeders , 1991, 2001 IEEE Power Engineering Society Winter Meeting. Conference Proceedings (Cat. No.01CH37194).

[9]  Emanuele Crisostomi,et al.  Optimal distributed consensus algorithm for fair V2G power dispatch in a microgrid , 2014, 2014 IEEE International Electric Vehicle Conference (IEVC).

[10]  Zhong Fan,et al.  A Distributed Demand Response Algorithm and Its Application to PHEV Charging in Smart Grids , 2012, IEEE Transactions on Smart Grid.

[11]  Shengli Xie,et al.  Cognitive machine-to-machine communications: visions and potentials for the smart grid , 2012, IEEE Network.

[12]  Weihua Zhuang,et al.  Optimizing the Energy Delivery via V2G Systems Based on Stochastic Inventory Theory , 2013, IEEE Transactions on Smart Grid.

[13]  Akihiko Yokoyama,et al.  Autonomous Distributed V2G (Vehicle-to-Grid) Satisfying Scheduled Charging , 2012, IEEE Transactions on Smart Grid.

[14]  Derong Liu,et al.  Infinite Horizon Self-Learning Optimal Control of Nonaffine Discrete-Time Nonlinear Systems , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Stanton W. Hadley,et al.  Potential Impacts of Plug-in Hybrid Electric Vehicles on Regional Power Generation , 2009 .

[16]  Ahmed Yousuf Saber,et al.  Plug-in Vehicles and Renewable Energy Sources for Cost and Emission Reductions , 2011, IEEE Transactions on Industrial Electronics.

[17]  Derong Liu,et al.  Policy Iteration Algorithm for Online Design of Robust Control for a Class of Continuous-Time Nonlinear Systems , 2014, IEEE Transactions on Automation Science and Engineering.

[18]  Catherine Rosenberg,et al.  Real-Time Distributed Control for Smart Electric Vehicle Chargers: From a Static to a Dynamic Study , 2014, IEEE Transactions on Smart Grid.

[19]  Cishen Zhang,et al.  Optimal Coordination of G2V and V2G to Support Power Grids With High Penetration of Renewable Energy , 2015, IEEE Transactions on Transportation Electrification.

[20]  Mohamed A. El-Sharkawi,et al.  Optimal Scheduling of Vehicle-to-Grid Energy and Ancillary Services , 2012, IEEE Transactions on Smart Grid.

[21]  Mahmud Fotuhi-Firuzabad,et al.  Investigating the Impacts of Plug-in Hybrid Electric Vehicles on Power Distribution Systems , 2013, IEEE Transactions on Smart Grid.

[22]  Paul J. Werbos,et al.  Approximate dynamic programming for real-time control and neural modeling , 1992 .

[23]  H. Aisu,et al.  Management of quick charging of electric vehicles using power from grid and storage batteries , 2012, 2012 IEEE International Electric Vehicle Conference.

[24]  Derong Liu,et al.  Multibattery Optimal Coordination Control for Home Energy Management Systems via Distributed Iterative Adaptive Dynamic Programming , 2015, IEEE Transactions on Industrial Electronics.

[25]  Derong Liu,et al.  Data-Based Adaptive Critic Designs for Nonlinear Robust Optimal Control With Uncertain Dynamics , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[26]  Willett Kempton,et al.  Vehicle-to-grid power implementation: From stabilizing the grid to supporting large-scale renewable energy , 2005 .

[27]  Pangan Ting,et al.  Decentralized Plug-in Electric Vehicle Charging Selection Algorithm in Power Systems , 2012, IEEE Transactions on Smart Grid.

[28]  Zechun Hu,et al.  Decentralized Vehicle-to-Grid Control for Primary Frequency Regulation Considering Charging Demands , 2013, IEEE Transactions on Power Systems.

[29]  Hamid Sharif,et al.  A Survey on Smart Grid Communication Infrastructures: Motivations, Requirements and Challenges , 2013, IEEE Communications Surveys & Tutorials.

[30]  Yu Cao,et al.  A holistic system for enhanced fair value compensation for automated participation of EV in a Peak Demand Event , 2012, 2012 IEEE 5th India International Conference on Power Electronics (IICPE).

[31]  Derong Liu,et al.  Finite-Approximation-Error-Based Discrete-Time Iterative Adaptive Dynamic Programming , 2014, IEEE Transactions on Cybernetics.

[32]  Mohammad A. S. Masoum,et al.  Real-Time Coordination of Plug-In Electric Vehicle Charging in Smart Grids to Minimize Power Losses and Improve Voltage Profile , 2011, IEEE Transactions on Smart Grid.

[33]  Xin Wang,et al.  Energy Management Strategy for Plug-In Hybrid Electric Vehicles via Bidirectional Vehicle-to-Grid , 2017, IEEE Systems Journal.

[34]  Derong Liu,et al.  Data-Driven Neuro-Optimal Temperature Control of Water–Gas Shift Reaction Using Stable Iterative Adaptive Dynamic Programming , 2014, IEEE Transactions on Industrial Electronics.

[35]  Derong Liu,et al.  Neural-network-based robust optimal control design for a class of uncertain nonlinear systems via adaptive dynamic programming , 2014, Inf. Sci..

[36]  Chau Yuen,et al.  Electricity Cost Minimization for a Microgrid With Distributed Energy Resource Under Different Information Availability , 2015, IEEE Transactions on Industrial Electronics.

[37]  Shengli Xie,et al.  PHEV Charging and Discharging Cooperation in V2G Networks: A Coalition Game Approach , 2014, IEEE Internet of Things Journal.

[38]  H. Farhangi,et al.  The path of the smart grid , 2010, IEEE Power and Energy Magazine.

[39]  Frank L. Lewis,et al.  Multiple Actor-Critic Structures for Continuous-Time Optimal Control Using Input-Output Data , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[40]  Charlie Qiu,et al.  Design of fair charging algorithm for smart electrical vehicle charging infrastructure , 2013, 2013 International Conference on ICT Convergence (ICTC).

[41]  Ali Elkamel,et al.  Optimal Transition to Plug-In Hybrid Electric Vehicles in Ontario, Canada, Considering the Electricity-Grid Limitations , 2010, IEEE Transactions on Industrial Electronics.

[42]  Gonzalo Seco-Granados,et al.  Fair Design of Plug-in Electric Vehicles Aggregator for V2G Regulation , 2012, IEEE Transactions on Vehicular Technology.

[43]  Gerald Thomas Heydt,et al.  The Next Generation of Power Distribution Systems , 2010, IEEE Transactions on Smart Grid.

[44]  Ming Yang,et al.  Analysis on the effect of rotor angle control for transient stability enhancement , 2014, IEEE PES Innovative Smart Grid Technologies, Europe.

[45]  Prasanta Ghosh,et al.  Optimizing Electric Vehicle Charging: A Customer's Perspective , 2013, IEEE Transactions on Vehicular Technology.

[46]  Jinjun Xiong,et al.  A distributed scheme for fair EV charging under transmission constraints , 2012, 2012 American Control Conference (ACC).

[47]  Hamed Mohsenian Rad,et al.  Achieving Optimality and Fairness in Autonomous Demand Response: Benchmarks and Billing Mechanisms , 2013, IEEE Transactions on Smart Grid.

[48]  Pedro Faria,et al.  Day-ahead resource scheduling including demand response for electric vehicles , 2013, 2014 IEEE PES General Meeting | Conference & Exposition.

[49]  Derong Liu,et al.  Value Iteration Adaptive Dynamic Programming for Optimal Control of Discrete-Time Nonlinear Systems , 2016, IEEE Transactions on Cybernetics.

[50]  Huaguang Zhang,et al.  Adaptive Dynamic Programming: An Introduction , 2009, IEEE Computational Intelligence Magazine.

[51]  Mohsen Guizani,et al.  Cognitive radio based hierarchical communications infrastructure for smart grid , 2011, IEEE Network.

[52]  Derong Liu,et al.  An Approximate Optimal Control Approach for Robust Stabilization of a Class of Discrete-Time Nonlinear Systems With Uncertainties , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[53]  Paul McNamara,et al.  Fair charging strategies for EVs connected to a low-voltage distribution network , 2013, IEEE PES ISGT Europe 2013.

[54]  J. Driesen,et al.  The Impact of Charging Plug-In Hybrid Electric Vehicles on a Residential Distribution Grid , 2010, IEEE Transactions on Power Systems.

[55]  Hamed Mohsenian Rad,et al.  Vehicle-to-Aggregator Interaction Game , 2012, IEEE Transactions on Smart Grid.

[56]  Seán McLoone,et al.  Enhanced AIMD-based decentralized residential charging of EVs , 2015 .