Market-Based EV Charging Coordination

Electric vehicle (EV) charging loads may challenge grid stability due to a combination of high charging power and temporal clustering of charging activity. Hence, EV charging needs to be coordinated appropriately. Prior work addressing this challenge focused on static charging strategies responding to exogenous price vectors. We extend this work in two directions: To achieve an endogenous resource pricing, we substitute exogenous pricing for a local market platform which allocates available charging capacity to demand from EVs. To achieve meaningful interaction with this market, we model the bidding behavior of EVs by means of a Q-learning approach. Using an integrated trip-based state space representation spanned by required battery level and time to departure, we moderate between bidding aggressiveness and mobility requirements. For appropriate learning parameters, bidding behavior converges and the market achieves significant load shifting.

[1]  Sarvapali D. Ramchurn,et al.  Putting the 'smarts' into the smart grid , 2012, Commun. ACM.

[2]  Ulrich Eberle,et al.  Sustainable transportation based on electric vehicle concepts: a brief overview , 2010 .

[3]  Hartmut Schmeck,et al.  Improving Electric Vehicle Charging Coordination Through Area Pricing , 2014, Transp. Sci..

[4]  A. Maitra,et al.  Evaluation of the impact of plug-in electric vehicle loading on distribution system operations , 2009, 2009 IEEE Power & Energy Society General Meeting.

[5]  Michal Pechoucek,et al.  Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems , 2005, AAMAS 2005.

[6]  Tom Holvoet,et al.  Decentralized coordination of plug-in hybrid vehicles for imbalance reduction in a smart grid , 2011, AAMAS.

[7]  Sarvapali D. Ramchurn,et al.  Trading agents for the smart electricity grid , 2010, AAMAS.

[8]  Saifur Rahman,et al.  An investigation into the impact of electric vehicle load on the electric utility distribution system , 1993 .

[9]  Kevin P. Schneider,et al.  Impacts Assessment of Plug-in Hybrid Vehicles on Electric Utilities and Regional US Power Grids: Part 1: Technical Analysis , 2007 .

[10]  J. K. Kok,et al.  PowerMatcher: multiagent control in the electricity infrastructure , 2005, AAMAS '05.

[11]  Liz Sonenberg Online Mechanism Design for Electric Vehicle Charging , 2011 .

[12]  Steffen Lamparter,et al.  An agent-based market platform for Smart Grids , 2010, AAMAS.

[13]  Hado Philip van Hasselt,et al.  Insights in reinforcement rearning : formal analysis and empirical evaluation of temporal-difference learning algorithms , 2011 .

[14]  Nicholas R. Jennings,et al.  An Online Mechanism for Multi-speed Electric Vehicle Charging , 2011, AMMA.

[15]  Jeffrey O. Kephart,et al.  Pricing in Agent Economies Using Multi-Agent Q-Learning , 2002, Autonomous Agents and Multi-Agent Systems.

[16]  Seth Blumsack,et al.  Ready or not, here comes the smart grid! , 2012 .

[17]  Christof Weinhardt,et al.  Decision Support for Electric Vehicle Charging , 2012, AMCIS.

[18]  F. J. Soares,et al.  Identifying management procedures to deal with connection of Electric Vehicles in the grid , 2009, 2009 IEEE Bucharest PowerTech.

[19]  David L. Greene,et al.  Estimating daily vehicle usage distributions and the implications for limited-range vehicles , 1985 .

[20]  Chris Watkins,et al.  Learning from delayed rewards , 1989 .

[21]  Moshe Tennenholtz,et al.  Adaptive Load Balancing: A Study in Multi-Agent Learning , 1994, J. Artif. Intell. Res..