Factored Models for Multiscale Decision-Making in Smart Grid Customers

Active participation of customers in the management of demand, and renewable energy supply, is a critical goal of the Smart Grid vision. However, this is a complex problem with numerous scenarios that are difficult to test in field projects. Rich and scalable simulations are required to develop effective strategies and policies that elicit desirable behavior from customers. We present a versatile agent-based factored model that enables rich simulation scenarios across distinct customer types and varying agent granularity. We formally characterize the decisions to be made by Smart Grid customers as a multiscale decision-making problem and show how our factored model representation handles several temporal and contextual decisions by introducing a novel utility optimizing agent. We further contribute innovative algorithms for (i) statistical learning-based hierarchical Bayesian timeseries simulation, and (ii) adaptive capacity control using decision-theoretic approximation of multiattribute utility functions over multiple agents. Prominent among the approaches being studied to achieve active customer participation is one based on offering customers financial incentives through variable-price tariffs; we also contribute an effective solution to the problem of customer herding under such tariffs. We support our contributions with experimental results from simulations based on real-world data on an open Smart Grid simulation platform.

[1]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .

[2]  Sarvapali D. Ramchurn,et al.  Decentralised Control of Micro-Storage in the Smart Grid , 2011, AAAI.

[3]  J. Zico Kolter,et al.  A Large-Scale Study on Predicting and Contextualizing Building Energy Usage , 2011, AAAI.

[4]  M. West,et al.  Bayesian forecasting and dynamic models , 1989 .

[5]  Ying Guo,et al.  A Simulator for Self-Adaptive Energy Demand Management , 2008, 2008 Second IEEE International Conference on Self-Adaptive and Self-Organizing Systems.

[6]  Michael P. Wellman REASONING ABOUT PREFERENCE MODELS , 1985 .

[7]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[8]  Stamatis Karnouskos,et al.  Simulation of a Smart Grid City with Software Agents , 2009, 2009 Third UKSim European Symposium on Computer Modeling and Simulation.

[9]  Galen Barbose,et al.  A survey of utility experience with real time pricing: implications for policymakers seeking price responsive demand , 2005 .

[10]  Goran Strbac,et al.  Demand side management: Benefits and challenges ☆ , 2008 .

[11]  Jukka Paatero,et al.  A model for generating household electricity load profiles , 2006 .

[12]  Sarvapali D. Ramchurn,et al.  Agent-based control for decentralised demand side management in the smart grid , 2011, AAMAS.

[13]  C. Gomes Computational Sustainability: Computational methods for a sustainable environment, economy, and society , 2009 .

[14]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[15]  Andrew Gelman,et al.  Data Analysis Using Regression and Multilevel/Hierarchical Models , 2006 .

[16]  Dominik Möst,et al.  Simulations in the Smart Grid Field Study MeRegioSimulationen im MeRegio Smart Grid Feldtest , 2010, it Inf. Technol..

[17]  Olof M. Jarvegren,et al.  Pacific Northwest GridWise™ Testbed Demonstration Projects; Part I. Olympic Peninsula Project , 2008 .

[18]  Marija D. Ilic,et al.  Interactive object-oriented simulation of interconnected power systems using SIMULINK , 2001, IEEE Trans. Educ..

[19]  Wolfgang Ketter,et al.  The Power Trading Agent Competition , 2011 .

[20]  Kung-Sik Chan,et al.  Time Series Analysis: With Applications in R , 2010 .

[21]  Manuela M. Veloso,et al.  Learned Behaviors of Multiple Autonomous Agents in Smart Grid Markets , 2011, AAAI.

[22]  Eric Horvitz,et al.  Decision theory in expert systems and artificial intelligenc , 1988, Int. J. Approx. Reason..

[23]  Sarvapali D. Ramchurn,et al.  Theoretical and Practical Foundations of Large-Scale Agent-Based Micro-Storage in the Smart Grid , 2011, J. Artif. Intell. Res..

[24]  Junjie Sun,et al.  An Agent-Based Computational Laboratory for Wholesale Power Market Design , 2007, 2007 IEEE Power Engineering Society General Meeting.

[25]  Ian Beausoleil-Morrison,et al.  Synthetically derived profiles for representing occupant-driven electric loads in Canadian housing , 2009 .

[26]  Manuela Veloso,et al.  Coaching: learning and using environment and agent models for advice , 2005 .

[27]  Christian Wernz,et al.  Multiscale decision-making: Bridging organizational scales in systems with distributed decision-makers , 2010, Eur. J. Oper. Res..

[28]  Martin Braun,et al.  A REVIEW ON AGGREGATION APPROACHES OF CONTROLLABLE DISTRIBUTED ENERGY UNITS IN ELECTRICAL POWER SYSTEMS , 2008 .

[29]  Michael A. West,et al.  Bayesian Forecasting and Dynamic Models (2nd edn) , 1997, J. Oper. Res. Soc..

[30]  Pericles A. Mitkas,et al.  Improving Agent Bidding in Power Stock Markets through a Data Mining Enhanced Agent Platform , 2009, ADMI.

[31]  B.F. Wollenberg,et al.  Toward a smart grid: power delivery for the 21st century , 2005, IEEE Power and Energy Magazine.

[32]  K S Barber,et al.  Multi-Scale Behavioral Modeling and Analysis Promoting a Fundamental Understanding of Agent-Based System Design and Operation , 2007 .

[33]  Wolfgang Ketter,et al.  Demand side management—A simulation of household behavior under variable prices , 2011 .

[34]  Makoto Yokoo,et al.  Adopt: asynchronous distributed constraint optimization with quality guarantees , 2005, Artif. Intell..

[35]  S. Borenstein The Trouble With Electricity Markets: Understanding California's Restructuring Disaster , 2002 .