New Tools for Econometric Analysis of High-Frequency Time Series Data - Application to Demand-Side Management in Electricity Markets

Author(s): Balandat, Maximilian | Advisor(s): Tomlin, Claire J | Abstract: This thesis develops novel methods for econometric analysis of time series data, and applies these methods in the context of demand-side management in California’s electricity markets. The first method is an optimization framework for simulating the behavior of electricity consumers with realistic dynamic consumption models under various dynamic electricity tariffs. This allows to generate new insights into the effect of intertemporal substitution on individual and social surplus under various existing and hypothetical pricing schemes, including Real-Time pricing, Time-of-Use pricing, Critical Peak Pricing, and Critical Peak Rebates. By introducing the concept of a baseline-taking equilibrium, it is possible to quantify the welfare implications of the manipulation of Demand Response (DR) baselines. A second contribution of this thesis is the formulation of the optimal contract design problem a DR aggregator faces when employing inter-temporal flexibility of commercial buildings' HVAC-related power consumption in order to participate in the regulation capacity spot market. The associated bilevel optimization problem can be cast as a mixed-integer optimization problem that can be solved efficiently. The third contribution of this thesis is a novel methodology for causal inference on time series data based on ideas from Machine Learning. This two-stage approach allows to evaluate conditional individual treatment effects in experimental and non-experimental settings with repeated treatment exposure. The setup is very general and agnostic to the specific regression models used. Besides establishing core theoretical results, this thesis presents associated multi-stage bootstrapping techniques, which allow to perform statistical inference even under computationally challenging prediction models. Based on the developed inference methodology, the empirical contribution of this thesis is to study the effect of receiving DR notifications on energy consumption of residential electricity customers in California, including causal estimates of individual and average treatment effects. These results inform the design of a large-scale randomized controlled trial of much broader scope, which is currently being implemented in collaboration with a DR provider in California and involves more than 10,000 customers over a 14 month duration.

[1]  D. Cochrane,et al.  Application of Least Squares Regression to Relationships Containing Auto-Correlated Error Terms , 1949 .

[2]  D. Rubin Estimating causal effects of treatments in randomized and nonrandomized studies. , 1974 .

[3]  Kjell A. Doksum,et al.  Empirical Probability Plots and Statistical Inference for Nonlinear Models in the Two-Sample Case , 1974 .

[4]  James G. MacKinnon,et al.  A MAXIMUM LIKELIHOOD PROCEDURE FOR REGRESSION WITH AUTOCORRELATED ERRORS , 1978 .

[5]  L. E. Clarke,et al.  Probability and Measure , 1980 .

[6]  David A. Lane Randomization Analysis of Experimental Data: The Fisher Randomization Test Comment , 1980 .

[7]  J. Robert Malko,et al.  The residential demand for electricity by time-of-use: A survey of twelve experiments with peak load pricing☆ , 1983 .

[8]  D. Rubin,et al.  The central role of the propensity score in observational studies for causal effects , 1983 .

[9]  D. Rubin,et al.  Reducing Bias in Observational Studies Using Subclassification on the Propensity Score , 1984 .

[10]  Douglas W. Caves,et al.  Consistency of residential customer response in time-of-use electricity pricing experiments , 1984 .

[11]  Orley Ashenfelter,et al.  Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs , 1984 .

[12]  R. Lalonde Evaluating the Econometric Evaluations of Training Programs with Experimental Data , 1984 .

[13]  C. Glymour,et al.  STATISTICS AND CAUSAL INFERENCE , 1985 .

[14]  J. Haltiwanger,et al.  Tax Reform and Strong Substitutes , 1986 .

[15]  Robert Tibshirani,et al.  Bootstrap Methods for Standard Errors, Confidence Intervals, and Other Measures of Statistical Accuracy , 1986 .

[16]  B. Efron Better Bootstrap Confidence Intervals , 1987 .

[17]  B. Efron The jackknife, the bootstrap, and other resampling plans , 1987 .

[18]  Charles F. Manski,et al.  Analog estimation methods in econometrics , 1988 .

[19]  M. Nerlove,et al.  Biases in dynamic models with fixed effects , 1988 .

[20]  J. Slemrod,et al.  Optimal Taxation and Optimal Tax Systems , 1989 .

[21]  James J. Heckman,et al.  Choosing Among Alternative Nonexperimental Methods for Estimating the Impact of Social Programs: the Case of Manpower Training , 1989 .

[22]  H. Künsch The Jackknife and the Bootstrap for General Stationary Observations , 1989 .

[23]  W. Newey,et al.  Semiparametric Efficiency Bounds , 1990 .

[24]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[25]  Chitru S. Fernando,et al.  The theory of peak-load pricing: A survey , 1995 .

[26]  D. Rubin,et al.  Assessing the effect of an influenza vaccine in an encouragement design. , 2000, Biostatistics.

[27]  Francis X. Diebold,et al.  Modeling and Forecasting Realized Volatility , 2001 .

[28]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[29]  J. Laffont,et al.  The Theory of Incentives: The Principal-Agent Model , 2001 .

[30]  E. Duflo,et al.  How Much Should We Trust Differences-in-Differences Estimates? , 2001 .

[31]  Jeffrey A. Smith,et al.  Does Matching Overcome Lalonde's Critique of Nonexperimental Estimators? , 2000 .

[32]  S. Borenstein The Trouble With Electricity Markets: Understanding California's Restructuring Disaster , 2002 .

[33]  E. Duflo,et al.  The Role of Information and Social Interactions in Retirement Plan Decisions: Evidence from a Randomized Experiment , 2002 .

[34]  S. Borenstein,et al.  Dynamic Pricing, Advanced Metering, and Demand Response in Electricity Markets , 2002 .

[35]  A. Faruqui,et al.  Time-Varying Retail Electricity Prices: Theory and Practice , 2003 .

[36]  J. Tirole,et al.  Intrinsic and Extrinsic Motivation , 2003 .

[37]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[38]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[39]  P. Kantor Foundations of Statistical Natural Language Processing , 2001, Information Retrieval.

[40]  Sergio Firpo Efficient Semiparametric Estimation of Quantile Treatment Effects , 2004 .

[41]  J. Tirole,et al.  Retail Electricity Competition , 2004 .

[42]  R. C. Bradley Basic properties of strong mixing conditions. A survey and some open questions , 2005, math/0511078.

[43]  Simeng Liu,et al.  Experimental Analysis of Model-Based Predictive Optimal Control for Active and Passive Building Thermal Storage Inventory , 2005 .

[44]  Alberto Abadie Semiparametric Difference-in-Differences Estimators , 2005 .

[45]  G. Imbens,et al.  The Propensity Score with Continuous Treatments , 2005 .

[46]  J. Tirole,et al.  Incentives and Prosocial Behavior , 2004 .

[47]  Erick Jorge Canales-Rodríguez,et al.  Granger Causality on Spatial Manifolds: Applications to Neuroimaging , 2006 .

[48]  Patrice Marcotte,et al.  An overview of bilevel optimization , 2007, Ann. Oper. Res..

[49]  David S. Wishart,et al.  Applications of Machine Learning in Cancer Prediction and Prognosis , 2006, Cancer informatics.

[50]  Susan A. Murphy,et al.  Monographs on statistics and applied probability , 1990 .

[51]  Christian Hansen,et al.  Generalized least squares inference in panel and multilevel models with serial correlation and fixed effects , 2007 .

[52]  F. Wolak Residential Customer Response to Real-time Pricing: The Anaheim Critical Peak Pricing Experiment , 2007 .

[53]  Warren B. Powell,et al.  Approximate Dynamic Programming - Solving the Curses of Dimensionality , 2007 .

[54]  Richard K. Crump,et al.  Nonparametric Tests for Treatment Effect Heterogeneity , 2006, The Review of Economics and Statistics.

[55]  Mohammed H. Albadi,et al.  A summary of demand response in electricity markets , 2008 .

[56]  Sila Kiliccote,et al.  Lawrence Berkeley National Laboratory Lawrence Berkeley National Laboratory Title Estimating Demand Response Load Impacts : Evaluation of Baseline Load Models for Non-Residential Buildings in California Permalink , 2008 .

[57]  Causation and Prediction Challenge at WCCI 2008, Hong Kong, June 1-6, 2008 , 2008, WCCI Causation and Prediction Challenge.

[58]  Sanem Sergici,et al.  The Impact of Informational Feedback on Energy Consumption -- A Survey of the Experimental Evidence , 2009 .

[59]  B. Hobbs,et al.  When It Comes to Demand Response, Is FERC Its Own Worst Enemy? , 2009 .

[60]  Jian Ma,et al.  Operational Impacts of Wind Generation on California Power Systems , 2009, IEEE Transactions on Power Systems.

[61]  H. Paul Williams,et al.  Logic and Integer Programming , 2009, Logic and Integer Programming.

[62]  Karen Herter,et al.  Residential response to critical-peak pricing of electricity: California evidence , 2010 .

[63]  Pablo A. Parrilo,et al.  Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization , 2007, SIAM Rev..

[64]  Elizabeth A Stuart,et al.  Improving propensity score weighting using machine learning , 2010, Statistics in medicine.

[65]  Lihong Li,et al.  Learning from Logged Implicit Exploration Data , 2010, NIPS.

[66]  A. Belloni,et al.  SPARSE MODELS AND METHODS FOR OPTIMAL INSTRUMENTS WITH AN APPLICATION TO EMINENT DOMAIN , 2012 .

[67]  Causality: Objectives and Assessment (NIPS 2008 Workshop), Whistler, Canada, December 12, 2008 , 2010, NIPS Causality: Objectives and Assessment.

[68]  Peng Sun,et al.  Information Relaxations and Duality in Stochastic Dynamic Programs , 2010, Oper. Res..

[69]  Ted K.A. Brekken,et al.  Reserve requirement impacts of large-scale integration of wind, solar, and ocean wave power generation , 2010, IEEE PES General Meeting.

[70]  A. Faruqui,et al.  Household response to dynamic pricing of electricity: a survey of 15 experiments , 2010 .

[71]  Philip Haves,et al.  Model predictive control for the operation of building cooling systems , 2010, Proceedings of the 2010 American Control Conference.

[72]  Barbara R. Alexander Dynamic Pricing? Not So Fast! A Residential Consumer Perspective , 2010 .

[73]  J. Kmenta Mostly Harmless Econometrics: An Empiricist's Companion , 2010 .

[74]  Lior Rokach,et al.  Introduction to Recommender Systems Handbook , 2011, Recommender Systems Handbook.

[75]  Vincent W. S. Wong,et al.  Real-time vehicle-to-grid control algorithm under price uncertainty , 2011, 2011 IEEE International Conference on Smart Grid Communications (SmartGridComm).

[76]  H. Allcott,et al.  Rethinking Real Time Electricity Pricing , 2011 .

[77]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[78]  Frauke Oldewurtel,et al.  Stochastic model predictive control for energy efficient building climate control , 2011 .

[79]  Peter Palensky,et al.  Demand Side Management: Demand Response, Intelligent Energy Systems, and Smart Loads , 2011, IEEE Transactions on Industrial Informatics.

[80]  Wei Chu,et al.  An unbiased offline evaluation of contextual bandit algorithms with generalized linear models , 2011 .

[81]  N. P. Padhy,et al.  Influence of Price Responsive Demand Shifting Bidding on Congestion and LMP in Pool-Based Day-Ahead Electricity Markets , 2011, IEEE Transactions on Power Systems.

[82]  Wei Chu,et al.  Unbiased offline evaluation of contextual-bandit-based news article recommendation algorithms , 2010, WSDM '11.

[83]  Francesco Borrelli,et al.  Bilinear Model Predictive Control of a HVAC System Using Sequential Quadratic Programming , 2011 .

[84]  Vincent W. S. Wong,et al.  Advanced Demand Side Management for the Future Smart Grid Using Mechanism Design , 2012, IEEE Transactions on Smart Grid.

[85]  Jonathan Levin,et al.  Pricing and Welfare in Health Plan Choice , 2008, The American economic review.

[86]  David E. Culler,et al.  Identifying models of HVAC systems using semiparametric regression , 2012, 2012 American Control Conference (ACC).

[87]  Manfred Morari,et al.  Use of model predictive control and weather forecasts for energy efficient building climate control , 2012 .

[88]  Zhi Chen,et al.  Real-Time Price-Based Demand Response Management for Residential Appliances via Stochastic Optimization and Robust Optimization , 2012, IEEE Transactions on Smart Grid.

[89]  Koichiro Ito,et al.  Do Consumers Respond to Marginal or Average Price? Evidence from Nonlinear Electricity Pricing , 2012 .

[90]  Shaojie Tang,et al.  Distributed Demand and Response Algorithm for Optimizing Social-Welfare in Smart Grid , 2012, 2012 IEEE 26th International Parallel and Distributed Processing Symposium.

[91]  Shing-Chow Chan,et al.  Demand Response Optimization for Smart Home Scheduling Under Real-Time Pricing , 2012, IEEE Transactions on Smart Grid.

[92]  Katrina Jessoe,et al.  Knowledge is (Less) Power: Experimental Evidence from Residential Energy Use , 2012 .

[93]  John N. Tsitsiklis,et al.  European Journal of Operational Research Pricing of Fluctuations in Electricity Markets , 2022 .

[94]  Michael K. Price,et al.  Using Nonpecuniary Strategies to Influence Behavior: Evidence from a Large-Scale Field Experiment , 2011, Review of Economics and Statistics.

[95]  Stephen P. Ryan,et al.  Selection on Moral Hazard in Health Insurance , 2011, The American economic review.

[96]  Colin Neil Jones,et al.  Least-restrictive robust periodic model predictive control applied to room temperature regulation , 2013, Autom..

[97]  Johanna L. Mathieu,et al.  A framework for and assessment of demand response and energy storage in power systems , 2013, 2013 IREP Symposium Bulk Power System Dynamics and Control - IX Optimization, Security and Control of the Emerging Power Grid.

[98]  V. Zavala Real-Time Optimization Strategies for Building Systems† , 2013 .

[99]  Sean P. Meyn,et al.  Ancillary service for the grid via control of commercial building HVAC systems , 2013, 2013 American Control Conference.

[100]  Henrik Madsen,et al.  A bilevel model for electricity retailers' participation in a demand response market environment , 2013 .

[101]  H. Chao,et al.  Incentive effects of paying demand response in wholesale electricity markets , 2013 .

[102]  Gongguo Tang,et al.  A game-theoretic approach for optimal time-of-use electricity pricing , 2013, IEEE Transactions on Power Systems.

[103]  Evangelos Vrettos,et al.  Robust Provision of Frequency Reserves by Office Building Aggregations , 2014 .

[104]  Raj Chetty,et al.  Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates , 2014 .

[105]  Alberto L. Sangiovanni-Vincentelli,et al.  Building Efficiency and Sustainability in the Tropics ( SinBerBEST ) Title Model Predictive Control Approach to Online Computation of Demand-Side Flexibility of Commercial Buildings HVAC Systems for Supply Following Permalink , 2014 .

[106]  Hal R. Varian,et al.  Big Data: New Tricks for Econometrics , 2014 .

[107]  Susan Athey,et al.  Finite Population Causal Standard Errors , 2014 .

[108]  Mo Chen,et al.  Contract design for frequency regulation by aggregations of commercial buildings , 2014, 2014 52nd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[109]  Jonathan Levin,et al.  The Data Revolution and Economic Analysis , 2013, Innovation Policy and the Economy.

[110]  Tin Kam Ho,et al.  Demand forecasting in smart grids , 2014, Bell Labs Technical Journal.

[111]  J. Neubauer,et al.  Deployment of Behind-The-Meter Energy Storage for Demand Charge Reduction , 2015 .

[112]  Wesley R. Hartmann,et al.  Welfare Effects of Home Automation Technology with Dynamic Pricing , 2015 .

[113]  Susan Athey,et al.  Machine Learning and Causal Inference for Policy Evaluation , 2015, KDD.

[114]  Takanori Ida,et al.  The Persistence of Moral Suasion and Economic Incentives: Field Experimental Evidence from Energy Demand , 2015 .

[115]  Christos V. Verikoukis,et al.  A Survey on Demand Response Programs in Smart Grids: Pricing Methods and Optimization Algorithms , 2015, IEEE Communications Surveys & Tutorials.

[116]  Steven L. Scott,et al.  Inferring causal impact using Bayesian structural time-series models , 2015, 1506.00356.

[117]  Susan Athey,et al.  Recursive partitioning for heterogeneous causal effects , 2015, Proceedings of the National Academy of Sciences.

[118]  Suchi Saria,et al.  A Bayesian Nonparametic Approach for Estimating Individualized Treatment-Response Curves , 2016, ArXiv.

[119]  Claire J. Tomlin,et al.  Residential demand response targeting using machine learning with observational data , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[120]  Matthew Harding,et al.  Empowering Consumers Through Data and Smart Technology: Experimental Evidence on the Consequences of Time‐of‐Use Electricity Pricing Policies , 2016 .

[121]  S. Borenstein The economics of fixed cost recovery by utilities , 2016 .

[122]  Christopher R. Knittel,et al.  Sufficient Statistics for Imperfect Externality-Correcting Policies , 2016 .

[123]  Zhou Datong,et al.  A Bayesian perspective on Residential Demand Response using smart meter data , 2016 .

[124]  A. Mesbah,et al.  Stochastic Model Predictive Control: An Overview and Perspectives for Future Research , 2016, IEEE Control Systems.

[125]  Andrew Caplin Measuring and Modeling Attention , 2016 .

[126]  Lucas W. Davis,et al.  Do Energy Efficiency Investments Deliver at the Right Time? , 2017, American Economic Journal: Applied Economics.

[127]  Stefan Wager,et al.  Estimation and Inference of Heterogeneous Treatment Effects using Random Forests , 2015, Journal of the American Statistical Association.

[128]  Duncan S. Callaway,et al.  Location, Location, Location: The Variable Value of Renewable Energy and Demand-Side Efficiency Resources , 2018, Journal of the Association of Environmental and Resource Economists.