A Robust Segmented Mixed Effect Regression Model for Baseline Electricity Consumption Forecasting

Renewable energy production has been surging in the United States and around the world in recent years. To mitigate increasing renewable generation uncertainty and intermittency, proactive demand response algorithms and programs are proposed and developed to improve the utilization of load flexibility further and increase power system operation efficiency. One of the biggest challenges to efficient control and operation of demand response resources is how to forecast the baseline electricity consumption and estimate the load impact from demand response resources accurately. In this paper, we propose to use a mixed-effect segmented regression model and a new robust estimate for forecasting the baseline electricity consumption in Southern California by combining the ideas of random effect regression model, segmented regression model, and the least trimmed squares estimate. Since the log-likelihood of the considered model is not differentiable at breakpoints, we propose a new backfitting algorithm to estimate the unknown parameters. The estimation performance and predictive power of the new estimation procedure have been demonstrated with both simulation studies and the real data application for the electric load baseline forecasting in Southern California.

[1]  Weixin Yao,et al.  Robust linear regression: A review and comparison , 2014, Commun. Stat. Simul. Comput..

[2]  J. Ware,et al.  Random-effects models for longitudinal data. , 1982, Biometrics.

[3]  Jianhui Wang,et al.  Review of real-time electricity markets for integrating Distributed Energy Resources and Demand Response , 2015 .

[4]  Nathan Charlton,et al.  A refined parametric model for short term load forecasting , 2014 .

[5]  E. Feuer,et al.  Permutation tests for joinpoint regression with applications to cancer rates. , 2000, Statistics in medicine.

[6]  Tianshu Wei,et al.  From passive demand response to proactive demand participation , 2015, 2015 IEEE International Conference on Automation Science and Engineering (CASE).

[7]  Peter Filzmoser,et al.  Robust fitting of mixtures using the trimmed likelihood estimator , 2007, Comput. Stat. Data Anal..

[8]  S. MacEachern,et al.  Regularization of Case-Specific Parameters for Robustness and Efficiency , 2012, 1210.0701.

[9]  Atul K. Raturi,et al.  Renewables 2016 Global status report , 2015 .

[10]  Benjamin Goehry,et al.  Aggregation of Multi-Scale Experts for Bottom-Up Load Forecasting , 2020, IEEE Transactions on Smart Grid.

[11]  P. Feder The Log Likelihood Ratio in Segmented Regression , 1975 .

[12]  V. Muggeo Estimating regression models with unknown break‐points , 2003, Statistics in medicine.

[13]  Simon G Thompson,et al.  Flexible parametric models for random‐effects distributions , 2008, Statistics in medicine.

[14]  Chen Chen,et al.  Ensuring Cyberattack-Resilient Load Forecasting with A Robust Statistical Method , 2019, 2019 IEEE Power & Energy Society General Meeting (PESGM).

[15]  Bayesian analysis of logistic regression with an unknown change point and covariate measurement error. , 2001, Statistics in medicine.

[16]  Pierre Pinson,et al.  Global Energy Forecasting Competition 2012 , 2014 .

[17]  P. Diggle Analysis of Longitudinal Data , 1995 .

[18]  Pierluigi Caramia,et al.  Multivariate Quantile Regression for Short-Term Probabilistic Load Forecasting , 2020, IEEE Transactions on Power Systems.

[19]  M. Lesperance,et al.  PIECEWISE REGRESSION: A TOOL FOR IDENTIFYING ECOLOGICAL THRESHOLDS , 2003 .

[20]  Asher Tishler,et al.  A Maximum Likelihood Method for Piecewise Regression Models with a Continuous Dependent Variable , 1981 .

[21]  V. Yohai HIGH BREAKDOWN-POINT AND HIGH EFFICIENCY ROBUST ESTIMATES FOR REGRESSION , 1987 .

[22]  Ruxandra Prodan Potential Pitfalls in Determining Multiple Structural Changes With an Application to Purchasing Power Parity , 2004 .

[23]  Katarina Grolinger,et al.  Deep Learning for Load Forecasting: Sequence to Sequence Recurrent Neural Networks With Attention , 2020, IEEE Access.

[24]  Yonghua Song,et al.  Hybrid Ensemble Deep Learning for Deterministic and Probabilistic Low-Voltage Load Forecasting , 2020, IEEE Transactions on Power Systems.

[25]  Shu-Cherng Fang,et al.  Robust Regression Models for Load Forecasting , 2019, IEEE Transactions on Smart Grid.

[26]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[27]  V. Yohai,et al.  A class of robust and fully efficient regression estimators , 2002 .

[28]  Peter J. Rousseeuw,et al.  ROBUST REGRESSION BY MEANS OF S-ESTIMATORS , 1984 .

[29]  W. Yao,et al.  Outlier detection and robust mixture modeling using nonconvex penalized likelihood , 2015 .

[30]  Tianshu Wei,et al.  Proactive Demand Participation of Smart Buildings in Smart Grid , 2016, IEEE Transactions on Computers.

[31]  E. Fowlkes,et al.  Some Algorithms for Linear Spline and Piecewise Multiple Linear Regression , 1976 .

[32]  Juni Palmgren,et al.  A random change point model for assessing variability in repeated measures of cognitive function , 2008, Statistics in medicine.

[33]  A. Siegel Robust regression using repeated medians , 1982 .

[34]  R. Tibshirani,et al.  Generalized Additive Models , 1986 .

[35]  Louis A. Jaeckel Estimating Regression Coefficients by Minimizing the Dispersion of the Residuals , 1972 .

[36]  J. Daurès,et al.  Regression splines for threshold selection in survival data analysis. , 2001, Statistics in medicine.

[37]  Jun Hu,et al.  Short-Term Load Forecasting With Deep Residual Networks , 2018, IEEE Transactions on Smart Grid.

[38]  David C. Atkins,et al.  Segmented mixed models with random changepoints: a maximum likelihood approach with application to treatment for depression study , 2014 .

[39]  Mark O'Malley,et al.  Challenges and barriers to demand response deployment and evaluation , 2015 .

[40]  Meng Li,et al.  Robust estimation of the number of components for mixtures of linear regression models , 2016, Comput. Stat..

[41]  P. Rousseeuw Least Median of Squares Regression , 1984 .

[42]  Quanxi Shao,et al.  Applications: Modelling trends in groundwater levels by segmented regression with constraints , 2002 .

[43]  Weilin Li,et al.  Short-term electrical load forecasting using the Support Vector Regression (SVR) model to calculate the demand response baseline for office buildings , 2017 .

[44]  Yiyuan She,et al.  Outlier Detection Using Nonconvex Penalized Regression , 2010, ArXiv.

[45]  R. Cook,et al.  Testing for Two-Phase Regressions , 1979 .

[46]  Li Yang,et al.  Robust fitting of mixtures of factor analyzers using the trimmed likelihood estimator , 2017, Commun. Stat. Simul. Comput..

[47]  Mohamed Boutahar,et al.  Bai and Perron's and spectral density methods for structural change detection in the US inflation process , 2004 .

[48]  Yang Liu,et al.  Spatio-temporal modeling of electric loads , 2017, 2017 North American Power Symposium (NAPS).