Assuring explainability on demand response targeting via credit scoring

Abstract As data-driven innovation becomes a main trend in the energy sector, explainability of data-driven actions is becoming a major fairness issue for the residential applications, and it is expected to become a requirement for regulatory compliance. Explainability, however, often demands a sacrifice in prediction performance and affects the effectiveness of data-driven actions. In this study, we consider data-driven customer targeting in an incentive-based residential demand response program, and investigate the explainability-performance tradeoff when using simple-rule based, machine learning, and credit scoring methods. Credit scoring, that has been a popular solution in the finance discipline for over 60 years, is a scorecard based modeling method that can surely provide explainability. We first provide the detailed steps of applying credit scoring to the demand response problem. Then, we use a dataset of 14,525 households obtained from a real demand response program and analyze two prediction problems – participation prediction and behavior change prediction. The results show that credit scoring can achieve a comparable performance as the best-performing machine learning methods while providing full explainability. Our results suggest that credit scoring can be a promising explainability option for broader energy sector problems.

[1]  Alan Meier,et al.  Accuracy of home energy rating systems , 2000 .

[2]  David J. Hand,et al.  Statistical Classification Methods in Consumer Credit Scoring: a Review , 1997 .

[3]  C. Bolton,et al.  Logistic regression and its application in credit scoring , 2010 .

[4]  Steve Halligan,et al.  Disadvantages of using the area under the receiver operating characteristic curve to assess imaging tests: A discussion and proposal for an alternative approach , 2015, European Radiology.

[5]  I. Vassileva,et al.  Understanding energy consumption behavior for future demand response strategy development , 2012 .

[6]  J. Wiginton A Note on the Comparison of Logit and Discriminant Models of Consumer Credit Behavior , 1980, Journal of Financial and Quantitative Analysis.

[7]  M. P. Moghaddam,et al.  Demand response modeling considering Interruptible/Curtailable loads and capacity market programs , 2010 .

[8]  Ramachandra Kota,et al.  Cooperative Virtual Power Plant Formation Using Scoring Rules , 2012, AAAI.

[9]  J. Aghaei,et al.  Demand response in smart electricity grids equipped with renewable energy sources: A review , 2013 .

[10]  Ram Rajagopal,et al.  Data-Driven Targeting of Customers for Demand Response , 2016, IEEE Transactions on Smart Grid.

[11]  F. Cheong,et al.  Building a Scorecard in Practice , 2008 .

[12]  Stefan Rüping,et al.  Learning interpretable models , 2006 .

[13]  Jin-ho Kim,et al.  Common failures of demand response , 2011 .

[14]  Ram Rajagopal,et al.  Demand response targeting using big data analytics , 2013, 2013 IEEE International Conference on Big Data.

[15]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[16]  Been Kim,et al.  Towards A Rigorous Science of Interpretable Machine Learning , 2017, 1702.08608.

[17]  Hamid Reza Momeni,et al.  Optimal estimation and control of WECS via a Genetic Neuro Fuzzy Approach , 2012 .

[18]  Loretta J. Mester What's the point of credit scoring? , 1997 .

[19]  Jianzhou Wang,et al.  An adaptive fuzzy combination model based on self-organizing map and support vector regression for electric load forecasting , 2012 .

[20]  Karen Herter Residential implementation of critical-peak pricing of electricity , 2007 .

[21]  Mohammed H. Albadi,et al.  A summary of demand response in electricity markets , 2008 .

[22]  Pedro Larrañaga,et al.  A review of feature selection techniques in bioinformatics , 2007, Bioinform..

[23]  Jonathan N. Crook,et al.  Credit Scoring and Its Applications , 2002, SIAM monographs on mathematical modeling and computation.

[24]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[25]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[26]  J. Torriti,et al.  A review of the costs and benefits of demand response for electricity in the UK , 2013 .