Hybrid filter-wrapper feature selection for short-term load forecasting

Selection of input features plays an important role in developing models for short-term load forecasting (STLF). Previous studies along this line of research have focused pre-dominantly on filter and wrapper methods. Given the potential value of a hybrid selection scheme that includes both filter and wrapper methods in constructing an appropriate pool of features, coupled with the general lack of success in employing filter or wrapper methods individually, in this study we propose a hybrid filter-wrapper approach for STLF feature selection. This proposed approach, which is believed to have taken full advantage of the strengths of both filter and wrapper methods, first uses the Partial Mutual Information based filter method to filter out most of the irrelevant and redundant features, and subsequently applies a wrapper method, implemented via a firefly algorithm, to further reduce the redundant features without degrading the forecasting accuracy. The well-established support vector regression is selected as the modeler to implement the proposed hybrid feature selection scheme. Real-world electricity load datasets from a North-American electric utility and the Global Energy Forecasting Competition 2012 have been used to test the performance of the proposed approach, and the experimental results show its superiority over selected counterparts. A flowchart of the proposed hybrid feature selection method.Display Omitted We propose a filter-wrapper feature selection method for STLF.PMI is first used to filter irrelevant and redundant features.A wrapper method is then used to further reduce the remaining redundant features.The proposed hybrid method can identify less inputs with relatively shorter time.Better forecasting results are obtained based on the selected features.

[1]  A. Goia,et al.  Functional clustering and linear regression for peak load forecasting , 2010 .

[2]  M. Murray A review and comparison , 2008 .

[3]  Ying Chen,et al.  Short-Term Load Forecasting: Similar Day-Based Wavelet Neural Networks , 2010, IEEE Transactions on Power Systems.

[4]  Silja Meyer-Nieberg,et al.  Electric load forecasting methods: Tools for decision making , 2009, Eur. J. Oper. Res..

[5]  V.H. Hinojosa,et al.  Short-Term Load Forecasting Using Fuzzy Inductive Reasoning and Evolutionary Algorithms , 2010, IEEE Transactions on Power Systems.

[6]  Zhiyong Wang,et al.  Short-Term Load Forecasting Based on Mutual Information and Artificial Neural Network , 2006, ISNN.

[7]  Paras Mandal,et al.  A novel hybrid approach using wavelet, firefly algorithm, and fuzzy ARTMAP for day-ahead electricity price forecasting , 2013, IEEE Transactions on Power Systems.

[8]  Samer S. Saab,et al.  Univariate modeling and forecasting of energy consumption: the case of electricity in Lebanon , 2001 .

[9]  Sung-Kwan Joo,et al.  Holiday Load Forecasting Using Fuzzy Polynomial Regression With Weather Feature Selection and Adjustment , 2012, IEEE Transactions on Power Systems.

[10]  Ming-Wei Chang,et al.  Load Forecasting Using Support Vector Machines: A Study on EUNITE Competition 2001 , 2004, IEEE Transactions on Power Systems.

[11]  Liu Xiao-hua,et al.  Short-term Load Forecasting Based on Support Vector Machine , 2005 .

[12]  S. Fan,et al.  Short-term load forecasting based on an adaptive hybrid method , 2006, IEEE Transactions on Power Systems.

[13]  Jose Miguel Puerta,et al.  A GRASP algorithm for fast hybrid (filter-wrapper) feature subset selection in high-dimensional datasets , 2011, Pattern Recognit. Lett..

[14]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[15]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[16]  Amir F. Atiya,et al.  A review and comparison of strategies for multi-step ahead time series forecasting based on the NN5 forecasting competition , 2011, Expert Syst. Appl..

[17]  Zhou Quan,et al.  RBF Neural Network and ANFIS-Based Short-Term Load Forecasting Approach in Real-Time Price Environment , 2008, IEEE Transactions on Power Systems.

[18]  Henrique S. Hippert,et al.  An evaluation of Bayesian techniques for controlling model complexity in a neural network for short-term load forecasting , 2010 .

[19]  Mansour Sheikhan,et al.  Neural-based electricity load forecasting using hybrid of GA and ACO for feature selection , 2011, Neural Computing and Applications.

[20]  Benjamin F. Hobbs,et al.  Artificial neural networks for short-term energy forecasting: Accuracy and economic value , 1998, Neurocomputing.

[21]  Ravi Sankar,et al.  Time Series Prediction Using Support Vector Machines: A Survey , 2009, IEEE Computational Intelligence Magazine.

[22]  N. Amjady,et al.  Day-ahead price forecasting of electricity markets by combination of mutual information technique and neural network , 2008, 2008 IEEE Power and Energy Society General Meeting - Conversion and Delivery of Electrical Energy in the 21st Century.

[23]  Ashish Sharma,et al.  Seasonal to interannual rainfall probabilistic forecasts for improved water supply management: Part 3 — A nonparametric probabilistic forecast model , 2000 .

[24]  Holger R. Maier,et al.  Input determination for neural network models in water resources applications. Part 1—background and methodology , 2005 .

[25]  Carlos E. Pedreira,et al.  Neural networks for short-term load forecasting: a review and evaluation , 2001 .

[26]  Farshid Keynia,et al.  Electricity market price spike analysis by a hybrid data model and feature selection technique , 2010 .

[27]  K. Chandrasekaran,et al.  Optimal Deviation Based Firefly Algorithm Tuned Fuzzy Design for Multi-Objective UCP , 2013, IEEE Transactions on Power Systems.

[28]  Saifur Rahman,et al.  Input variable selection for ANN-based short-term load forecasting , 1998 .

[29]  Zhongyi Hu,et al.  PSO-MISMO Modeling Strategy for MultiStep-Ahead Time Series Prediction , 2014, IEEE Transactions on Cybernetics.

[30]  Amir Hossein Gandomi,et al.  Firefly Algorithm for solving non-convex economic dispatch problems with valve loading effect , 2012, Appl. Soft Comput..

[31]  Nima Amjady,et al.  Mixed price and load forecasting of electricity markets by a new iterative prediction method , 2009 .

[32]  Özge Uncu,et al.  A novel feature selection approach: Combining feature wrappers and filters , 2007, Inf. Sci..

[33]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[34]  Yukyee Leung,et al.  A Multiple-Filter-Multiple-Wrapper Approach to Gene Selection and Microarray Data Classification , 2010, IEEE ACM Trans. Comput. Biol. Bioinform..

[35]  Zhongyi Hu,et al.  Interval Forecasting of Electricity Demand: A Novel Bivariate EMD-based Support Vector Regression Modeling Framework , 2014, ArXiv.

[36]  Xin-She Yang,et al.  Firefly Algorithms for Multimodal Optimization , 2009, SAGA.

[37]  Richard Nock,et al.  A hybrid filter/wrapper approach of feature selection using information theory , 2002, Pattern Recognit..

[38]  Souhaib Ben Taieb,et al.  A gradient boosting approach to the Kaggle load forecasting competition , 2014 .

[39]  Q. Henry Wu,et al.  Electric Load Forecasting Based on Locally Weighted Support Vector Regression , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[40]  C. Senabre,et al.  Application of SOM neural networks to short-term load forecasting: The Spanish electricity market case study , 2012 .

[41]  Zhongyi Hu,et al.  Multi-step-ahead time series prediction using multiple-output support vector regression , 2014, Neurocomputing.

[42]  Farshid Keynia,et al.  Short-term load forecasting of power systems by combination of wavelet transform and neuro-evolutionary algorithm , 2009 .

[43]  Rob J Hyndman,et al.  Short-Term Load Forecasting Based on a Semi-Parametric Additive Model , 2012, IEEE Transactions on Power Systems.

[44]  Raphael Nedellec,et al.  GEFCom2012: Electric load forecasting and backcasting with semi-parametric models , 2014 .

[45]  Ashish Sharma,et al.  Seasonal to interannual rainfall probabilistic forecasts for improved water supply management: Part 1 — A strategy for system predictor identification , 2000 .

[46]  Sheng Ping Koo Feature Selection of Microarray Data , 2009 .

[47]  Nathan Charlton,et al.  A refined parametric model for short term load forecasting , 2014 .

[48]  R. Adapa,et al.  The impacts of temperature forecast uncertainty on Bayesian load forecasting , 1998 .

[49]  Rahmat-Allah Hooshmand,et al.  A hybrid intelligent algorithm based short-term load forecasting approach , 2013 .

[50]  James W. Taylor,et al.  An evaluation of Bayesian techniques for controlling model complexity and selecting inputs in a neural network for short-term load forecasting , 2010, Neural Networks.

[51]  Agnaldo J. R. Reis,et al.  Feature extraction via multiresolution analysis for short-term load forecasting , 2005, IEEE Transactions on Power Systems.

[52]  Raymond Chiong,et al.  An alternative way of presenting statistical test results when evaluating the performance of stochastic approaches , 2015, Neurocomputing.

[53]  Rob J Hyndman,et al.  Another look at measures of forecast accuracy , 2006 .

[54]  Alireza Khotanzad,et al.  A Neuro-Fuzzy Approach to Short-Term Load Forecasting in a Price-Sensitive Environment , 2002, IEEE Power Engineering Review.

[55]  Pierre Pinson,et al.  Global Energy Forecasting Competition 2012 , 2014 .

[56]  Farshid Keynia,et al.  A New Neural Network Approach to Short Term Load Forecasting of Electrical Power Systems , 2011 .

[57]  P. McSharry,et al.  Short-Term Load Forecasting Methods: An Evaluation Based on European Data , 2007, IEEE Transactions on Power Systems.

[58]  Jaime Lloret,et al.  A Survey on Electric Power Demand Forecasting: Future Trends in Smart Grids, Microgrids and Smart Buildings , 2014, IEEE Communications Surveys & Tutorials.

[59]  Tao Hong,et al.  Energy Forecasting: Past, Present, and Future , 2013 .

[60]  Mohammad Kazem Sayadia,et al.  A discrete firefly metaheuristic with local search for makespan minimization in permutation flow shop scheduling problems , 2010 .

[61]  Amiya Nayak,et al.  Fault identification with binary adaptive fireflies in parallel and distributed systems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[62]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[63]  Zhongyi Hu,et al.  Beyond One-Step-Ahead Forecasting: Evaluation of Alternative Multi-Step-Ahead Forecasting Models for Crude Oil Prices , 2013, ArXiv.

[64]  Zhongyi Hu,et al.  Electricity Load Forecasting Using Support Vector Regression with Memetic Algorithms , 2013, TheScientificWorldJournal.

[65]  James Robert Lloyd,et al.  GEFCom2012 hierarchical load forecasting: Gradient boosting machines and Gaussian processes , 2014 .

[66]  Luis Neves,et al.  Short‐term load forecasting based on support vector regression and load profiling , 2014 .

[67]  Farshid Keynia A new feature selection algorithm and composite neural network for electricity price forecasting , 2012, Eng. Appl. Artif. Intell..

[68]  Lester C. Hunt,et al.  Electricity demand for Sri Lanka : A time series analysis , 2008 .

[69]  Jun Wang,et al.  Applying input variables selection technique on input weighted support vector machine modeling for BOF endpoint prediction , 2010, Eng. Appl. Artif. Intell..

[70]  N Amjady,et al.  Midterm Demand Prediction of Electrical Power Systems Using a New Hybrid Forecast Technique , 2011, IEEE Transactions on Power Systems.

[71]  Yukyee Leung,et al.  A Multiple-Filter-Multiple-Wrapper Approach to Gene Selection and Microarray Data Classification , 2010, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[72]  Dipti Srinivasan,et al.  Parallel neural network-fuzzy expert system strategy for short-term load forecasting: system implementation and performance evaluation , 1999 .

[73]  Xixuan Han,et al.  On Weighted Support Vector Regression , 2014, Qual. Reliab. Eng. Int..

[74]  Almeida,et al.  [IEEE 2011 IEEE Congress on Evolutionary Computation (CEC) - New Orleans, LA, USA (2011.06.5-2011.06.8)] 2011 IEEE Congress of Evolutionary Computation (CEC) - Fault identification with binary adaptive fireflies in parallel and distributed systems , 2011 .

[75]  Holger R. Maier,et al.  Non-linear variable selection for artificial neural networks using partial mutual information , 2008, Environ. Model. Softw..

[76]  Li-Yeh Chuang,et al.  IG-GA: A Hybrid Filter/Wrapper Method for Feature Selection of Microarray Data , 2010 .

[77]  M. Sayadi,et al.  A discrete firefly meta-heuristic with local search for makespan minimization in permutation flow shop scheduling problems , 2010 .

[78]  Kwok-Wing Chau,et al.  Data-driven models for monthly streamflow time series prediction , 2010, Eng. Appl. Artif. Intell..

[79]  Syed Naqvi,et al.  A Hybrid Filter-Wrapper Approach for FeatureSelection , 2011 .

[80]  Tomonobu Senjyu,et al.  A neural network based several-hour-ahead electric load forecasting using similar days approach , 2006 .