An incremental electric load forecasting model based on support vector regression

With the smart portable systems and the daily growth of databases on the web, there are ever-increasing requirements to learn the batch arriving and large sample data set. In this paper, an incremental learning model of support vector regression (SVR) is proposed to forecast the electric load under the batch arriving and large sample. For modeling with SVR, the optimal embedding of time series is constructed by phase space reconstruction (PSR). Then, an optimal training subset for the training of SVR is extracted based on the current data set, which enables us to cut the high time and space complexity by reducing the full training data set. When newly-increased data are added into the system, a representative data set reconstruction method is presented for quickly re-training the current SVR, and a nested particle swarm optimization (NPSO) framework is presented to select the parameters of the incremental SVR model. Experiments of incremental electric load forecasting demonstrate the computational superiority of the presented model over the comparison models.

[1]  Stefan Rüping,et al.  Incremental Learning with Support Vector Machines , 2001, ICDM.

[2]  X. C. Guo,et al.  A novel LS-SVMs hyper-parameter selection based on particle swarm optimization , 2008, Neurocomputing.

[3]  Chih-Jen Lin,et al.  Asymptotic Behaviors of Support Vector Machines with Gaussian Kernel , 2003, Neural Computation.

[4]  Wei-Chiang Hong,et al.  Electric load forecasting by the SVR model with differential empirical mode decomposition and auto regression , 2016, Neurocomputing.

[5]  Zhou Wei.  An Analysis of SVMs Generalization Performance , 2001 .

[6]  Yoshua Bengio,et al.  Gradient-Based Optimization of Hyperparameters , 2000, Neural Computation.

[7]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  Combining meta-learning and search techniques to select parameters for support vector machines , 2012, Neurocomputing.

[8]  B. LeBaron,et al.  Nonlinear Dynamics, Chaos, and Instability: Statistical Theory and Economic Evidence , 1991 .

[9]  Jianzhou Wang,et al.  Short-term load forecasting using a kernel-based support vector regression combination model , 2014 .

[10]  Farookh Khadeer Hussain,et al.  Support vector regression with chaos-based firefly algorithm for stock market price forecasting , 2013, Appl. Soft Comput..

[11]  Kevin M. Smith,et al.  Forecasting energy consumption of multi-family residential buildings using support vector regression: Investigating the impact of temporal and spatial monitoring granularity on performance accuracy , 2014 .

[12]  Chang-Dong Wang,et al.  SVStream: A Support Vector-Based Algorithm for Clustering Data Streams , 2013, IEEE Transactions on Knowledge and Data Engineering.

[13]  Eric Wai Ming Lee,et al.  An incremental adaptive neural network model for online noisy data regression and its application to compartment fire studies , 2011, Appl. Soft Comput..

[14]  Mehmet Karaköse,et al.  A multi-objective artificial immune algorithm for parameter optimization in support vector machine , 2011, Appl. Soft Comput..

[15]  Ushasta Aich,et al.  Modeling of EDM responses by support vector machine regression with parameters selected by particle swarm optimization , 2014 .

[16]  Sebastián Dormido-Canto,et al.  INCREMENTAL SUPPORT VECTOR MACHINES FOR FAST RELIABLE INCREMENTAL SUPPORT VECTOR MACHINES FOR FAST RELIABLE IMAGE RECOGNITION , 2013 .

[17]  Haidar Samet,et al.  A new hybrid Modified Firefly Algorithm and Support Vector Regression model for accurate Short Term Load Forecasting , 2014, Expert Syst. Appl..

[18]  Alexander J. Smola,et al.  Learning with Kernels: support vector machines, regularization, optimization, and beyond , 2001, Adaptive computation and machine learning series.

[19]  Dino Isa,et al.  A load predictive energy management system for supercapacitor-battery hybrid energy storage system in solar application using the Support Vector Machine , 2015 .

[20]  Denis Bolduc,et al.  A pseudo-panel data model of household electricity demand , 2011 .

[21]  D. Broomhead,et al.  Takens embedding theorems for forced and stochastic systems , 1997 .

[22]  Qingtian Zeng,et al.  An incremental learning algorithm for Lagrangian support vector machines , 2009, Pattern Recognit. Lett..

[23]  Hyojoo Son,et al.  Forecasting Short-term Electricity Demand in Residential Sector Based on Support Vector Regression and Fuzzy-rough Feature Selection with Particle Swarm Optimization , 2015 .

[24]  Chi-Jie Lu,et al.  Sales forecasting of computer products based on variable selection scheme and support vector regression , 2014, Neurocomputing.

[25]  Jing Shi,et al.  Fine tuning support vector machines for short-term wind speed forecasting , 2011 .

[26]  Raymond Chiong,et al.  Mid-term interval load forecasting using multi-output support vector regression with a memetic algorithm for feature selection , 2015 .

[27]  Sayan Mukherjee,et al.  Choosing Multiple Parameters for Support Vector Machines , 2002, Machine Learning.

[28]  Caiming Zhang,et al.  Fast instance selection for speeding up support vector machines , 2013, Knowl. Based Syst..

[29]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[30]  Wenwu He,et al.  Forecasting electricity load with optimized local learning models , 2008 .

[31]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[32]  Chia-Feng Juang,et al.  An incremental support vector machine-trained TS-type fuzzy system for online classification problems , 2011, Fuzzy Sets Syst..

[33]  Lars Kai Hansen,et al.  Adaptive Regularization in Neural Network Modeling , 2012, Neural Networks: Tricks of the Trade.

[34]  Dino Isa,et al.  Active incremental Support Vector Machine for oil and gas pipeline defects prediction system using long range ultrasonic transducers. , 2014, Ultrasonics.

[35]  Riccardo Poli,et al.  Analysis of the publications on the applications of particle swarm optimisation , 2008 .

[36]  Carlos Gershenson,et al.  Wind speed forecasting for wind farms: A method based on support vector regression , 2016 .

[37]  JinXing Che,et al.  Optimal training subset in a support vector regression electric load forecasting model , 2012, Appl. Soft Comput..

[38]  Andrew P. Bradley,et al.  Rule Extraction from Support Vector Machines: A Sequential Covering Approach , 2007, IEEE Transactions on Knowledge and Data Engineering.

[39]  Abbas Khosravi,et al.  Uncertainty handling using neural network-based prediction intervals for electrical load forecasting , 2014 .

[40]  JinXing Che.  Support vector regression based on optimal training subset and adaptive particle swarm optimization algorithm , 2013, Appl. Soft Comput..

[41]  Jianhua Zhang,et al.  A hybrid forecasting model with parameter optimization for short-term load forecasting of micro-grids , 2014 .

[42]  Wei-Chiang Hong,et al.  Electric load forecasting by seasonal recurrent SVR (support vector regression) with chaotic artific , 2011 .

[43]  Rahmat-Allah Hooshmand,et al.  Short term electric load forecasting by wavelet transform and grey model improved by PSO (particle swarm optimization) algorithm , 2014 .

[44]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[45]  Yuan-Hai Shao,et al.  A GA-based model selection for smooth twin parametric-margin support vector machine , 2013, Pattern Recognit..

[46]  Sheng Chen,et al.  Sparse support vector regression based on orthogonal forward selection for the generalised kernel model , 2006, Neurocomputing.

[47]  Robert Sabourin,et al.  A dynamic model selection strategy for support vector machine classifiers , 2012, Appl. Soft Comput..

[48]  Shai Ben-David,et al.  Understanding Machine Learning: From Theory to Algorithms , 2014 .

[49]  Su-Yun Huang,et al.  Model selection for support vector machines via uniform design , 2007, Comput. Stat. Data Anal..

[50]  F. Takens.  Detecting strange attractors in turbulence , 1981 .

[51]  Jianzhou Wang,et al.  A combined model based on data pre-analysis and weight coefficients optimization for electrical load forecasting , 2015 .

[52]  Mohammad Monfared,et al.  A new strategy for wind speed forecasting using artificial intelligent methods , 2009 .

[53]  Wenyu Zhang,et al.  Short-term wind speed forecasting based on a hybrid model , 2013, Appl. Soft Comput..

[54]  J. Salas,et al.  Nonlinear dynamics, delay times, and embedding windows , 1999 .