Deep-Learning Prediction Model with Serial Two-Level Decomposition Based on Bayesian Optimization

The power load prediction is significant in a sustainable power system, which is the key to the energy system’s economic operation. An accurate prediction of the power load can provide a reliable decision for power system planning. However, it is challenging to predict the power load with a single model, especially for multistep prediction, because the time series load data have multiple periods. This paper presents a deep hybrid model with a serial two‐level decomposition structure. First, the power load data are decomposed into components; then, the gated recurrent unit (GRU) network, with the Bayesian optimization parameters, is used as the subpredictor for each component. Last, the predictions of different components are fused to achieve the final predictions. The power load data of American Electric Power (AEP) were used to verify the proposed predictor. The results showed that the proposed prediction method could effectively improve the accuracy of power load prediction.

[1]  Tingli Su,et al.  Deep Hybrid Model Based on EMD with Classification by Frequency Characteristics for Long-Term Air Quality Prediction , 2020, Mathematics.

[2]  Yang Yang,et al.  Long-Term Span Traffic Prediction Model Based on STL Decomposition and LSTM , 2019, 2019 20th Asia-Pacific Network Operations and Management Symposium (APNOMS).

[3]  Gao Qi,et al.  Expandable deep learning for real-time economic generation dispatch and control of three-state energies based future smart grids , 2020 .

[4]  Xiao Zhang,et al.  Hierarchical parameter and state estimation for bilinear systems , 2020, Int. J. Syst. Sci..

[5]  Xiao-yi Wang,et al.  Dynamic Correlation Analysis Method of Air Pollutants in Spatio-Temporal Analysis , 2020, International journal of environmental research and public health.

[6]  Ling Xu,et al.  Highly computationally efficient state filter based on the delta operator , 2019, International Journal of Adaptive Control and Signal Processing.

[7]  Ling Xu.  The parameter estimation algorithms based on the dynamical response measurement data , 2017 .

[8]  Cunbin Li,et al.  A least squares support vector machine model optimized by moth-flame optimization algorithm for annual power load forecasting , 2016, Applied Intelligence.

[9]  Xiao Zhang,et al.  Adaptive parameter estimation for a general dynamical system with unknown states , 2020, International Journal of Robust and Nonlinear Control.

[10]  Jürgen Schmidhuber,et al.  Learning Precise Timing with LSTM Recurrent Networks , 2003, J. Mach. Learn. Res..

[11]  F. Ding,et al.  Partially‐coupled least squares based iterative parameter estimation for multi‐variable output‐error‐like autoregressive moving average systems , 2019, IET Control Theory & Applications.

[12]  Feng Ding,et al.  Parameter estimation algorithms for dynamical response signals based on the multi-innovation theory and the hierarchical principle , 2017, IET Signal Process..

[13]  Qinyao Liu,et al.  Recursive identification of bilinear time-delay systems through the redundant rule , 2020, J. Frankl. Inst..

[14]  Feng Ding,et al.  Parameter estimation with scarce measurements , 2011, Autom..

[15]  Feng Ding,et al.  Parameter estimation for control systems based on impulse responses , 2017 .

[16]  Baihai Zhang,et al.  A Neuron-Based Kalman Filter with Nonlinear Autoregressive Model , 2020, Sensors.

[17]  Zhu Han,et al.  Transmission network restoration considering AC power flow constraints , 2015, 2015 IEEE International Conference on Smart Grid Communications (SmartGridComm).

[18]  Feng Ding,et al.  Novel data filtering based parameter identification for multiple-input multiple-output systems using the auxiliary model , 2016, Autom..

[19]  Gao Xiuyun,et al.  Short-term Load Forecasting Model of GRU Network Based on Deep Learning Framework , 2018, 2018 2nd IEEE Conference on Energy Internet and Energy System Integration (EI2).

[20]  Feng Ding,et al.  Recursive Least Squares and Multi-innovation Stochastic Gradient Parameter Estimation Methods for Signal Modeling , 2017, Circuits Syst. Signal Process..

[21]  Feng Ding,et al.  A multi-innovation state and parameter estimation algorithm for a state space system with d-step state-delay , 2017, Signal Process..

[22]  Tingli Su,et al.  Compound Autoregressive Network for Prediction of Multivariate Time Series , 2019, Complex..

[23]  Feng Ding,et al.  Reconstruction of continuous-time systems from their non-uniformly sampled discrete-time systems , 2009, Autom..

[24]  Feng Ding,et al.  Hierarchical Least Squares Identification for Linear SISO Systems With Dual-Rate Sampled-Data , 2011, IEEE Transactions on Automatic Control.

[25]  Guo Wei.  Short term load forecasting based on RBF neural network , 2004 .

[26]  Ling Xu,et al.  Recursive parameter estimation methods and convergence analysis for a special class of nonlinear systems , 2019, International Journal of Robust and Nonlinear Control.

[27]  Jiahao Deng,et al.  Short-Term Power Load Forecasting with Deep Belief Network and Copula Models , 2017, 2017 9th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC).

[28]  Wei Li,et al.  The Mid-Long Term Power Load Forecasting Based on Gray and SVM Algorithm , 2010 .

[29]  Donghui Li,et al.  Short-term power load forecasting based on improved T-S fuzzy-neural network , 2016, 2016 12th World Congress on Intelligent Control and Automation (WCICA).

[30]  Feng Ding,et al.  Partially Coupled Stochastic Gradient Identification Methods for Non-Uniformly Sampled Systems , 2010, IEEE Transactions on Automatic Control.

[31]  Ahmed Alsaedi,et al.  Gradient estimation algorithms for the parameter identification of bilinear systems using the auxiliary model , 2020, J. Comput. Appl. Math..

[32]  Yi Li,et al.  Gaussian Process Regression With Automatic Relevance Determination Kernel for Calendar Aging Prediction of Lithium-Ion Batteries , 2020, IEEE Transactions on Industrial Informatics.

[33]  Xiangkui Wan,et al.  Two-stage Gradient-based Iterative Estimation Methods for Controlled Autoregressive Systems Using the Measurement Data , 2020, International Journal of Control, Automation and Systems.

[34]  Feng Ding,et al.  Hierarchical Newton and least squares iterative estimation algorithm for dynamic systems by transfer functions based on the impulse responses , 2018, Int. J. Syst. Sci..

[35]  Jaakko Astola,et al.  Application of Kolmogorov complexity and universal codes to identity testing and nonparametric testing of serial independence for time series , 2005, Theor. Comput. Sci..

[36]  Li Xin Dai,et al.  Application Optimization of Grey Model in Power Load Forecasting , 2011 .

[37]  F. Ding,et al.  Recursive parameter estimation and its convergence for bilinear systems , 2020, IET Control Theory & Applications.

[38]  Sen Guo,et al.  A hybrid annual power load forecasting model based on generalized regression neural network with fruit fly optimization algorithm , 2013, Knowl. Based Syst..

[39]  Yunlong Shang,et al.  A Data-Driven Approach With Uncertainty Quantification for Predicting Future Capacities and Remaining Useful Life of Lithium-ion Battery , 2021, IEEE Transactions on Industrial Electronics.

[40]  Jiabin Yu,et al.  An approach of recursive timing deep belief network for algal bloom forecasting , 2018, Neural Computing and Applications.

[41]  Li Mo,et al.  Day-ahead short-term load probability density forecasting method with a decomposition-based quantile regression forest , 2020 .

[42]  Ting Wang,et al.  Short‐term power load forecasting based on multi‐layer bidirectional recurrent neural network , 2019, IET Generation, Transmission & Distribution.

[43]  Zhihong Gu,et al.  Long and Medium Term Power Load Forecasting with Multi-Level Recursive Regression Analysis , 2008, 2008 Second International Symposium on Intelligent Information Technology Application.

[44]  Xiao Zhang,et al.  The innovation algorithms for multivariable state‐space models , 2019, International Journal of Adaptive Control and Signal Processing.

[45]  Ting-Li Su,et al.  Hybrid Deep Learning Predictor for Smart Agriculture Sensing Based on Empirical Mode Decomposition and Gated Recurrent Unit Group Model , 2020, Sensors.

[46]  Jiping Xu,et al.  An approach of improved Multivariate Timing-Random Deep Belief Net modelling for algal bloom prediction , 2019, Biosystems Engineering.

[47]  Ling Xu,et al.  The damping iterative parameter identification method for dynamical systems based on the sine signal measurement , 2016, Signal Process..

[48]  Yi Yang,et al.  Fuzzy Boost Classifier of Decision Experts for Multicriteria Group Decision-Making , 2020, Complex..

[49]  Y. Liu,et al.  Gradient-based and least-squares-based iterative estimation algorithms for multi-input multi-output systems , 2012, J. Syst. Control. Eng..

[50]  Jae-Hyun Lim,et al.  A Design of Short-Term Load Forecasting Structure Based on ARIMA Using Load Pattern Classification , 2011 .

[51]  Stefanos D. Kollias,et al.  A Deep Learning Approach for Load Demand Forecasting of Power Systems , 2018, 2018 IEEE Symposium Series on Computational Intelligence (SSCI).

[52]  Yong Liu,et al.  Short-term power load forecasting based on SVM , 2012, World Automation Congress 2012.

[53]  J. Adamowski,et al.  Coupling the maximum overlap discrete wavelet transform and long short-term memory networks for irrigation flow forecasting , 2019, Agricultural Water Management.

[54]  Jianjun Xu,et al.  Deep Learning with Gated Recurrent Unit Networks for Financial Sequence Predictions , 2018 .

[55]  Yi Li,et al.  Modified Gaussian Process Regression Models for Cyclic Capacity Prediction of Lithium-Ion Batteries , 2019, IEEE Transactions on Transportation Electrification.

[56]  Feng Ding,et al.  An efficient hierarchical identification method for general dual-rate sampled-data systems , 2014, Autom..

[57]  Tingli Su,et al.  Deep Learning Predictor for Sustainable Precision Agriculture Based on Internet of Things System , 2020, Sustainability.

[58]  Feng Ding,et al.  State estimation for bilinear systems through minimizing the covariance matrix of the state estimation errors , 2019, International Journal of Adaptive Control and Signal Processing.

[59]  Wei Li,et al.  Short-Term Power Load Forecasting Based on a Combination of VMD and ELM , 2018, Polish Journal of Environmental Studies.

[60]  Ling Xu,et al.  Parameter estimation and controller design for dynamic systems from the step responses based on the Newton iteration , 2015 .

[61]  Tingli Su,et al.  Integrated Predictor Based on Decomposition Mechanism for PM2.5 Long-Term Prediction , 2019, Applied Sciences.

[62]  Baihai Zhang,et al.  Adaptive filtering for MEMS gyroscope with dynamic noise model. , 2020, ISA transactions.

[63]  Rui Wang,et al.  Analyses of integrated aircraft cabin contaminant monitoring network based on Kalman consensus filter. , 2017, ISA transactions.

[64]  Scott Sanner,et al.  Comparison of machine learning models for occupancy prediction in residential buildings using connected thermostat data , 2019, Building and Environment.

[65]  Irma J. Terpenning,et al.  STL : A Seasonal-Trend Decomposition Procedure Based on Loess , 1990 .

[66]  Yuexing Peng,et al.  Ensemble Deep Learning Method for Short-Term Load Forecasting , 2018, 2018 14th International Conference on Mobile Ad-Hoc and Sensor Networks (MSN).

[67]  Wei Cheng,et al.  The Application of Chaotic Particle Swarm Optimization Algorithm in Power System Load Forecasting , 2012 .

[68]  Tao Zhang,et al.  Short-Term Load Forecasting Using a Novel Deep Learning Framework , 2018, Energies.

[69]  Jinkyu Hong,et al.  Weather impacts on electric power load: partial phase synchronization analysis , 2015 .

[70]  The power load’s signal analysis and short-term prediction based on wavelet decomposition , 2017, Cluster Computing.

[71]  T. Hayat,et al.  Hierarchical Parameter Estimation for the Frequency Response Based on the Dynamical Window Data , 2018, International Journal of Control, Automation and Systems.

[72]  Feng Ding,et al.  Iterative Parameter Estimation for Signal Models Based on Measured Data , 2018, Circuits Syst. Signal Process..

[73]  Shuai Wang,et al.  Midterm Power Load Forecasting Model Based on Kernel Principal Component Analysis and Back Propagation Neural Network with Particle Swarm Optimization , 2019, Big Data.

[74]  Jia-Shu Zhang,et al.  Predicting Chaotic Time Series Using Recurrent Neural Network , 2000 .