Deep interval prediction model with gradient descend optimization method for short-term wind power prediction

The application of wind power interval prediction for power systems attempts to give more comprehensive support to dispatchers and operators of the grid. Lower upper bound estimation (LUBE) method is widely applied in interval prediction. However, the existing LUBE approaches are trained by meta-heuristic optimization, which is either time-consuming or show poor effect when the LUBE model is complex. In this paper, a deep interval prediction method is designed in the framework of LUBE and an efficient gradient descend (GD) training approach is proposed to train the LUBE model. In this method, the long short-term memory is selected as a representative to show the modelling approach. The architecture of the proposed model consists of three parts, namely the long short-term memory module, the fully connected layers and the rank ordered module. Two loss functions are specially designed for implementing the GD training method based on the root mean square back propagation algorithm. To verify the performance of the proposed model, conventional LUBE models, as well as popular statistic interval prediction models are compared in numerical experiments. The results show that the proposed approach performs best in terms of effectiveness and efficiency with average 45% promotion in quality of prediction interval and 66% reduction of time consumptions compared to traditional LUBE models.

[1]  Mahantapas Kundu,et al.  Handwritten isolated Bangla compound character recognition: A new benchmark using a novel deep learning approach , 2017, Pattern Recognit. Lett..

[2]  Jing Deng,et al.  Hybrid Probabilistic Wind Power Forecasting Using Temporally Local Gaussian Process , 2016, IEEE Transactions on Sustainable Energy.

[3]  Yoshua Bengio,et al.  Equilibrated adaptive learning rates for non-convex optimization , 2015, NIPS.

[4]  Kai Wang,et al.  Multi-step short-term wind speed forecasting approach based on multi-scale dominant ingredient chaotic analysis, improved hybrid GWO-SCA optimization and ELM , 2019, Energy Conversion and Management.

[5]  Yitao Liu,et al.  Deep learning based ensemble approach for probabilistic wind power forecasting , 2017 .

[6]  Vladimiro Miranda,et al.  Time-adaptive quantile-copula for wind power probabilistic forecasting , 2012 .

[7]  Yang Xiyun,et al.  Wind power probability interval prediction based on Bootstrap quantile regression method , 2017, 2017 Chinese Automation Congress (CAC).

[8]  Bijaya K. Panigrahi,et al.  Prediction Interval Estimation of Electricity Prices Using PSO-Tuned Support Vector Machines , 2015, IEEE Transactions on Industrial Informatics.

[9]  Chu Zhang,et al.  A hybrid model based on synchronous optimisation for multi-step short-term wind speed forecasting , 2018 .

[10]  Pengfei Chen,et al.  An Inter Type-2 FCR Algorithm Based T–S Fuzzy Model for Short-Term Wind Power Interval Prediction , 2019, IEEE Transactions on Industrial Informatics.

[11]  Jianzhou Wang,et al.  A novel hybrid system based on a new proposed algorithm-Multi-Objective Whale Optimization Algorithm for wind speed forecasting , 2017 .

[12]  Qinghua Hu,et al.  Transfer learning for short-term wind speed prediction with deep neural networks , 2016 .

[13]  Yugang Niu,et al.  Hourly day-ahead solar irradiance prediction using weather forecasts by LSTM , 2018 .

[14]  Wenhao Huang,et al.  Deep Architecture for Traffic Flow Prediction: Deep Belief Networks With Multitask Learning , 2014, IEEE Transactions on Intelligent Transportation Systems.

[15]  Zhang Chao,et al.  Short-term prediction of wind power based on deep Long Short-Term Memory , 2016, 2016 IEEE PES Asia-Pacific Power and Energy Engineering Conference (APPEEC).

[16]  Bijaya Ketan Panigrahi,et al.  A multiobjective framework for wind speed prediction interval forecasts , 2016 .

[17]  P. McSharry,et al.  Short-Term Load Forecasting Methods: An Evaluation Based on European Data , 2007, IEEE Transactions on Power Systems.

[18]  Yanfei Li,et al.  Smart multi-step deep learning model for wind speed forecasting based on variational mode decomposition, singular spectrum analysis, LSTM network and ELM , 2018 .

[19]  Abbas Khosravi,et al.  Short-Term Load and Wind Power Forecasting Using Neural Network-Based Prediction Intervals , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Rafael Bernardo Carmona-Benítez,et al.  ARIMA + GARCH + Bootstrap forecasting method applied to the airline industry , 2018, Journal of Air Transport Management.

[21]  Yanhe Xu,et al.  A Hybrid Approach for Multi-Step Wind Speed Forecasting Based on Multi-Scale Dominant Ingredient Chaotic Analysis, KELM and Synchronous Optimization Strategy , 2019, Sustainability.

[22]  Shengxian Zhuang,et al.  An ensemble prediction intervals approach for short-term PV power forecasting , 2017 .

[23]  Ersan YAZAN,et al.  Comparison of the stochastic gradient descent based optimization techniques , 2017, 2017 International Artificial Intelligence and Data Processing Symposium (IDAP).

[24]  Li Lin,et al.  Remaining useful life estimation of engineered systems using vanilla LSTM neural networks , 2018, Neurocomputing.

[25]  Saeid Nahavandi,et al.  Prediction Intervals to Account for Uncertainties in Travel Time Prediction , 2011, IEEE Transactions on Intelligent Transportation Systems.

[26]  Nan Zhang,et al.  Multi-objective optimization of the closure law of guide vanes for pumped storage units , 2019, Renewable Energy.

[27]  Yan-Lin He,et al.  A novel prediction intervals method integrating an error & self-feedback extreme learning machine with particle swarm optimization for energy consumption robust prediction , 2018, Energy.

[28]  Ann Spence,et al.  National Renewable Energy Laboratory: A profile , 2010 .

[29]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[30]  Deshu Chen,et al.  Multi-objective complementary scheduling of hydro-thermal-RE power system via a multi-objective hybrid grey wolf optimizer , 2019, Energy.

[31]  N.D. Hatziargyriou,et al.  An Advanced Statistical Method for Wind Power Forecasting , 2007, IEEE Transactions on Power Systems.

[32]  Zhao Yang Dong,et al.  Advanced method for short-term wind power prediction with multiple observation points using extreme learning machines , 2009 .

[33]  Yitao Liu,et al.  Deterministic and probabilistic forecasting of photovoltaic power based on deep convolutional neural network , 2017 .

[34]  Angelo Cangelosi,et al.  Head pose estimation in the wild using Convolutional Neural Networks and adaptive gradient methods , 2017, Pattern Recognit..

[35]  Yanhe Xu,et al.  An Integrated Start-Up Method for Pumped Storage Units Based on a Novel Artificial Sheep Algorithm , 2018 .

[36]  Menglin Zhang,et al.  A Novel Multi-Objective Optimal Approach for Wind Power Interval Prediction , 2017 .

[37]  A. Weigend,et al.  Estimating the mean and variance of the target probability distribution , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[38]  Kit Po Wong,et al.  Electricity Price Forecasting With Extreme Learning Machine and Bootstrapping , 2012, IEEE Transactions on Power Systems.

[39]  Nan Zhang,et al.  A multi-objective artificial sheep algorithm , 2019, Neural Computing and Applications.

[40]  Amir F. Atiya,et al.  Lower Upper Bound Estimation Method for Construction of Neural Network-Based Prediction Intervals , 2011, IEEE Transactions on Neural Networks.

[41]  Yan Wang,et al.  An integrated multi-sensor fusion-based deep feature learning approach for rotating machinery diagnosis , 2018 .

[42]  Lu Chen,et al.  Efficient estimation of flood forecast prediction intervals via single‐ and multi‐objective versions of the LUBE method , 2016 .

[43]  Xiaoming Xue,et al.  Short-Term Wind Speed Interval Prediction Based on Ensemble GRU Model , 2020, IEEE Transactions on Sustainable Energy.

[44]  Nan Zhang,et al.  Design of a fractional-order PID controller for a pumped storage unit using a gravitational search algorithm based on the Cauchy and Gaussian mutation , 2017, Inf. Sci..