Effective long short-term memory with fruit fly optimization algorithm for time series forecasting

A number of recent studies have adopted long short-term memory (LSTM) in extensive applications, such as handwriting recognition and time series prediction, with considerable success. However, the parameters of LSTM have greatly influenced its accuracy and performance. In this study, LSTM with fruit fly optimization algorithm (FOA), called FOA-LSTM, is designed to solve time series problems. As a novel intelligent algorithm, FOA is applied to decide on the optimal hyper-parameter of LSTM. Experiments under the NN3 time series, three comparative experiments and the monthly energy consumption of the USA are conducted to verify the effectiveness of the FOA-LSTM model. The results indicate that the symmetric mean absolute percentage error (SMAPE) is reduced by up to 11.44% in the last 11 monthly series in the NN3 dataset. Four comparative experiments and the real-life series verify further that the FOA-LSTM model obtains a better result compared with other forecasting models.

[1]  Wen-Tsao Pan,et al.  A new Fruit Fly Optimization Algorithm: Taking the financial distress model as an example , 2012, Knowl. Based Syst..

[2]  Soumaya Yacout,et al.  Bidirectional handshaking LSTM for remaining useful life prediction , 2019, Neurocomputing.

[3]  Xinggao Liu,et al.  Melt index prediction by least squares support vector machines with an adaptive mutation fruit fly optimization algorithm , 2015 .

[4]  Peter C. Y. Chen,et al.  LSTM network: a deep learning approach for short-term traffic forecast , 2017 .

[5]  Fernando Jiménez,et al.  Multi-objective evolutionary feature selection for online sales forecasting , 2017, Neurocomputing.

[6]  Jingjing Xie,et al.  Air pollutants concentrations forecasting using back propagation neural network based on wavelet decomposition with meteorological conditions , 2016 .

[7]  Vilém Novák,et al.  Forecasting seasonal time series based on fuzzy techniques , 2019, Fuzzy Sets Syst..

[8]  Huanling Hu,et al.  Forecasting energy consumption and wind power generation using deep echo state network , 2020 .

[9]  Rob J Hyndman,et al.  Automatic Time Series Forecasting: The forecast Package for R , 2008 .

[10]  Guoqiang Han,et al.  δ-agree AdaBoost stacked autoencoder for short-term traffic flow forecasting , 2017, Neurocomputing.

[11]  Lin Wang,et al.  An effective fruit fly optimization algorithm with hybrid information exchange and its applications , 2018, Int. J. Mach. Learn. Cybern..

[12]  Jun Wang,et al.  Forecasting energy market indices with recurrent neural networks: Case study of crude oil price fluctuations , 2016 .

[13]  Ha Young Kim,et al.  Forecasting the volatility of stock price index: A hybrid model integrating LSTM with multiple GARCH-type models , 2018, Expert Syst. Appl..

[14]  VellascoMarley M.B.R.,et al.  Neural Expert Weighting , 2015 .

[15]  Vilém Novák,et al.  Detection of Structural Breaks in Time Series Using Fuzzy Techniques , 2018, Int. J. Fuzzy Log. Intell. Syst..

[16]  Yunpeng Wang,et al.  Long short-term memory neural network for traffic speed prediction using remote microwave sensor data , 2015 .

[17]  William E. Roper,et al.  Energy demand estimation of South Korea using artificial neural network , 2009 .

[18]  Tao Chen,et al.  Back propagation neural network with adaptive differential evolution algorithm for time series forecasting , 2015, Expert Syst. Appl..

[19]  Lin Wang,et al.  Optimizing an integrated inventory-routing system for multi-item joint replenishment and coordinated outbound delivery using differential evolution algorithm , 2020, Appl. Soft Comput..

[20]  Bart De Schutter,et al.  Forecasting spot electricity prices Deep learning approaches and empirical comparison of traditional algorithms , 2018 .

[21]  Qi Li,et al.  Artificial neural networks forecasting of PM2.5 pollution using air mass trajectory based geographic model and wavelet transformation , 2015 .

[22]  Qian He,et al.  On a novel multi-swarm fruit fly optimization algorithm and its application , 2014, Appl. Math. Comput..

[23]  B. Eswara Reddy,et al.  A moving-average filter based hybrid ARIMA-ANN model for forecasting time series data , 2014, Appl. Soft Comput..

[24]  Yu-Rong Zeng,et al.  Effective sparse adaboost method with ESN and FOA for industrial electricity consumption forecasting in China , 2018, Energy.

[25]  Bertrand Neveu,et al.  A beginner's guide to tuning methods , 2014, Appl. Soft Comput..

[26]  Lu Peng,et al.  Effective energy consumption forecasting using enhanced bagged echo state network , 2020 .

[27]  Zhigang Zeng,et al.  A short-term power load forecasting model based on the generalized regression neural network with decreasing step fruit fly optimization algorithm , 2017, Neurocomputing.

[28]  Wenbo Chen,et al.  Electricity price prediction based on hybrid model of adam optimized LSTM neural network and wavelet transform , 2019, Energy.

[29]  Sen Guo,et al.  A hybrid annual power load forecasting model based on generalized regression neural network with fruit fly optimization algorithm , 2013, Knowl. Based Syst..

[30]  Sung-Bae Cho,et al.  Web traffic anomaly detection using C-LSTM neural networks , 2018, Expert Syst. Appl..

[31]  Ponnuthurai Nagaratnam Suganthan,et al.  Empirical Mode Decomposition based ensemble deep learning for load demand time series forecasting , 2017, Appl. Soft Comput..

[32]  Gang Qu,et al.  Modified genetic algorithm-based feature selection combined with pre-trained deep neural network for demand forecasting in outpatient department , 2017, Expert Syst. Appl..

[33]  Lu Liu,et al.  Predicting housing price in China based on long short-term memory incorporating modified genetic algorithm , 2019, Soft Comput..

[34]  Rui Liu,et al.  An effective and efficient fruit fly optimization algorithm with level probability policy and its applications , 2016, Knowl. Based Syst..

[35]  Wang Sheng,et al.  Fruit fly optimization algorithm based fractional order fuzzy-PID controller for electronic throttle , 2013 .

[36]  Bernhard Sick,et al.  Deep Learning for solar power forecasting — An approach using AutoEncoder and LSTM Neural Networks , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[37]  Jana-Rebecca Rehse,et al.  Predicting process behaviour using deep learning , 2016, Decis. Support Syst..

[38]  Marley M. B. R. Vellasco,et al.  Neural Expert Weighting: A NEW framework for dynamic forecast combination , 2015, Expert Syst. Appl..

[39]  Guoqiang Peter Zhang,et al.  Time series forecasting using a hybrid ARIMA and neural network model , 2003, Neurocomputing.

[40]  Rui Liu,et al.  Effective long short-term memory with differential evolution algorithm for electricity price prediction , 2018, Energy.

[41]  Xiaobo Zhang,et al.  Short-term electric load forecasting based on singular spectrum analysis and support vector machine optimized by Cuckoo search algorithm , 2017 .

[42]  Lin Wang,et al.  An Effective Hybrid Differential Evolution Algorithm Incorporating Simulated Annealing for Joint Replenishment and Delivery Problem with Trade Credit , 2016, Int. J. Comput. Intell. Syst..

[43]  Rob Law,et al.  Forecasting tourism demand with composite search index , 2017 .

[44]  Stefan Lessmann,et al.  A comparative study of LSTM neural networks in forecasting day-ahead global horizontal irradiance with satellite data , 2018 .

[45]  Himansu Sekhar Behera,et al.  A hybrid ETS-ANN model for time series forecasting , 2017, Eng. Appl. Artif. Intell..

[46]  Yi Zeng,et al.  Multifactor-influenced energy consumption forecasting using enhanced back-propagation neural network , 2017 .

[47]  Duanfeng Han,et al.  Ship motion prediction using dynamic seasonal RvSVR with phase space reconstruction and the chaos adaptive efficient FOA , 2016, Neurocomputing.

[48]  Lin Wang,et al.  Optimizing echo state network with backtracking search optimization algorithm for time series forecasting , 2019, Eng. Appl. Artif. Intell..

[49]  Thomas Fischer,et al.  Deep learning with long short-term memory networks for financial market predictions , 2017, Eur. J. Oper. Res..

[50]  Sung-Bae Cho,et al.  Predicting residential energy consumption using CNN-LSTM neural networks , 2019, Energy.

[51]  Guohua Cao,et al.  Support vector regression with fruit fly optimization algorithm for seasonal electricity consumption forecasting , 2016 .

[52]  Rodney A. Stewart,et al.  ANN-based residential water end-use demand forecasting model , 2013, Expert Syst. Appl..