An Improved Equilibrium Optimizer Algorithm and Its Application in LSTM Neural Network

An improved equilibrium optimizer (EO) algorithm is proposed in this paper to address premature and slow convergence. Firstly, a highly stochastic chaotic mechanism is adopted to initialize the population for range expansion. Secondly, the capability to conduct global search to jump out of local optima is enhanced by assigning adaptive weights and setting adaptive convergence factors. In addition 25 classical benchmark functions are used to validate the algorithm. As revealed by the analysis of the accuracy, speed, and stability of convergence, the IEO algorithm proposed in this paper significantly outperforms other meta-heuristic algorithms. In practice, the distribution is asymmetric because most logging data are unlabeled. Traditional classification models have difficulty in accurately predicting the location of oil layer. In this paper, the oil layers related to oil exploration are predicted using long short-term memory (LSTM) networks. Due to the large amount of data used, however, it is difficult to adjust the parameters. For this reason, an improved equilibrium optimizer algorithm (IEO) is applied to optimize the parameters of LSTM for improved performance, while the effective IEO-LSTM is applied for oil layer prediction. As indicated by the results, the proposed model outperforms the current popular optimization algorithms including particle swarm algorithm PSO and genetic algorithm GA in terms of accuracy, absolute error, root mean square error and mean absolute error.

[1]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[2]  Povilas Treigys,et al.  Unsupervised marine vessel trajectory prediction using LSTM network and wild bootstrapping techniques , 2021, Nonlinear Analysis: Modelling and Control.

[3]  Vili Podgorelec,et al.  Swarm Intelligence Algorithms for Feature Selection: A Review , 2018, Applied Sciences.

[4]  Chee Kiong Sia,et al.  A carnivorous plant algorithm for solving global optimization problems , 2021, Appl. Soft Comput..

[5]  Bart Baesens,et al.  Editorial survey: swarm intelligence for data mining , 2010, Machine Learning.

[6]  Kewen Xia,et al.  An Improved Transient Search Optimization with Neighborhood Dimensional Learning for Global Optimization Problems , 2021, Symmetry.

[7]  Wenjia Niu,et al.  Semisupervised SVM Based on Cuckoo Search Algorithm and Its Application , 2018 .

[8]  Shurui Fan,et al.  Dynamic Multi-Swarm Differential Learning Quantum Bird Swarm Algorithm and Its Application in Random Forest Classification Model , 2020, Comput. Intell. Neurosci..

[9]  Leandro dos Santos Coelho,et al.  Coyote Optimization Algorithm: A New Metaheuristic for Global Optimization Problems , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[10]  Amir H. Gandomi,et al.  Marine Predators Algorithm: A nature-inspired metaheuristic , 2020, Expert Syst. Appl..

[11]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms, Homomorphous Mappings, and Constrained Parameter Optimization , 1999, Evolutionary Computation.

[12]  Erik Cuevas,et al.  An Improved Grey Wolf Optimizer for a Supplier Selection and Order Quantity Allocation Problem , 2020, Mathematics.

[13]  Dedy Dwi Prastyo,et al.  Comparison between VAR, GSTAR, FFNN-VAR and FFNN-GSTAR Models for Forecasting Oil Production , 2018, MATEMATIKA.

[14]  Rung Ching Chen,et al.  Prediction of Status Particulate Matter 2.5 Using State Markov Chain Stochastic Process and HYBRID VAR-NN-PSO , 2019, IEEE Access.

[15]  Kewen Xia,et al.  Attribute Reduction Based on Consistent Covering Rough Set and Its Application , 2017, Complex..

[16]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[17]  Vijay Kumar,et al.  Seagull optimization algorithm: Theory and its applications for large-scale industrial engineering problems , 2019, Knowl. Based Syst..

[18]  Zhu Jianming,et al.  An Automatic Diagnosis of Arrhythmias Using a Combination of CNN and LSTM Technology , 2020, Electronics.

[19]  Jiandong Zhao,et al.  Lane Work-Schedule of Toll Station Based on Queuing Theory and PSO-LSTM Model , 2020, IEEE Access.

[20]  Yong-ke Pan,et al.  Semisupervised SVM by Hybrid Whale Optimization Algorithm and Its Application in Oil Layer Recognition , 2021, Mathematical Problems in Engineering.

[21]  Chaoshun Li,et al.  Hybrid Bidirectional LSTM Model for Short-Term Wind Speed Interval Prediction , 2020, IEEE Access.

[22]  Houshang Darabi,et al.  LSTM Fully Convolutional Networks for Time Series Classification , 2017, IEEE Access.

[23]  Seyedali Mirjalili,et al.  Equilibrium optimizer: A novel optimization algorithm , 2020, Knowl. Based Syst..

[24]  Bens Pardamean,et al.  Hybrid Vector Autoregression Feedforward Neural Network with Genetic Algorithm Model for Forecasting Space-Time Pollution Data , 2021 .

[25]  Rob J Hyndman,et al.  25 years of time series forecasting , 2006 .

[26]  Hany M. Hasanien,et al.  Transient search optimization: a new meta-heuristic optimization algorithm , 2020, Applied Intelligence.

[27]  Thomas Fischer,et al.  Deep learning with long short-term memory networks for financial market predictions , 2017, Eur. J. Oper. Res..

[28]  Janez Brest,et al.  A Brief Review of Nature-Inspired Algorithms for Optimization , 2013, ArXiv.

[29]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[30]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[31]  Rezzy Eko Caraka,et al.  Employing long short-term memory and Facebook prophet model in air temperature forecasting , 2021, Commun. Stat. Simul. Comput..

[32]  Kewen Xia,et al.  A Multi-Strategy Marine Predator Algorithm and Its Application in Joint Regularization Semi-Supervised ELM , 2021, Mathematics.

[33]  Seyedali Mirjalili,et al.  Henry gas solubility optimization: A novel physics-based algorithm , 2019, Future Gener. Comput. Syst..