A New Workload Prediction Model Using Extreme Learning Machine and Enhanced Tug of War optimization

Abstract Time series data is widely accessible in many life areas like economy, weather, stock price, retail sales, distributed system workloads. While many studies have focused on improving existing prediction techniques on accuracy aspect, less efforts is paid towards simple but efficient forecasting models in order to keep the balance between computation cost and prediction accuracy. In this work, we propose a novel time series prediction model, which aims to both model simplicity and accuracy. The core of the model is built based on extreme learning machine. Due to the random determination process for input weights and hidden biases, extreme learning machine requires a large number of hidden neurons to achieve good results and this increases the model complexity. To overcome this drawback, we propose a new opposition-based tug of war optimization to select optimally input weights, and hidden biases then apply to extreme learning machine. Two real public traffic monitoring datasets from Internet service providers were employed to evaluate our design. The achieved outcomes demonstrate that our proposed solution works effectively with satisfied performance in comparison with existing models for distributed system workload prediction.

[1]  Nadeem Javaid,et al.  An Accurate and Fast Converging Short-Term Load Forecasting Model for Industrial Applications in a Smart Grid , 2017, IEEE Transactions on Industrial Informatics.

[2]  Ali Kaveh,et al.  Guided Modal Strain Energy-Based Approach for Structural Damage Identification Using Tug-of-War Optimization Algorithm , 2017, J. Comput. Civ. Eng..

[3]  Hongming Yang,et al.  Extreme learning machine based genetic algorithm and its application in power system economic dispatch , 2013, Neurocomputing.

[4]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[5]  Ali Kaveh,et al.  Tug of War Optimization , 2021, Advances in Metaheuristic Algorithms for Optimal Design of Structures.

[6]  Ali Kaveh,et al.  Optimum design of laterally-supported castellated beams using tug of war optimization algorithm , 2016 .

[7]  Hossam Faris,et al.  Optimizing connection weights in neural networks using the whale optimization algorithm , 2016, Soft Computing.

[8]  Shahryar Rahnamayan,et al.  Opposition based learning: A literature review , 2017, Swarm Evol. Comput..

[9]  Yang Shu,et al.  Evolutionary Extreme Learning Machine : Based on Particle Swarm Optimization , 2006 .

[10]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[11]  Jamil Salem Barbar,et al.  Computer network traffic prediction: a comparison between traditional and deep learning neural networks , 2015, Int. J. Big Data Intell..

[12]  Huaguang Zhang,et al.  A Comprehensive Review of Stability Analysis of Continuous-Time Recurrent Neural Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[13]  A. Kai Qin,et al.  Evolutionary extreme learning machine , 2005, Pattern Recognit..

[14]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Pedro Sousa,et al.  Multi‐scale Internet traffic forecasting using neural networks and time series methods , 2010, Expert Syst. J. Knowl. Eng..

[16]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[17]  Yunpeng Wang,et al.  Long short-term memory neural network for traffic speed prediction using remote microwave sensor data , 2015 .

[18]  Rytis Maskeliunas,et al.  Bio-inspired voice evaluation mechanism , 2019, Appl. Soft Comput..

[19]  Tu Nguyen,et al.  Efficient Time-Series Forecasting Using Neural Network and Opposition-Based Coral Reefs Optimization , 2019, Int. J. Comput. Intell. Syst..

[20]  Steven Walczak,et al.  Artificial neural networks , 2019, Machine Learning for Tomographic Imaging.

[21]  Marcin Wozniak,et al.  Polar Bear Optimization Algorithm: Meta-Heuristic with Fast Population Movement and Dynamic Birth and Death Mechanism , 2017, Symmetry.