Training neural networks using Salp Swarm Algorithm for pattern classification

Pattern classification is one of the popular applications of neural networks. However, training the neural networks is the most essential phase. Traditional training algorithms (e.g. Back-propagation algorithm) have some drawbacks such as falling into the local minima and slow convergence rate. Therefore, optimization algorithms are employed to overcome these issues. Salp Swarm Algorithm (SSA) is a recent and novel nature-inspired optimization algorithm that proved a good performance in solving many optimization problems. This paper proposes the use of SSA to optimize the weights coefficients for the neural networks in order to perform pattern classification. The merits of the proposed method are validated using a set of well-known classification problems and compared against rival optimization algorithms. The obtained results show that the proposed method performs better than or on par with other methods in terms of classification accuracy and sum squared errors.

[1]  Ahamad Tajudin Abdul Khader,et al.  Modified Tournament Harmony Search for Unconstrained Optimisation Problems , 2014, SCDM.

[2]  Majdi M. Mafarja,et al.  Hybrid Whale Optimization Algorithm with simulated annealing for feature selection , 2017, Neurocomputing.

[3]  Christian Blum,et al.  Training feed-forward neural networks with ant colony optimization: an application to pattern classification , 2005, Fifth International Conference on Hybrid Intelligent Systems (HIS'05).

[4]  El-Ghazali Talbi,et al.  Metaheuristics - From Design to Implementation , 2009 .

[5]  Ali Kattan,et al.  Enhanced MWO Training Algorithm to Improve Classification Accuracy of Artificial Neural Networks , 2014, SCDM.

[6]  Dervis Karaboga,et al.  Artificial Bee Colony (ABC) Optimization Algorithm for Training Feed-Forward Neural Networks , 2007, MDAI.

[7]  Rosni Abdullah,et al.  NEURAL NETWORK TRAINING USING HYBRID PARTICLE-MOVE ARTIFICIAL BEE COLONY ALGORITHM FOR PATTERN CLASSIFICATION , 2017 .

[8]  Majdi M. Mafarja,et al.  S-Shaped vs. V-Shaped Transfer Functions for Ant Lion Optimization Algorithm in Feature Selection Problem , 2017, ICFNDS.

[9]  Ali Kattan,et al.  Training of Feed-Forward Neural Networks for Pattern-Classification Applications Using Music Inspired Algorithm , 2011 .

[10]  Ali Kattan,et al.  Supervised Training of Spiking Neural Network by Adapting the E-MWO Algorithm for Pattern Classification , 2018, Neural Processing Letters.

[11]  Andrew Lewis,et al.  Let a biogeography-based optimizer train your Multi-Layer Perceptron , 2014, Inf. Sci..

[12]  Hossam Faris,et al.  Evolutionary Population Dynamics and Grasshopper Optimization approaches for feature selection problems , 2017, Knowl. Based Syst..

[13]  B. Kappen Minimizing the System Error in Feedforward Neural Networks with Evolution Strategy , 2022 .

[14]  Ahmed A. Abusnaina,et al.  Modified Global Flower Pollination Algorithm and its Application for Optimization Problems , 2018, Interdisciplinary Sciences: Computational Life Sciences.

[15]  Ali Kattan,et al.  TRAINING FEED-FORWARD ARTIFICIAL NEURAL NETWORKS FOR PATTERN-CLASSIFICATION USING THE HARMONY SEARCH ALGORITHM , 2013, DEIS 2013.

[16]  Andrew B. Whinston,et al.  Advances in artificial intelligence in economics, finance, and management , 1994 .

[17]  Mustafa Mat Deris,et al.  Comparing Performances of Cuckoo Search Based Neural Networks , 2014, SCDM.

[18]  Ali Kattan,et al.  Self-Adaptive Mussels Wandering Optimization Algorithm with Application for Artificial Neural Network Training , 2018, J. Intell. Syst..

[19]  Teresa Bernarda Ludermir,et al.  An evolutionary extreme learning machine based on group search optimization , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[20]  Hossam Faris,et al.  Salp Swarm Algorithm: A bio-inspired optimizer for engineering design problems , 2017, Adv. Eng. Softw..

[21]  L. Madin Aspects of jet propulsion in salps , 1990 .

[22]  Wolfram Schiffmann,et al.  Application of Genetic Algorithms to the Construction of Topologies for Multilayer Perceptrons , 1993 .

[23]  Kaiyu Wan,et al.  Characteristics and classification of big data in health care sector , 2016, 2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).

[24]  Rodney A. Stewart,et al.  ANN-based residential water end-use demand forecasting model , 2013, Expert Syst. Appl..

[25]  Hossam Faris,et al.  Feature Selection Using Salp Swarm Algorithm with Chaos , 2018, ISMSI '18.

[26]  Seyed Mohammad Mirjalili,et al.  Whale optimization approaches for wrapper feature selection , 2018, Appl. Soft Comput..