Training a Feed-Forward Neural Network Using Particle Swarm Optimizer with Autonomous Groups for Sonar Target Classification

Feed-Forward Neural Networks (FFNNs), as one of the wide-spreading Artificial NNs, has been used to solve many practical problems such as classification of the sonar dataset. Improper selection of the training method, which is an important part of the design process, results in slow convergence rate, entrapment in local minima, and sensitivity to initial conditions. To overcome these issues, the recently proposed method known as “Particle Swarm Optimizer with Autonomous Groups (AGPSO)” has been used in this paper. It is known that the FNNs are very sensitive to the problem’s dimension, so clearly applying it to a dataset with large dimension results in poor performance. However, the combination of FNN and AGPSO solves this problem because of the ability of AGPSO in the optimization of high dimension problems. To evaluate the performance of the proposed classifier, it is applied to other datasets and the results are compared to the standard PSO, modified PSO (IPSO), Gravitational Search Algorithm (GSA) and Gray Wolf Optimizer (GWO). Simulation results show that the AGPSO classifier provides better performance in terms of convergence speed, entrapment in local minima and classification accuracy compared to the other algorithms.

[1]  Seyed Mohammad Mirjalili,et al.  Optical buffer performance enhancement using Particle Swarm Optimization in Ring-Shape-Hole Photonic Crystal Waveguide , 2013 .

[2]  Dervis Karaboga,et al.  Artificial Bee Colony (ABC) Optimization Algorithm for Training Feed-Forward Neural Networks , 2007, MDAI.

[3]  Xin Yao,et al.  Evolutionary Artificial Neural Networks , 1993, Int. J. Neural Syst..

[4]  Christian Blum,et al.  An ant colony optimization algorithm for continuous optimization: application to feed-forward neural network training , 2007, Neural Computing and Applications.

[5]  Urbashi Mitra,et al.  Robust Object Classification in Underwater Sidescan Sonar Images by Using Reliability-Aware Fusion of Shadow Features , 2015, IEEE Journal of Oceanic Engineering.

[6]  Amir Hossein Gandomi,et al.  Chaotic Krill Herd algorithm , 2014, Inf. Sci..

[7]  Zhengming Li Test Sample Oriented Dictionary Learning for Face Recognition , 2016, J. Circuits Syst. Comput..

[8]  J. Fialkowski,et al.  Methods for Identifying and Controlling Sonar Clutter , 2010, IEEE Journal of Oceanic Engineering.

[9]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[10]  K. LePage Higher Moment Estimation for Shallow-Water Reverberation Prediction , 2010, IEEE Journal of Oceanic Engineering.

[11]  Hossam Faris,et al.  Training feedforward neural networks using multi-verse optimizer for binary classification problems , 2016, Applied Intelligence.

[12]  Andrew Lewis,et al.  Biogeography-based optimisation with chaos , 2014, Neural Computing and Applications.

[13]  D. Chu,et al.  Statistics of Echoes From a Directional Sonar Beam Insonifying Finite Numbers of Single Scatterers and Patches of Scatterers , 2010, IEEE Journal of Oceanic Engineering.

[14]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[15]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[16]  Peter Auer,et al.  A learning rule for very simple universal approximators consisting of a single layer of perceptrons , 2008, Neural Networks.

[17]  DeLiang Wang,et al.  Neural Network Based Pitch Tracking in Very Noisy Speech , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[18]  Stephen K. Pearce,et al.  Sharpening Sidescan Sonar Images for Shallow-Water Target and Habitat Classification With a Vertically Stacked Array , 2013, IEEE Journal of Oceanic Engineering.

[19]  Andrew Lewis,et al.  Autonomous Particles Groups for Particle Swarm Optimization , 2014 .

[20]  David P. Williams,et al.  Exploiting Environmental Information for Improved Underwater Target Classification in Sonar Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Hamid Salimi,et al.  Stochastic Fractal Search: A powerful metaheuristic algorithm , 2015, Knowl. Based Syst..

[22]  David P. Williams,et al.  Adaptive Multiview Target Classification in Synthetic Aperture Sonar Images Using a Partially Observable Markov Decision Process , 2012, IEEE Journal of Oceanic Engineering.

[23]  Andrew Lewis,et al.  Let a biogeography-based optimizer train your Multi-Layer Perceptron , 2014, Inf. Sci..

[24]  Ji-Xun Zhou,et al.  Shallow-water reverberation level: measurement technique and initial reference values , 2005, IEEE Journal of Oceanic Engineering.

[25]  Daniel Gatica-Perez,et al.  Hire me: Computational Inference of Hirability in Employment Interviews Based on Nonverbal Behavior , 2014, IEEE Transactions on Multimedia.

[26]  Nicolaos B. Karayiannis,et al.  Reformulated radial basis neural networks trained by gradient descent , 1999, IEEE Trans. Neural Networks.

[27]  Arun Kumar,et al.  Marine vessel classification based on passive sonar data: the cepstrum-based approach , 2013 .

[28]  Gaddi Blumrosen,et al.  Noncontact Wideband Sonar for Human Activity Detection and Classification , 2014, IEEE Sensors Journal.

[29]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[30]  David P. Williams Label Alteration to Improve Underwater Mine Classification , 2011, IEEE Geoscience and Remote Sensing Letters.

[31]  Andrew Lewis,et al.  S-shaped versus V-shaped transfer functions for binary Particle Swarm Optimization , 2013, Swarm Evol. Comput..

[32]  Amir Hossein Alavi,et al.  An effective krill herd algorithm with migration operator in biogeography-based optimization , 2014 .

[33]  Xin Li,et al.  Genetic Algorithm-Based Multi-Objective Optimization for Statistical Yield Analysis Under Parameter Variations , 2016, J. Circuits Syst. Comput..

[34]  J.R. Preston,et al.  Using Triplet Arrays for Broadband Reverberation Analysis and Inversions , 2007, IEEE Journal of Oceanic Engineering.

[35]  Mohammad Reza Mosavi,et al.  Classification of sonar data set using neural network trained by Gray Wolf Optimization , 2016 .