GM-CPSO: A New Viewpoint to Chaotic Particle Swarm Optimization via Gauss Map

Abstract Chaos concept has been appealed in the recent optimization methods to achieve a convenient tradeoff between exploration and exploitation. Different chaotic maps have been considered to find out the appropriate one for the system dynamics. However, on particle swarm optimization (PSO), the usage of these maps has not been handled in an extensive manner, and the best fit one has not known yet. In this paper, ten chaotic maps are handled to reveal the best fit one for PSO, and to explore whether chaotic maps are necessary for PSO or not. Thirteen benchmark functions are used to perform a detailed evaluation at the first experiment. Chaotic PSO (CPSO) methods including different maps are tested on global function optimization. Concerning this, Gauss map based CPSO (GM-CPSO) has come to the forefront by achieving promising fitness values in all function evaluations and in comparison with the state-of-the-art methods. To test the efficiency of GM-CPSO on a different task, GM-CPSO is hybridized with neural network (NN) at the second experiment, and the epileptic seizure recognition is handled. Discrete wavelet transform (DWT) based features, GM-CPSO and NN are considered to design an efficient framework and to specify the type of electroencephalography signals. GM-CPSO-NN is compared with hybrid NNs including two state-of-the-art optimization methods so as to examine the efficiency of GM-CPSO. To accurately test the performances, twofold cross validation is realized on 11,500 instances, and four metrics [accuracy, area under ROC curve (AUC), sensitivity, specificity] are consulted for a detailed assessment beside of computational complexity analysis. In experiments, GM-CPSO including the necessary map, has provided remarkable fitness scores over the state-of-the-art optimization methods on optimization of various functions defined in different dimensions. Besides, the proposed framework including GM-CPSO-NN, has achieved remarkable performance by obtaining reliable accuracy (97.24%), AUC (95.67%), sensitivity (93.04%) and specificity (98.29%) scores, and by including less computational complexity than other algorithms. According to the results, GM-CPSO has arisen as the most convenient optimization method to be preferred in the formation of hybrid NNs. In addition to optimization and classification results, it’s seen that the detail sub-bands of DWT comprise necessary information for seizure recognition. Consequently, it’s revealed that GM-CPSO can be preferred on global function optimization for reliable convergence, and its usage can be extended to different disciplines like signal classification, pattern recognition or hybrid system design. Graphical Abstract

[1]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[2]  Chenguang Yang,et al.  New Noise-Tolerant Neural Algorithms for Future Dynamic Nonlinear Optimization With Estimation on Hessian Matrix Inversion , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[3]  K Lehnertz,et al.  Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: dependence on recording region and brain state. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  Salah Al-Sharhan,et al.  Adaptive multi-parent crossover GA for feature optimization in epileptic seizure identification , 2019, Appl. Soft Comput..

[5]  Xin-She Yang,et al.  Nature-Inspired Optimization Algorithms: Challenges and Open Problems , 2020, J. Comput. Sci..

[6]  Alexei A. Morozov,et al.  A method of analysis of EEG wave trains in early stages of Parkinson's disease , 2016, 2016 International Conference on Bioinformatics and Systems Biology (BSB).

[7]  Chao Wang,et al.  Shape optimization of structures with cutouts by an efficient approach based on XIGA and chaotic particle swarm optimization , 2019, European Journal of Mechanics - A/Solids.

[8]  James M. Shine,et al.  Analysis and Prediction of the Freezing of Gait Using EEG Brain Dynamics , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[9]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[10]  M. Jalili,et al.  Synchronizability of EEG-Based Functional Networks in Early Alzheimer's Disease , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  Weidong Zhou,et al.  Epileptic Seizure Detection Using Lacunarity and Bayesian Linear Discriminant Analysis in Intracranial EEG , 2013, IEEE Transactions on Biomedical Engineering.

[12]  Deng Yong,et al.  Infrared image segmentation with 2-D maximum entropy method based on particle swarm optimization (PSO) , 2005 .

[13]  Nik Bessis,et al.  CS-PSO: chaotic particle swarm optimization algorithm for solving combinatorial optimization problems , 2016, Soft Computing.

[14]  Bijaya K. Panigrahi,et al.  A comparative study of wavelet families for EEG signal classification , 2011, Neurocomputing.

[15]  Amir Hossein Gandomi,et al.  Chaotic Krill Herd algorithm , 2014, Inf. Sci..

[16]  Chuanjun Dai,et al.  Stability and Hopf Bifurcation Analysis of a Nutrient-Phytoplankton Model with Delay Effect , 2014 .

[17]  Anubha Gupta,et al.  A Novel Signal Modeling Approach for Classification of Seizure and Seizure-Free EEG Signals , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  Hasan Koyuncu,et al.  A New Breakpoint in Hybrid Particle Swarm-Neural Network Architecture: Individual Boundary Adjustment , 2016, Int. J. Inf. Technol. Decis. Mak..

[19]  Andrew Lewis,et al.  Biogeography-based optimisation with chaos , 2014, Neural Computing and Applications.

[20]  Hasan Koyuncu,et al.  An extensive study for binary characterisation of adrenal tumours , 2018, Medical & Biological Engineering & Computing.

[21]  Qi Peng,et al.  A three-dimensional indoor positioning technique based on visible light communication using chaotic particle swarm optimization algorithm , 2018, Optik.

[22]  Moayed Daneshyari,et al.  Chaotic neural network controlled by particle swarm with decaying chaotic inertia weight for pattern recognition , 2010, Neural Computing and Applications.

[23]  Zhifeng Dai,et al.  Extension of Modified Polak-Ribière-Polyak Conjugate Gradient Method to Linear Equality Constraints Minimization Problems , 2014 .

[24]  Hasan Koyuncu,et al.  Scout Particle Swarm Optimization , 2015 .

[25]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[26]  Fei Wang,et al.  A PRP-based residual method for large-scale monotone nonlinear equations , 2015, Appl. Math. Comput..

[27]  Sherin M. Youssef,et al.  A hybrid automated detection of epileptic seizures in EEG records , 2016, Comput. Electr. Eng..

[28]  Ke Chen,et al.  Chaotic dynamic weight particle swarm optimization for numerical function optimization , 2018, Knowl. Based Syst..

[29]  Shuai Li,et al.  On Generalized RMP Scheme for Redundant Robot Manipulators Aided With Dynamic Neural Networks and Nonconvex Bound Constraints , 2019, IEEE Transactions on Industrial Informatics.

[30]  Yong Deng,et al.  Infrared image segmentation with 2-D maximum entropy method based on particle swarm optimization (PSO) , 2005, Pattern Recognit. Lett..

[31]  Ahmed Hamza Osman,et al.  New Approach for Automated Epileptic Disease Diagnosis Using an Integrated Self-Organization Map and Radial Basis Function Neural Network Algorithm , 2019, IEEE Access.

[32]  Reza Ghanbari,et al.  Some new three-term Hestenes–Stiefel conjugate gradient methods with affine combination , 2017 .

[33]  K. Teo,et al.  Robust multi-objective optimal switching control arising in 1,3-propanediol microbial fed-batch process , 2017 .

[34]  Javad Haddadnia,et al.  Epileptic seizure detection using cross-bispectrum of electroencephalogram signal , 2019, Seizure.

[35]  Hasan Koyuncu,et al.  A PSO based approach: Scout particle swarm algorithm for continuous global optimization problems , 2018, J. Comput. Des. Eng..

[36]  Rahime Ceylan,et al.  A Novel Rotation Forest Modality Based on Hybrid NNs: RF (ScPSO-NN) , 2017, J. King Saud Univ. Comput. Inf. Sci..

[37]  Xia Li,et al.  Model turbine heat rate by fast learning network with tuning based on ameliorated krill herd algorithm , 2017, Knowl. Based Syst..