Chaotic neural network algorithm with competitive learning for global optimization

Abstract Neural network algorithm (NNA) is one of the newest proposed metaheuristic algorithms. NNA has strong global search ability due to the unique structure of artificial neural networks. Further, NNA is an algorithm without any effort for fine tuning initial parameters. Thus, it is very easy for NNA to solve different types of optimization problems. However, when used for solving complex optimization problems, slow convergence and premature convergence are its drawbacks. To overcome the two drawbacks, this work presents an improved NNA, namely chaotic neural network algorithm with competitive learning (CCLNNA), for global optimization. In CCLNNA, population is first divided into excellent subpopulation and common subpopulation according to the built competitive mechanism. Then, to balance exploration and exploitation of CCLNNA, excellent subpopulation is optimized by the designed transfer operator while common subpopulation is updated by the combination of the designed bias operator and transfer operator. Besides, chaos theory is introduced to increase the chance of CCLNNA to escape from the local optimum. To investigate the effectiveness of the improved strategies, CCLNNA is first used to solve the well-known CEC 2014 test suite with 30 benchmark functions. Then it is employed for solving three constrained real-world engineering design problems. Experimental results reveal that the improved strategies introduced to NNA can significantly improve the optimization performance of NNA and CCLNNA is a very powerful algorithm in solving complex optimization problems with multimodal properties by comparing with the other competitive algorithms.

[1]  Seyedali Mirjalili,et al.  SCA: A Sine Cosine Algorithm for solving optimization problems , 2016, Knowl. Based Syst..

[2]  Ardeshir Bahreininejad,et al.  Water cycle algorithm - A novel metaheuristic optimization method for solving constrained engineering optimization problems , 2012 .

[3]  Vahid Khatibi Bardsiri,et al.  Poor and rich optimization algorithm: A new human-based and multi populations algorithm , 2019, Eng. Appl. Artif. Intell..

[4]  Liang Gao,et al.  Queuing search algorithm: A novel metaheuristic algorithm for solving engineering optimization problems , 2018, Applied Mathematical Modelling.

[5]  Diego Oliva,et al.  Parameter estimation of photovoltaic cells using an improved chaotic whale optimization algorithm , 2017 .

[6]  R. Venkata Rao,et al.  Teaching-Learning-Based Optimization: An optimization method for continuous non-linear large scale problems , 2012, Inf. Sci..

[7]  Ardeshir Bahreininejad,et al.  Mine blast algorithm: A new population based algorithm for solving constrained engineering optimization problems , 2013, Appl. Soft Comput..

[8]  Rajiv Tiwari,et al.  Multi-objective design optimisation of rolling bearings using genetic algorithms , 2007 .

[9]  Bijaya K. Panigrahi,et al.  A hybridization of an improved particle swarm optimization and gravitational search algorithm for multi-robot path planning , 2016, Swarm Evol. Comput..

[10]  Ali Kaveh,et al.  Water Evaporation Optimization , 2016 .

[11]  A. L. Sangal,et al.  Tunicate Swarm Algorithm: A new bio-inspired based metaheuristic paradigm for global optimization , 2020, Eng. Appl. Artif. Intell..

[12]  Seyed Mohammad Mirjalili,et al.  Multi-Verse Optimizer: a nature-inspired algorithm for global optimization , 2015, Neural Computing and Applications.

[13]  Hossam Faris,et al.  Salp Swarm Algorithm: A bio-inspired optimizer for engineering design problems , 2017, Adv. Eng. Softw..

[14]  Yaochu Jin,et al.  A Competitive Swarm Optimizer for Large Scale Optimization , 2015, IEEE Transactions on Cybernetics.

[15]  M. Khishe,et al.  Chimp optimization algorithm , 2020, Expert Syst. Appl..

[16]  Juan Wang,et al.  Chaos-enhanced Cuckoo search optimization algorithms for global optimization , 2016 .

[17]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[18]  Kusum Deep,et al.  Sine cosine grey wolf optimizer to solve engineering design problems , 2020, Engineering with Computers.

[19]  Mehdi Hosseinzadeh,et al.  A framework to expedite joint energy-reserve payment cost minimization using a custom-designed method based on Mixed Integer Genetic Algorithm , 2018, Eng. Appl. Artif. Intell..

[20]  Prasanta K. Jana,et al.  Energy efficient clustering and routing algorithms for wireless sensor networks: Particle swarm optimization approach , 2014, Eng. Appl. Artif. Intell..

[21]  A. Gandomi,et al.  Mixed variable structural optimization using Firefly Algorithm , 2011 .

[22]  Tingsong Du,et al.  DSLC-FOA : Improved fruit fly optimization algorithm for application to structural engineering design optimization problems , 2018 .

[23]  Amir H. Gandomi,et al.  The Arithmetic Optimization Algorithm , 2021, Computer Methods in Applied Mechanics and Engineering.

[24]  Mohamed Abd Elaziz,et al.  Performance analysis of Chaotic Multi-Verse Harris Hawks Optimization: A case study on solving engineering problems , 2020, Eng. Appl. Artif. Intell..

[25]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[26]  Lei Wu,et al.  A new improved fruit fly optimization algorithm IAFOA and its application to solve engineering optimization problems , 2017, Knowl. Based Syst..

[27]  Xin-She Yang,et al.  Cuckoo search: recent advances and applications , 2013, Neural Computing and Applications.

[28]  Wei Wang,et al.  Electricity load forecasting by an improved forecast engine for building level consumers , 2017 .

[29]  Ke Chen,et al.  Chaotic dynamic weight particle swarm optimization for numerical function optimization , 2018, Knowl. Based Syst..

[30]  Seyed Mohammad Mirjalili,et al.  Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm , 2015, Knowl. Based Syst..

[31]  Gaurav Dhiman,et al.  Spotted hyena optimizer: A novel bio-inspired based metaheuristic technique for engineering applications , 2017, Adv. Eng. Softw..

[32]  Maoguo Gong,et al.  Quantum-behaved discrete multi-objective particle swarm optimization for complex network clustering , 2017, Pattern Recognit..

[33]  Harish Garg,et al.  A hybrid GSA-GA algorithm for constrained optimization problems , 2019, Inf. Sci..

[34]  Amandeep Kaur,et al.  STOA: A bio-inspired based optimization algorithm for industrial engineering problems , 2019, Eng. Appl. Artif. Intell..

[35]  Vijander Singh,et al.  A novel nature-inspired algorithm for optimization: Squirrel search algorithm , 2019, Swarm Evol. Comput..

[36]  R. Venkata Rao,et al.  Teaching-learning-based optimization: A novel method for constrained mechanical design optimization problems , 2011, Comput. Aided Des..

[37]  Vimal Savsani,et al.  Passing vehicle search (PVS): A novel metaheuristic algorithm , 2016 .

[38]  Haiguo Tang,et al.  A new wind power prediction method based on ridgelet transforms, hybrid feature selection and closed-loop forecasting , 2018, Adv. Eng. Informatics.

[39]  Yiying Zhang,et al.  Group teaching optimization algorithm: A novel metaheuristic method for solving global optimization problems , 2020, Expert Syst. Appl..

[40]  Kusum Deep,et al.  Improved sine cosine algorithm with crossover scheme for global optimization , 2019, Knowl. Based Syst..

[41]  José Boaventura-Cunha,et al.  Chaos-based grey wolf optimizer for higher order sliding mode position control of a robotic manipulator , 2017 .

[42]  Zhikai Xing,et al.  An improved emperor penguin optimization based multilevel thresholding for color image segmentation , 2020, Knowl. Based Syst..

[43]  Seyedali Mirjalili,et al.  Henry gas solubility optimization: A novel physics-based algorithm , 2019, Future Gener. Comput. Syst..

[44]  Vijay Kumar,et al.  Emperor penguin optimizer: A bio-inspired algorithm for engineering problems , 2018, Knowl. Based Syst..

[45]  Chenglong He,et al.  Efficient path planning for UAV formation via comprehensively improved particle swarm optimization. , 2020, ISA transactions.

[46]  Hammoudi Abderazek,et al.  A Comparative Study of Recent Non-traditional Methods for Mechanical Design Optimization , 2019, Archives of Computational Methods in Engineering.

[47]  Noradin Ghadimi,et al.  Multi-objective energy management in a micro-grid , 2018, Energy Reports.

[48]  Ouajdi Korbaa,et al.  Chaotic lightning search algorithm , 2020, Soft Computing.

[49]  Keqin Li,et al.  Enhance chaotic gravitational search algorithm (CGSA) by balance adjustment mechanism and sine randomness function for continuous optimization problems , 2020 .

[50]  Mengnan Tian,et al.  An improved differential evolution with information intercrossing and sharing mechanism for numerical optimization , 2017, Swarm Evol. Comput..

[51]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[52]  Anupam Yadav,et al.  A dynamic metaheuristic optimization model inspired by biological nervous systems: Neural network algorithm , 2018, Appl. Soft Comput..

[53]  Vijay Kumar,et al.  Seagull optimization algorithm: Theory and its applications for large-scale industrial engineering problems , 2019, Knowl. Based Syst..

[54]  Mohammad Ghiasi,et al.  Extracting Appropriate Nodal Marginal Prices for All Types of Committed Reserve , 2019 .

[55]  Alireza Askarzadeh,et al.  A novel metaheuristic method for solving constrained engineering optimization problems: Crow search algorithm , 2016 .

[56]  Hossam Faris,et al.  Harris hawks optimization: Algorithm and applications , 2019, Future Gener. Comput. Syst..

[57]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[58]  P. N. Suganthan,et al.  Ensemble particle swarm optimizer , 2017, Appl. Soft Comput..

[59]  Li Zhang,et al.  Intelligent skin cancer detection using enhanced particle swarm optimization , 2018, Knowl. Based Syst..

[60]  Hojjat Rakhshani,et al.  Snap-drift cuckoo search: A novel cuckoo search optimization algorithm , 2017, Appl. Soft Comput..

[61]  Hung Nguyen-Xuan,et al.  Balancing composite motion optimization , 2020, Inf. Sci..

[62]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[63]  Noradin Ghadimi,et al.  A new prediction model of battery and wind-solar output in hybrid power system , 2019, J. Ambient Intell. Humaniz. Comput..

[64]  Ali Kaveh,et al.  Chaos-based firefly algorithms for optimization of cyclically large-size braced steel domes with multiple frequency constraints , 2019, Computers & Structures.

[65]  Rabeh Abbassi,et al.  An efficient salp swarm-inspired algorithm for parameters identification of photovoltaic cell models , 2019, Energy Conversion and Management.

[66]  Witold Pedrycz,et al.  Solving Fuzzy Job-Shop Scheduling Problem Using DE Algorithm Improved by a Selection Mechanism , 2020, IEEE Transactions on Fuzzy Systems.