A survey on particle swarm optimization with emphasis on engineering and network applications

Swarm intelligence is a kind of artificial intelligence that is based on the collective behavior of the decentralized and self-organized systems. This work focuses on reviewing a heuristic global optimization method called particle swarm optimization (PSO). This includes the mathematical representation of PSO in contentious and binary spaces, the evolution and modifications of PSO over the last two decades. We also present a comprehensive taxonomy of heuristic-based optimization algorithms such as genetic algorithms, tabu search, simulated annealing, cross entropy and illustrate the advantages and disadvantages of these algorithms. Furthermore, we present the application of PSO on graphics processing unit and show various applications of PSO in networks.

[1]  Thomas Jansen,et al.  On the analysis of the (1+1) evolutionary algorithm , 2002, Theor. Comput. Sci..

[2]  Liuqing Yang,et al.  Multi-constrained QoS routing based on PSO for named data networking , 2017, IET Commun..

[3]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[4]  Duc Truong Pham,et al.  Intelligent Optimisation Techniques: Genetic Algorithms, Tabu Search, Simulated Annealing and Neural Networks , 2011 .

[5]  Mahmoud Al-Ayyoub,et al.  Accelerating 3D medical volume segmentation using GPUs , 2018, Multimedia Tools and Applications.

[6]  Yudong Zhang,et al.  A Comprehensive Survey on Particle Swarm Optimization Algorithm and Its Applications , 2015 .

[7]  Xin Chen,et al.  Neural Network Training Using Stochastic PSO , 2006, ICONIP.

[8]  Roberto Santana,et al.  On the Taxonomy of Optimization Problems Under Estimation of Distribution Algorithms , 2013, Evolutionary Computation.

[9]  Shie Mannor,et al.  A Tutorial on the Cross-Entropy Method , 2005, Ann. Oper. Res..

[10]  Yudong Zhang,et al.  Swarm Intelligence and Its Applications , 2013, TheScientificWorldJournal.

[11]  Rasim Temür,et al.  Geometrically Nonlinear Analysis of Trusses Using Particle Swarm Optimization , 2015, Recent Advances in Swarm Intelligence and Evolutionary Computation.

[12]  Diptam Dutta,et al.  Network Anomaly Detection using PSO-ANN , 2013 .

[13]  Simon G. M. Koo,et al.  On neighbor-selection strategy in hybrid peer-to-peer networks , 2006, Future Gener. Comput. Syst..

[14]  Lee Jacobson,et al.  Genetic Algorithms in Java Basics , 2015, Apress.

[15]  Beatriz A. Garro,et al.  Designing Artificial Neural Networks Using Particle Swarm Optimization Algorithms , 2015, Comput. Intell. Neurosci..

[16]  Mahmoud Al-Ayyoub,et al.  Parallel implementation of FCM-based volume segmentation of 3D images , 2016, 2016 IEEE/ACS 13th International Conference of Computer Systems and Applications (AICCSA).

[17]  Ram Ramanathan,et al.  Topology control of multihop wireless networks using transmit power adjustment , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[18]  Ying Tan,et al.  GPU-based Parallel Implementation of Swarm Intelligence Algorithms , 2016 .

[19]  P. Siarry,et al.  FITTING OF TABU SEARCH TO OPTIMIZE FUNCTIONS OF CONTINUOUS VARIABLES , 1997 .

[20]  Jaspreet Kaur,et al.  Parallel Implementation of PSO Algorithm Using GPGPU , 2016, 2016 Second International Conference on Computational Intelligence & Communication Technology (CICT).

[21]  Marco Dorigo,et al.  Ant colony optimization theory: A survey , 2005, Theor. Comput. Sci..

[22]  Chang Wook Ahn,et al.  A genetic algorithm for shortest path routing problem and the sizing of populations , 2002, IEEE Trans. Evol. Comput..

[23]  Keun-Chang Kwak,et al.  An Optimization of Granular Networks Based on PSO and Two-Sided Gaussian Contexts , 2012 .

[24]  Z W Geem,et al.  APPLICATION OF HARMONY SEARCH TO MULTI-OBJECTIVE OPTIMIZATION FOR SATELLITE HEAT PIPE DESIGN , 2006 .

[25]  Pericles A. Mitkas,et al.  Agent-based short-term load and price forecasting using a parallel implementation of an adaptive PSO-trained local linear wavelet neural network , 2015, 2015 12th International Conference on the European Energy Market (EEM).

[26]  Layachi Zaghba,et al.  Fuzzy logic, PSO based fuzzy logic algorithm and current controls comparative for grid-connected hybrid system , 2017 .

[27]  Weichung Wang,et al.  Accelerating parallel particle swarm optimization via GPU , 2012, Optim. Methods Softw..

[28]  Michal Pluhacek,et al.  Exploring the shortest path in PSO communication network , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[29]  W. Hoeffding.  Probability Inequalities for sums of Bounded Random Variables , 1963 .

[30]  Bo Yang,et al.  Survey on Applications of Particle Swarm Optimization in Electric Power Systems , 2007, 2007 IEEE International Conference on Control and Automation.

[31]  Zbigniew Michalewicz,et al.  Particle Swarm Optimization for Single Objective Continuous Space Problems: A Review , 2017, Evolutionary Computation.

[32]  Ye Hongtao,et al.  Survey of particle swarm optimization algorithm and its applications in antenna circuit , 2015, 2015 IEEE International Conference on Communication Problem-Solving (ICCP).

[33]  Hai Jin,et al.  Enhanced PSO for network reconfiguration under different fault locations in smart grids , 2017, 2017 International Conference On Smart Technologies For Smart Nation (SmartTechCon).

[34]  Slawomir Koziel,et al.  Power loss reduction through distribution network reconfiguration using feasibility-preserving simulated annealing , 2018, 2018 19th International Scientific Conference on Electric Power Engineering (EPE).

[35]  Faouzi Kamoun,et al.  Neural networks for shortest path computation and routing in computer networks , 1993, IEEE Trans. Neural Networks.

[36]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[37]  Giancarlo Mauri,et al.  A GPU-Based Multi-swarm PSO Method for Parameter Estimation in Stochastic Biological Systems Exploiting Discrete-Time Target Series , 2012, EvoBIO.

[38]  Ulf Grenander,et al.  A stochastic nonlinear model for coordinated bird flocks , 1990 .

[39]  A. Al-Fuqaha,et al.  A genetic approach for trajectory planning in non-autonomous Mobile Ad-Hoc Networks with QoS requirements , 2010, 2010 IEEE Globecom Workshops.

[40]  Ya Wang,et al.  Improved OTSU and adaptive genetic algorithm for infrared image segmentation , 2018, 2018 Chinese Control And Decision Conference (CCDC).

[41]  Pascal Bouvry,et al.  A scalable parallel cooperative coevolutionary PSO algorithm for multi-objective optimization , 2018, J. Parallel Distributed Comput..

[42]  Ala I. Al-Fuqaha,et al.  Design of a Social Collaboration and Precise Localization Services for the Blind and Visually Impaired , 2013, EUSPN/ICTH.

[43]  Falah H. Ali,et al.  Trained Particle Swarm Optimization for Ad-Hoc Collaborative Computing Networks , 2008 .

[44]  S. N. Sivanandam,et al.  An Enhanced PSO-Based Clustering Energy Optimization Algorithm for Wireless Sensor Network , 2016, TheScientificWorldJournal.

[45]  Tianzi Jiang,et al.  A tabu search method for geometric primitive extraction , 1997, Pattern Recognit. Lett..

[46]  Emmanuel Dotaro,et al.  Routing foreseeable lightpath demands using a tabu search meta-heuristic , 2002, Global Telecommunications Conference, 2002. GLOBECOM '02. IEEE.

[47]  C. Priyadharshini,et al.  PSO based route lifetime prediction algorithm for maximizing network lifetime in MANET , 2012, 2012 International Conference on Recent Trends in Information Technology.

[48]  Jing Shen,et al.  A Novel Discrete Particle Swarm Optimization Algorithm for Microarray Data-Based Tumor Marker Gene Selection , 2008, 2008 International Conference on Computer Science and Software Engineering.

[49]  Keisuke Kameyama,et al.  Particle Swarm Optimization - A Survey , 2009, IEICE Trans. Inf. Syst..

[50]  Chengdong Wu,et al.  A Pso-Based Maintenance Strategy in Wireless Sensor Networks , 2015, Intell. Autom. Soft Comput..

[51]  Irène Charon,et al.  The noising method: a new method for combinatorial optimization , 1993, Oper. Res. Lett..

[52]  Kay Hamacher,et al.  Stochastic tunneling transformation during selection in genetic algorithm , 2014, GECCO.

[53]  Dirk P. Kroese,et al.  The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation and Machine Learning , 2004 .

[54]  Russell C. Eberhart,et al.  Solving Constrained Nonlinear Optimization Problems with Particle Swarm Optimization , 2002 .

[55]  Souad Larabi Marie-Sainte,et al.  A survey of Particle Swarm Optimization techniques for solving university Examination Timetabling Problem , 2015, Artificial Intelligence Review.

[56]  David C. Yen,et al.  A Network Behavior-Based Botnet Detection Mechanism Using PSO and K-means , 2015, TMIS.

[57]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[58]  W. Wenzel,et al.  Stochastic Tunneling Approach for Global Minimization of Complex Potential Energy Landscapes , 1999 .

[59]  L. Lakshmanan,et al.  OPTIMIZING LOCALIZATION ROUTE USING PARTICLE SWARM-A GENETIC APPROACH , 2014 .

[60]  J. Anuradha,et al.  A Survey on Particle Swarm Optimization in Feature Selection , 2011 .

[61]  M. A. Khanesar,et al.  A novel binary particle swarm optimization , 2007, 2007 Mediterranean Conference on Control & Automation.

[62]  Ala I. Al-Fuqaha,et al.  Gyroscope drift correction based on TDoA technology in support of Pedestrian Dead Reckoning , 2012, 2012 IEEE Globecom Workshops.

[63]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[64]  Jingyu Wang,et al.  A PSO-based virtual SDN customization for multi-tenant cloud services , 2017, IMCOM.

[65]  A. Schug,et al.  Reproducible protein folding with the stochastic tunneling method. , 2003, Physical review letters.

[66]  K. Lee,et al.  A new meta-heuristic algorithm for continuous engineering optimization: harmony search theory and practice , 2005 .

[67]  N. C. Sahoo,et al.  Research Article Efficient Computation of Shortest Paths in Networks Using Particle Swarm Optimization and Noising Metaheuristics , 2007 .

[68]  M. Fesanghary,et al.  An improved harmony search algorithm for solving optimization problems , 2007, Appl. Math. Comput..

[69]  Wuling Ren,et al.  A Localization Algorithm Based On SFLA and PSO for Wireless Sensor Network , 2013 .

[70]  Wei Kong,et al.  A combination of modified particle swarm optimization algorithm and support vector machine for gene selection and tumor classification. , 2007, Talanta.

[71]  James M. Hereford,et al.  Integer-valued Particle Swarm Optimization applied to Sudoku puzzles , 2008, 2008 IEEE Swarm Intelligence Symposium.

[72]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[73]  K.Y. Lee,et al.  Application of Particle Swarm Optimization to Economic Dispatch Problem: Advantages and Disadvantages , 2006, 2006 IEEE PES Power Systems Conference and Exposition.

[74]  Ajith Abraham,et al.  A Particle Swarm Optimization Algorithm for Neighbor Selection in Peer-to-Peer Networks , 2007, 6th International Conference on Computer Information Systems and Industrial Management Applications (CISIM'07).

[75]  Kostas Papadopoulos,et al.  Communication network design using Particle Swarm Optimization , 2008, 2008 International Multiconference on Computer Science and Information Technology.

[76]  Ying Tan,et al.  GPU-based parallel particle swarm optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[77]  Riccardo Poli,et al.  Analysis of the publications on the applications of particle swarm optimisation , 2008 .

[78]  Deep Medhi,et al.  Routing, flow, and capacity design in communication and computer networks , 2004 .

[79]  Shivani Sharma,et al.  Analysis of metrics: Improved hybrid ACO-PSO based routing algorithm for mobile ad-hoc network , 2016, 2016 Fourth International Conference on Parallel, Distributed and Grid Computing (PDGC).

[80]  Lane R. Johnson,et al.  Genetic Algorithms and Their Use in Geophysical Problems , 2013 .

[81]  Chukwudi Anyakoha,et al.  A review of particle swarm optimization. Part I: background and development , 2007, Natural Computing.

[82]  A. P. Engelbrecht,et al.  Particle Swarm Optimization: Global Best or Local Best? , 2013, 2013 BRICS Congress on Computational Intelligence and 11th Brazilian Congress on Computational Intelligence.

[83]  Dirk Sudholt,et al.  On the runtime analysis of the 1-ANT ACO algorithm , 2007, GECCO '07.

[84]  Pabitra Mohan Khilar,et al.  Soft fault diagnosis in wireless sensor networks using PSO based classification , 2017, TENCON 2017 - 2017 IEEE Region 10 Conference.

[85]  Fenfen Xiong,et al.  Parallel particle swarm optimization on a graphics processing unit with application to trajectory optimization , 2016 .

[86]  Marwan Krunz,et al.  Power controlled dual channel (PCDC) medium access protocol for wireless ad hoc networks , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[87]  Kay Hamacher,et al.  A New Hybrid Metaheuristic - Combining Stochastic Tunneling and Energy Landscape Paving , 2013, Hybrid Metaheuristics.

[88]  Yaser Jararweh,et al.  An optimal multi-processor allocation algorithm for high performance GPU accelerators , 2011, 2011 IEEE Jordan Conference on Applied Electrical Engineering and Computing Technologies (AEECT).

[89]  Chukwudi Anyakoha,et al.  A review of particle swarm optimization. Part II: hybridisation, combinatorial, multicriteria and constrained optimization, and indicative applications , 2008, Natural Computing.

[90]  Xu Zhou,et al.  Parallel hybrid PSO with CUDA for lD heat conduction equation , 2015 .

[91]  Dirk Sudholt,et al.  Runtime analysis of binary PSO , 2008, GECCO '08.

[92]  Breno Avelar Rodrigues de Andrade,et al.  Simulated annealing and tabu search applied on network reconfiguration in distribution systems , 2018, 2018 Simposio Brasileiro de Sistemas Eletricos (SBSE).

[93]  Maan Younis Abdullah,et al.  Power Minimization Algorithm in Wireless Ad-hoc Networks Based on PSO , 2007 .

[94]  Jun Zhang,et al.  Competitive and cooperative particle swarm optimization with information sharing mechanism for global optimization problems , 2015, Inf. Sci..

[95]  Jinyu Wen,et al.  Design Fuzzy Logic Controller by Particle Swarm Optimization for Wind Turbine , 2013, ICSI.

[96]  James Kennedy,et al.  Defining a Standard for Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[97]  Kai Zhang,et al.  Optimum design of multistage half-band FIR filter for audio conversion using a simulated annealing algorithm , 2018, 2018 13th IEEE Conference on Industrial Electronics and Applications (ICIEA).

[98]  Tamás Vicsek,et al.  Flocking algorithm for autonomous flying robots , 2013, Bioinspiration & biomimetics.

[99]  Hiroshi Hattori,et al.  A CUDA Implementation of the Standard Particle Swarm Optimization , 2016, 2016 18th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC).

[100]  H. Fan.  A modification to particle swarm optimization algorithm , 2002 .

[101]  Panos M. Pardalos,et al.  Handbook of Optimization in Telecommunications , 2006 .

[102]  Hongwei Liu,et al.  Application of Improved Discrete Particle Swarm Algorithm in Partner Selection of Virtual Enterprise , 2006 .

[103]  Ala I. Al-Fuqaha,et al.  An intelligent data fusion technique based on the particle filter to perform precise outdoor localization , 2013, Int. J. Pervasive Comput. Commun..