Low-Complexity Particle Swarm Optimization for Time-Critical Applications

Particle swam optimization (PSO) is a popular stochastic optimization method that has found wide applications in diverse fields. However, PSO suffers from high computational complexity and slow convergence speed. High computational complexity hinders its use in applications that have limited power resources while slow convergence speed makes it unsuitable for time critical applications. In this paper, we propose two techniques to overcome these limitations. The first technique reduces the computational complexity of PSO while the second technique speeds up its convergence. These techniques can be applied, either separately or in conjunction, to any existing PSO variant. The proposed techniques are robust to the number of dimensions of the optimization problem. Simulation results are presented for the proposed techniques applied to the standard PSO as well as to several PSO variants. The results show that the use of both these techniques in conjunction results in a reduction in the number of computations required as well as faster convergence speed while maintaining an acceptable error performance for time-critical applications.

[1]  A. Selvakumar,et al.  A New Particle Swarm Optimization Solution to Nonconvex Economic Dispatch Problems , 2007, IEEE Transactions on Power Systems.

[2]  Y. Rahmat-Samii,et al.  Parallel particle swarm optimization and finite- difference time-domain (PSO/FDTD) algorithm for multiband and wide-band patch antenna designs , 2005, IEEE Transactions on Antennas and Propagation.

[3]  Jun Zhang,et al.  Orthogonal Learning Particle Swarm Optimization , 2011, IEEE Trans. Evol. Comput..

[4]  Azzedine Zerguine,et al.  An adaptive equalizer based on particle swarm optimization techniques , 2007, 2007 9th International Symposium on Signal Processing and Its Applications.

[5]  Joong-Rin Shin,et al.  A particle swarm optimization for economic dispatch with nonsmooth cost functions , 2005, IEEE Transactions on Power Systems.

[6]  Zaharias D. Zaharis,et al.  A Novel Adaptive Beamforming Technique Applied on Linear Antenna Arrays Using Adaptive Mutated Boolean PSO , 2011 .

[7]  T.A.A. Victoire,et al.  Reserve constrained dynamic dispatch of units with valve-point effects , 2005, IEEE Transactions on Power Systems.

[8]  Yongshun Zhang,et al.  Polyphase coded signal design for MIMO radar using MO-MicPSO , 2011 .

[9]  Jürgen Branke,et al.  Multi-swarm Optimization in Dynamic Environments , 2004, EvoWorkshops.

[10]  Konstantinos E. Parsopoulos,et al.  UPSO: A Unified Particle Swarm Optimization Scheme , 2019, International Conference of Computational Methods in Sciences and Engineering 2004 (ICCMSE 2004).

[11]  C. Christodoulou,et al.  Linear array geometry synthesis with minimum sidelobe level and null control using particle swarm optimization , 2005, IEEE Transactions on Antennas and Propagation.

[12]  Shiv Kumar,et al.  Equalization of digital communication channels based on PSO algorithm , 2010, 2010 INTERNATIONAL CONFERENCE ON COMMUNICATION CONTROL AND COMPUTING TECHNOLOGIES.

[13]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[14]  Kalyan Veeramachaneni,et al.  Fitness-distance-ratio based particle swarm optimization , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[15]  Ismail Jouny,et al.  Particle swarm optimization for radar target recognition and modeling , 2008, SPIE Defense + Commercial Sensing.

[16]  S. Kannan,et al.  Application and comparison of metaheuristic techniques to generation expansion planning problem , 2005, IEEE Transactions on Power Systems.

[17]  Min Chen,et al.  Virtual MIMO-based cross-layer design for wireless sensor networks , 2006, IEEE Transactions on Vehicular Technology.

[18]  Ijaz Mansoor Qureshi,et al.  Particle swarm optimization based MUD for overloaded MC-CDMA system , 2010, 2010 IEEE International Conference on Wireless Communications, Networking and Information Security.

[19]  Pramod K. Varshney,et al.  An adaptive multimodal biometric management algorithm , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[20]  A.P. Engelbrecht,et al.  Learning to play games using a PSO-based competitive learning approach , 2004, IEEE Transactions on Evolutionary Computation.

[21]  M. Pandit,et al.  Self-Organizing Hierarchical Particle Swarm Optimization for Nonconvex Economic Dispatch , 2008, IEEE Transactions on Power Systems.

[22]  Russell C. Eberhart,et al.  Multiobjective optimization using dynamic neighborhood particle swarm optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[23]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[24]  Andries Petrus Engelbrecht,et al.  Data clustering using particle swarm optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[25]  Kiyotaka Izumi,et al.  A particle-swarm-optimized fuzzy-neural network for voice-controlled robot systems , 2005, IEEE Transactions on Industrial Electronics.

[26]  Thomas Kiel Rasmussen,et al.  Hybrid Particle Swarm Optimiser with breeding and subpopulations , 2001 .

[27]  Riccardo Poli,et al.  Analysis of the publications on the applications of particle swarm optimisation , 2008 .

[28]  Zwe-Lee Gaing,et al.  Particle swarm optimization to solving the economic dispatch considering the generator constraints , 2003 .

[29]  H. Yoshida,et al.  A particle swarm optimization for reactive power and voltage control considering voltage security assessment , 1999, 2001 IEEE Power Engineering Society Winter Meeting. Conference Proceedings (Cat. No.01CH37194).

[30]  Shinn-Ying Ho,et al.  OPSO: Orthogonal Particle Swarm Optimization and Its Application to Task Assignment Problems , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[31]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[32]  Michael N. Vrahatis,et al.  On the computation of all global minimizers through particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[33]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[34]  Yun Shang,et al.  A Note on the Extended Rosenbrock Function , 2006 .

[35]  Chuangxin Guo,et al.  A multiagent-based particle swarm optimization approach for optimal reactive power dispatch , 2005 .

[36]  Zwe-Lee Gaing,et al.  A particle swarm optimization approach for optimum design of PID controller in AVR system , 2004 .

[37]  R. Poli An Analysis of Publications on Particle Swarm Optimisation Applications , 2007 .

[38]  Y. Rahmat-Samii,et al.  Advances in Particle Swarm Optimization for Antenna Designs: Real-Number, Binary, Single-Objective and Multiobjective Implementations , 2007, IEEE Transactions on Antennas and Propagation.

[39]  Hung T. Nguyen,et al.  Fast unsupervised learning method for rapid estimation of cluster centroids , 2012, 2012 IEEE Congress on Evolutionary Computation.

[40]  Vladimiro Miranda,et al.  NEW EVOLUTIONARY PARTICLE SWARM ALGORITHM (EPSO) APPLIED TO VOLTAGE/VAR CONTROL , 2002 .

[41]  Peter J. Bentley,et al.  Don't push me! Collision-avoiding swarms , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[42]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[43]  D.H. Werner,et al.  Particle swarm optimization versus genetic algorithms for phased array synthesis , 2004, IEEE Transactions on Antennas and Propagation.

[44]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[45]  Amitava Chatterjee,et al.  Nonlinear inertia weight variation for dynamic adaptation in particle swarm optimization , 2006, Comput. Oper. Res..

[46]  Y. Rahmat-Samii,et al.  Particle swarm optimization in electromagnetics , 2004, IEEE Transactions on Antennas and Propagation.

[47]  Shiv Kumar,et al.  A novel PSO based adaptive channel equalizer using a modified ANN structure , 2010, 2010 INTERNATIONAL CONFERENCE ON COMMUNICATION CONTROL AND COMPUTING TECHNOLOGIES.

[48]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[49]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[50]  M. A. Abido Optimal des'ign of Power System Stabilizers Using Particle Swarm Opt'imization , 2002, IEEE Power Engineering Review.

[51]  R. Garduno-Ramirez,et al.  Multiobjective control of power plants using particle swarm optimization techniques , 2006, IEEE Transactions on Energy Conversion.

[52]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[53]  Kiseon Kim,et al.  Particle swarm optimization for MIMO receivers , 2008 .

[54]  Luca Maria Gambardella,et al.  Swarm intelligence for routing in mobile ad hoc networks , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[55]  T. Krink,et al.  Extending particle swarm optimisers with self-organized criticality , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[56]  Lin Yang,et al.  Particle-Swarm-Optimization-Based Multiuser Detector for CDMA Communications , 2007, IEEE Transactions on Vehicular Technology.

[57]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[58]  P. J. Angeline,et al.  Using selection to improve particle swarm optimization , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).