Conjugate direction particle swarm optimization solving systems of nonlinear equations

Solving systems of nonlinear equations is a difficult problem in numerical computation. For most numerical methods such as the Newton's method for solving systems of nonlinear equations, their convergence and performance characteristics can be highly sensitive to the initial guess of the solution supplied to the methods. However, it is difficult to select a good initial guess for most systems of nonlinear equations. Aiming to solve these problems, Conjugate Direction Particle Swarm Optimization (CDPSO) was put forward, which introduced conjugate direction method into Particle Swarm Optimization (PSO)in order to improve PSO, and enable PSO to effectively optimize high-dimensional optimization problem. In one optimization problem, when after some iterations PSO got trapped in local minima with local optimal solution x^*, conjugate direction method was applied with x^* as a initial guess to optimize the problem to help PSO overcome local minima by changing high-dimension function optimization problem into low-dimensional function optimization problem. Because PSO is efficient in solving the low-dimension function optimization problem, PSO can efficiently optimize high-dimensional function optimization problem by this tactic. Since CDPSO has the advantages of Method of Conjugate Direction (CD) and Particle Swarm Optimization (PSO), it overcomes the inaccuracy of CD and PSO for solving systems of nonlinear equations. The numerical results showed that the approach was successful for solving systems of nonlinear equations.

[1]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[2]  Noël Gastinel,et al.  Linear numerical analysis , 1973 .

[3]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[4]  Sonia Krzyworzcka,et al.  Extension of the Lanczos and CGS methods to systems of nonlinear equations , 1996 .

[5]  Zeng Yi The Application of floating Genetic Algorithms to Solving Non-linear equation groups , 2005 .

[6]  Yuan Duan-cai,et al.  Hybrid Genetic Algorithm for solving systems of nonlinear equations , 2005 .

[7]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.