Heuristic Kalman Algorithm

In this chapter a new optimization method is presented, called the Heuristic Kalman Algorithm (HKA). This new algorithm is proposed as an alternative approach for solving continuous non-convex optimization problems. The principle of HKA is to consider explicitly the optimization problem as a measurement process intended to give an estimate of the optimum. A specific procedure, based on the Kalman estimator, was developed to improve the quality of the estimate obtained through the measurement process. A significant advantage of HKA against other metaheuristics lies mainly in the small number of parameters which have to be set by the user. In addition, it is shown that HKA converges almost surely to a near-optimal solution. The efficiency of HKA is evaluated in detail through several non-convex test problems, both in the unconstrained and constrained cases. The results are then compared to those obtained via other metaheuristics. These various numerical experiments show that the HKA has very interesting potentialities for solving non-convex optimization problems, especially with regard to the computation time and the success ratio.

[1]  Wesley E. Snyder,et al.  Optimization of functions with many minima , 1991, IEEE Trans. Syst. Man Cybern..

[2]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[3]  P. Siarry,et al.  Enhanced Continuous Tabu Search: An Algorithm for Optimizing Multiminima Functions , 1999 .

[4]  R. Toscano,et al.  Mixed H2/H∞ residual generator design via Heuristic Kalman Algorithm , 2009 .

[5]  Carlos A. Coello Coello,et al.  THEORETICAL AND NUMERICAL CONSTRAINT-HANDLING TECHNIQUES USED WITH EVOLUTIONARY ALGORITHMS: A SURVEY OF THE STATE OF THE ART , 2002 .

[6]  Patrick Siarry,et al.  Enhanced simulated annealing for globally minimizing functions of many-continuous variables , 1997, TOMS.

[7]  Kalyanmoy Deb,et al.  Optimal design of a welded beam via genetic algorithms , 1991 .

[8]  Toshiharu Sugie,et al.  Robust PID controller tuning based on the constrained particle swarm optimization , 2008, Autom..

[9]  Patrick Lyonnet,et al.  A Kalman Optimization Approach for Solving Some Industrial Electronics Problems , 2012, IEEE Transactions on Industrial Electronics.

[10]  K. M. Ragsdell,et al.  Optimal Design of a Class of Welded Structures Using Geometric Programming , 1976 .

[11]  Marco Dorigo,et al.  Ant colony optimization for continuous domains , 2008, Eur. J. Oper. Res..

[12]  Patrick Lyonnet,et al.  A new heuristic approach for non-convex optimization problems , 2010, Inf. Sci..

[13]  Arthur Gelb,et al.  Applied Optimal Estimation , 1974 .

[14]  Carlos A. Coello Coello,et al.  Use of a self-adaptive penalty approach for engineering optimization problems , 2000 .

[15]  Carlos A. Coello Coello,et al.  Constraint-handling in genetic algorithms through the use of dominance-based tournament selection , 2002, Adv. Eng. Informatics.

[16]  Silvano Martello,et al.  Meta-Heuristics: Advances and Trends in Local Search Paradigms for Optimization , 2012 .

[17]  Ling Wang,et al.  An effective co-evolutionary particle swarm optimization for constrained engineering design problems , 2007, Eng. Appl. Artif. Intell..

[18]  Patrick Lyonnet,et al.  Heuristic Kalman Algorithm for Solving Optimization Problems , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[19]  Patrick Siarry,et al.  A Continuous Genetic Algorithm Designed for the Global Optimization of Multimodal Functions , 2000, J. Heuristics.

[20]  Patrick Lyonnet,et al.  Robust PID controller tuning based on the heuristic Kalman algorithm , 2009, Autom..

[21]  Peter S. Maybeck,et al.  Stochastic Models, Estimation And Control , 2012 .

[22]  Dan Simon,et al.  Optimal State Estimation: Kalman, H∞, and Nonlinear Approaches , 2006 .

[23]  Rosario Toscano,et al.  Stochastic Methods for Hard Optimization: Application to Robust Control and Fault Diagnosis of Industrial Systems , 2010 .