Single-solution Simulated Kalman Filter algorithm for global optimisation problems

AbstractThis paper introduces single-solution Simulated Kalman Filter (ssSKF), a new single-agent optimisation algorithm inspired by Kalman Filter, for solving real-valued numerical optimisation problems. In comparison, the proposed ssSKF algorithm supersedes the original population-based Simulated Kalman Filter (SKF) algorithm by operating with only a single agent, and having less parameters to be tuned. In the proposed ssSKF algorithm, the initialisation parameters are not constants, but they are produced by random numbers taken from a normal distribution in the range of [0, 1], thus excluding them from tuning requirement. In order to balance between the exploration and exploitation in ssSKF, the proposed algorithm uses an adaptive neighbourhood mechanism during its prediction step. The proposed ssSKF algorithm is tested using the 30 benchmark functions of CEC 2014, and its performance is compared to that of the original SKF algorithm, Black Hole (BH) algorithm, Particle Swarm Optimisation (PSO) algorithm, Grey Wolf Optimiser (GWO) algorithm and Genetic Algorithm (GA). The results show that the proposed ssSKF algorithm is a promising approach and able to outperform GWO and GA algorithms, significantly.

[1]  Abas Khairul Hamimah,et al.  Four Different Methods to Hybrid Simulated Kalman Filter (SKF) with Gravitational Search Algorithm (GSA) , 2016 .

[2]  Zuwairie Ibrahim,et al.  PARAMETER-LESS SIMULATED KALMAN FILTER , 2017 .

[3]  Randy L. Haupt,et al.  Practical Genetic Algorithms , 1998 .

[4]  Sebastián Lozano,et al.  Metaheuristic optimization frameworks: a survey and benchmarking , 2011, Soft Computing.

[5]  Muhammad Badaruddin,et al.  Solving Airport Gate Allocation Problem using Simulated Kalman Filter , 2016 .

[6]  Seyedali Mirjalili,et al.  SCA: A Sine Cosine Algorithm for solving optimization problems , 2016, Knowl. Based Syst..

[7]  Mohd Saberi Mohamad,et al.  A Kalman filter approach for solving unimodal optimization problems , 2015 .

[8]  Nikolaus Hansen,et al.  On the Adaptation of Arbitrary Normal Mutation Distributions in Evolution Strategies: The Generating Set Adaptation , 1995, ICGA.

[9]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[10]  Zuwairie Ibrahim,et al.  BSKF: Simulated Kalman Filter , 2015, 2015 3rd International Conference on Artificial Intelligence, Modelling and Simulation (AIMS).

[11]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[12]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[13]  Muhammad Badaruddin,et al.  Solving Airport Gate Allocation Problem Using Angle Modulated Simulated Kalman Filter , 2016 .

[14]  Xin-She Yang,et al.  Firefly algorithm, stochastic test functions and design optimisation , 2010, Int. J. Bio Inspired Comput..

[15]  Riccardo Poli,et al.  Particle Swarm Optimisation , 2011 .

[16]  Ibrahim Zuwairie,et al.  How Important the Error Covariance in Simulated Kalman Filter , 2016 .

[17]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[18]  Janez Brest,et al.  A Brief Review of Nature-Inspired Algorithms for Optimization , 2013, ArXiv.

[19]  Marizan Mubin,et al.  Feature selection using angle modulated simulated Kalman filter for peak classification of EEG signals , 2016, SpringerPlus.

[20]  Mohd Saberi Mohamad,et al.  A New Hybrid Simulated Kalman Filter and Particle Swarm Optimization for Continuous Numerical Optimization Problems , 2015 .

[21]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[22]  Thomas Jansen,et al.  UNIVERSITY OF DORTMUND REIHE COMPUTATIONAL INTELLIGENCE COLLABORATIVE RESEARCH CENTER 531 Design and Management of Complex Technical Processes and Systems by means of Computational Intelligence Methods Upper and Lower Bounds for Randomized Search Heuristics in Black-Box Optimization , 2004 .

[23]  Marco Dorigo,et al.  Optimization, Learning and Natural Algorithms , 1992 .

[24]  Ibrahim Zuwairie,et al.  BSKF: Binary Simulated Kalman Filter , 2015 .

[25]  Bruce L. Golden,et al.  Optimisation , 1982, IEEE Trans. Syst. Man Cybern..

[26]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[27]  Ibrahim Zuwairie,et al.  Distance evaluated simulated kalman filter for combinatorial optimization problems , 2016 .

[28]  Pierre Hansen,et al.  Variable Neighborhood Search , 2018, Handbook of Heuristics.

[29]  Fred W. Glover,et al.  Future paths for integer programming and links to artificial intelligence , 1986, Comput. Oper. Res..

[30]  Mohd Saberi Mohamad,et al.  A Kalman Filter approach to PCB drill path optimization problem , 2016, 2016 IEEE Conference on Systems, Process and Control (ICSPC).

[31]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[32]  Tom Fearn,et al.  Particle Swarm Optimisation , 2014 .

[33]  Mohd Saberi Mohamad,et al.  Angle Modulated Simulated Kalman Filter Algorithm for Combinatorial Optimization Problems , 2016 .

[34]  Xin-She Yang,et al.  Cuckoo Search via Lévy flights , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[35]  Chang Wook Ahn,et al.  On the practical genetic algorithms , 2005, GECCO '05.

[36]  Min-Yuan Cheng,et al.  Symbiotic Organisms Search: A new metaheuristic optimization algorithm , 2014 .

[37]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[38]  María José del Jesús,et al.  KEEL: a software tool to assess evolutionary algorithms for data mining problems , 2008, Soft Comput..

[39]  Ibrahim Zuwairie,et al.  Simulated Kalman Filter: A Novel Estimation-based Metaheuristic Optimization Algorithm , 2016 .

[40]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[41]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[42]  Abdolreza Hatamlou,et al.  Black hole: A new heuristic optimization approach for data clustering , 2013, Inf. Sci..

[43]  Patrick Siarry,et al.  A survey on optimization metaheuristics , 2013, Inf. Sci..