An Intelligent Programmed Genetic Algorithm with advanced deterministic diversity creating operator using objective surface visualization

This paper presents a new fast Intelligent Programmed Genetic Algorithm (IPGA) based evolutionary optimization algorithm which requires lesser number of objective function evaluation for reaching optima. The proposed algorithm, apart from using probabilistic genetic operator, i.e. crossover and mutation, also uses a deterministic diversity creating operator for generating new solution in the current population. This is done by first projecting objective surface from higher dimension to lower dimension for visualization purpose and then deterministically generates new solution using some predefined rules in the region with higher objective function value. As the newly generated solution is in lower-dimensional space, these solutions are again projected back to higher dimensional space and then the objective function is evaluated at that point. The proposed IPGA is tested on three different categories of standard test functions viz. Unimodal function (2 Test Function), Unrotated Multimodal function (6 Test Function) and Rotated Multimodal function (5 Test Function). Simulation results were compared with that obtained using Binary Coded GA, Real Coded GA, recently proposed GA with Differential Evolution crossover operator (GA–DEx) and another success-history-based adaptive GA with aging mechanism (GA–aDEx SPS ) in terms of mean and standard deviation of the objective function, average number of objective function evaluation required to reach optima and algorithmic complexity. Simulation results clearly demonstrate better performance of the proposed IPGA when compared with other variants of GAs.

[1]  M. A. El-Shorbagy,et al.  A Hybridization of Sine Cosine Algorithm with Steady State Genetic Algorithm for Engineering Design Problems , 2019, AMLTA.

[2]  G. Andal Jayalakshmi,et al.  A Hybrid Genetic Algorithm - A New Approach to Solve Traveling Salesman Problem , 2001, Int. J. Comput. Eng. Sci..

[3]  Pethuru Raj,et al.  Adaptive fuzzy genetic algorithm for multi biometric authentication , 2019, Multimedia Tools and Applications.

[4]  Aizhu Zhang,et al.  A Hybrid Genetic Algorithm and Gravitational Search Algorithm for Global Optimization , 2015 .

[5]  Makoto Fukumoto,et al.  A Proposal for Intervention by User in Interactive Genetic Algorithm for Creation of Music Melody , 2013, 2013 International Conference on Biometrics and Kansei Engineering.

[6]  Andrei Zinovyev,et al.  Principal Manifolds for Data Visualization and Dimension Reduction , 2007 .

[7]  R. Chibante.  Simulated Annealing, Theory with Applications , 2010 .

[8]  Kalmanje Krishnakumar,et al.  Micro-Genetic Algorithms For Stationary And Non-Stationary Function Optimization , 1990, Other Conferences.

[9]  Hideyuki Takagi.  Active User Intervention in an EC Search , 2000 .

[10]  John Riedl,et al.  Application of Dimensionality Reduction in Recommender System - A Case Study , 2000 .

[11]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[12]  Shigenobu Kobayashi,et al.  A real-coded genetic algorithm using the unimodal normal distribution crossover , 2003 .

[13]  Michel Verleysen,et al.  Nonlinear Dimensionality Reduction , 2021, Computer Vision.

[14]  Ruhul A. Sarker,et al.  Analyzing the Simple Ranking and Selection Process for Constrained Evolutionary Optimization , 2008, Journal of Computer Science and Technology.

[15]  Andrew Knight.  Basics of MATLAB and Beyond , 1999 .

[16]  Mohamed Kurdi,et al.  A new hybrid island model genetic algorithm for job shop scheduling problem , 2015, Comput. Ind. Eng..

[17]  Olympia Roeva,et al.  Real-World Applications of Genetic Algorithms , 2012 .

[18]  Dimitri P. Bertsekas,et al.  Convex Optimization Algorithms , 2015 .

[19]  J. Michael Herrmann,et al.  A Review of No Free Lunch Theorems, and Their Implications for Metaheuristic Optimisation , 2018 .

[20]  Lazaros G. Papageorgiou,et al.  Fast genetic algorithm approaches to solving discrete-time mixed integer linear programming problems of capacity planning and scheduling of biopharmaceutical manufacture , 2019, Comput. Chem. Eng..

[21]  Kalyanmoy Deb,et al.  A Computationally Efficient Evolutionary Algorithm for Real-Parameter Optimization , 2002, Evolutionary Computation.

[22]  Sang-Hoon Park,et al.  The least‐squares meshfree method , 2001 .

[23]  Victor N. Kaliakin,et al.  Introduction to Approximate Solution Techniques, Numerical Modeling, and Finite Element Methods , 2001 .

[24]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[25]  M. Senthil Arumugam,et al.  New hybrid genetic operators for real coded genetic algorithm to compute optimal control of a class of hybrid systems , 2005, Appl. Soft Comput..

[26]  Hideyuki Takagi,et al.  Interactive evolutionary computation: fusion of the capabilities of EC optimization and human evaluation , 2001, Proc. IEEE.

[27]  Kalyanmoy Deb,et al.  Self-Adaptive Genetic Algorithms with Simulated Binary Crossover , 2001, Evolutionary Computation.

[28]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[29]  P. Subbaraj,et al.  Enhancement of Self-adaptive real-coded genetic algorithm using Taguchi method for Economic dispatch problem , 2011, Appl. Soft Comput..

[30]  Xiaoyan Sun,et al.  Interactive genetic algorithms with large population and semi-supervised learning , 2012, Appl. Soft Comput..

[31]  Robert G. Reynolds,et al.  An improved class of real-coded Genetic Algorithms for numerical optimization✰ , 2018, Neurocomputing.

[32]  Olli Nevalainen,et al.  Self-Adaptive Genetic Algorithm for Clustering , 2003, J. Heuristics.

[33]  A. J. Collins,et al.  Introduction To Multivariate Analysis , 1981 .

[34]  Anastasia Bezerianos,et al.  Evolutionary Visual Exploration: Evaluation of an IEC Framework for Guided Visual Search , 2017, Evolutionary Computation.

[35]  Hadi Gökçen,et al.  A multiple rule-based genetic algorithm for cost-oriented stochastic assembly line balancing problem , 2018, Assembly Automation.

[36]  Domagoj Jakobovic,et al.  Improving genetic algorithm performance by population initialisation with dispatching rules , 2019, Comput. Ind. Eng..

[37]  Sylvain Delisle,et al.  A meta-learning system based on genetic algorithms , 2004, SPIE Defense + Commercial Sensing.

[38]  Yong Wang,et al.  Hybrid Self-Adaptive Orthogonal Genetic Algorithm for Solving Global Optimization Problems: Hybrid Self-Adaptive Orthogonal Genetic Algorithm for Solving Global Optimization Problems , 2010 .

[39]  W. Shao,et al.  Improved self-adaptive genetic algorithm with quantum scheme for electromagnetic optimisation , 2014 .

[40]  Geoffrey C. Fox,et al.  A Hybrid Genetic Algorithm for Task Allocation in Multicomputers , 1991, ICGA.

[41]  Michal Pluhacek,et al.  A Review of Real-World Applications of Particle Swarm Optimization Algorithm , 2017 .

[42]  Wei Gao.  Study on New Improved Hybrid Genetic Algorithm , 2012 .

[43]  Anastasia Bezerianos,et al.  Evolutionary Visual Exploration: Evaluation With Expert Users , 2013, Comput. Graph. Forum.

[44]  Omid Bozorg-Haddad,et al.  Advanced Optimization by Nature-Inspired Algorithms , 2018 .

[45]  Hiroki Sayama,et al.  Hyperinteractive Evolutionary Computation , 2011, IEEE Transactions on Evolutionary Computation.

[46]  Ivan Zelinka,et al.  Handbook of Optimization - From Classical to Modern Approach , 2012, Handbook of Optimization.

[47]  Yiwen Wang,et al.  A new hybrid genetic algorithm based on chaos and PSO , 2009, 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[48]  Ruhul A. Sarker,et al.  A new genetic algorithm for solving optimization problems , 2014, Eng. Appl. Artif. Intell..

[49]  Hideyuki Takagi,et al.  Acceleration of EC convergence with landscape visualization and human intervention , 2002, Appl. Soft Comput..

[50]  Yuping Wang,et al.  A new hybrid genetic algorithm for job shop scheduling problem , 2012, Comput. Oper. Res..

[51]  Cai Zi-Xing,et al.  Hybrid Self-Adaptive Orthogonal Genetic Algorithm for Solving Global Optimization Problems , 2010 .

[52]  Per-Olof Persson,et al.  A Simple Mesh Generator in MATLAB , 2004, SIAM Rev..

[53]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[54]  Xishan Wen,et al.  A self-adaptive genetic algorithm to estimate JA model parameters considering minor loops , 2015 .

[55]  L. J. P. van der Maaten,et al.  An Introduction to Dimensionality Reduction Using Matlab , 2007 .

[56]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[57]  Ali AbdulKadhim Taher,et al.  Hybrid between Genetic Algorithm and Artificial Bee Colony for Key Generation Purpose , 2019 .

[58]  Gerardo W Flintsch,et al.  An adaptive hybrid genetic algorithm for pavement management , 2019 .

[59]  Hideyuki Takagi,et al.  Visualized IEC: interactive evolutionary computation with multidimensional data visualization , 2000, 2000 26th Annual Conference of the IEEE Industrial Electronics Society. IECON 2000. 2000 IEEE International Conference on Industrial Electronics, Control and Instrumentation. 21st Century Technologies.

[60]  O. Nelles,et al.  An Introduction to Optimization , 1996, IEEE Antennas and Propagation Magazine.

[61]  M. Yamamura,et al.  Multi-parent recombination with simplex crossover in real coded genetic algorithms , 1999 .