Interactive genetic algorithms with large population and semi-supervised learning

Interactive genetic algorithms are effective methods of solving optimization problems with implicit (qualitative) criteria by incorporating a user's intelligent evaluation into traditional evolution mechanisms. The heavy evaluation burden of the user, however, is crucial and limits their applications in complex optimization problems. We focus on reducing the evaluation burden by presenting a semi-supervised learning assisted interactive genetic algorithm with large population. In this algorithm, a population with many individuals is adopted to efficiently explore the search space. A surrogate model built with an improved semi-supervised learning method is employed to evaluate a part of individuals instead of the user to alleviate his/her burden in evaluation. Incorporated with the principles of the improved semi-supervised learning, the opportunities of applying and updating the surrogate model are determined by its confidence degree in estimation, and the informative individuals reevaluated by the user are selected according to the concept of learning from mistakes. We quantitatively analyze the performance of the proposed algorithm and apply it to the design of sunglasses lenses, a representative optimization problem with one qualitative criterion. The empirical results demonstrate the strength of our algorithm in searching for satisfactory solutions and easing the evaluation burden of the user.

[1]  Zhi-Hua Zhou,et al.  Semi-Supervised Regression with Co-Training Style Algorithms , 2007 .

[2]  Ji-Hyun Lee,et al.  Stimulating designers' creativity based on a creative evolutionary system and collective intelligence in product design , 2010 .

[3]  Guo Yinan Interactive genetic algorithms with multiple approximate models , 2008 .

[4]  Rayid Ghani,et al.  Analyzing the effectiveness and applicability of co-training , 2000, CIKM '00.

[5]  Hideyuki Takagi,et al.  User Fatigue Reduction by an Absolute Rating Data-trained Predictor in IEC , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[6]  Sung-Bae Cho,et al.  Application of interactive genetic algorithm to fashion design , 2000 .

[7]  Christine A. Shoemaker,et al.  Local function approximation in evolutionary algorithms for the optimization of costly functions , 2004, IEEE Transactions on Evolutionary Computation.

[8]  Samy Bengio,et al.  Semi-Supervised Kernel Methods for Regression Estimation , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[9]  Parag Kulkarni,et al.  A Survey of Semi-Supervised Learning Methods , 2008, 2008 International Conference on Computational Intelligence and Security.

[10]  Martin D. Buhmann,et al.  Radial Basis Functions , 2021, Encyclopedia of Mathematical Geosciences.

[11]  Zhi-Hua Zhou,et al.  Analyzing Co-training Style Algorithms , 2007, ECML.

[12]  Jie Yuan,et al.  Interactive genetic algorithms with large population size , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[13]  Xavier Llorà,et al.  Graph-theoretic measure for active iGAs: interaction sizing and parallel evaluation ensemble , 2008, GECCO '08.

[14]  Hideyuki Takagi,et al.  Interactive evolutionary computation: fusion of the capabilities of EC optimization and human evaluation , 2001, Proc. IEEE.

[15]  Xiaojin Zhu,et al.  Introduction to Semi-Supervised Learning , 2009, Synthesis Lectures on Artificial Intelligence and Machine Learning.

[16]  Xavier Llorà,et al.  Efficient Interactive Weight Tuning For Tts Synthesis: Reducing User Fatigue By Improving User Consistency , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[17]  Zhi-Hua Zhou,et al.  Semisupervised Regression with Cotraining-Style Algorithms , 2007, IEEE Transactions on Knowledge and Data Engineering.

[18]  李扬,et al.  Innovative Batik Design with an Interactive Evolutionary Art System , 2009 .

[19]  R. Dawkins The Blind Watchmaker , 1986 .

[20]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[21]  Xiaoyan Sun,et al.  Interactive Genetic Algorithms with Variational Population Size , 2009, ICIC.

[22]  Miho Ohsaki,et al.  Interactive Evolutionary Computation-Based Hearing Aid Fitting , 2007, IEEE Transactions on Evolutionary Computation.

[23]  Peter G. Anderson,et al.  Neural network fitness functions for a musical IGA , 1996 .

[24]  Martin D. Buhmann Radial Basis Functions: Theory and Implementations: Radial basis functions with compact support , 2003 .

[25]  Mikhail Belkin,et al.  Beyond the point cloud: from transductive to semi-supervised learning , 2005, ICML.

[26]  Sung-Bae Cho,et al.  An efficient genetic algorithm with less fitness evaluation by clustering , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[27]  Fujihara Nobuhiko Dynamic knowledge interaction in human cognition , 2000, KES'2000. Fourth International Conference on Knowledge-Based Intelligent Engineering Systems and Allied Technologies. Proceedings (Cat. No.00TH8516).

[28]  Meghna Babbar-Sebens,et al.  A Case-Based Micro Interactive Genetic Algorithm (CBMIGA) for interactive learning and search: Methodology and application to groundwater monitoring design , 2010, Environ. Model. Softw..