Parameter Tuning and Scientific Testing in Evolutionary Algorithms

Binnen algoritmes spelen parameter een belangrijke, maar vaak onderschatte rol. De instellingen van de parameter bepalen namelijk in grote mate de werking en daarmee de uitkomst van het algoritme. Je zou zelfs kunnen stellen dat ze bijna belangrijker zijn dan het model zelf, immers zonder goede instellingen werkt geen elke algoritme goed. Toch wordt dit tegenwoordig nog geregeld over het hoofd gezien en richt men zich vooral op het ontwikkelen van nieuwe algoritmes, in plaats van betere parameters. In dit proefschrift staat dan ook het hoe en waarom van het instellen van parameters centraal, specifiek binnen het vakgebied evolutionary algorithms. Evolutionary algorithms, parameter tuning en scientific testing blijken onlosmakelijk met elkaar verbonden.

[1]  Welch Bl.  THE GENERALIZATION OF ‘STUDENT'S’ PROBLEM WHEN SEVERAL DIFFERENT POPULATION VARLANCES ARE INVOLVED , 1947 .

[2]  Y. Rinott.  On two-stage selection procedures and related probability-inequalities , 1978 .

[3]  R. Shepard,et al.  Toward a universal law of generalization for psychological science. , 1987, Science.

[4]  Rajarshi Das,et al.  A Study of Control Parameters Affecting Online Performance of Genetic Algorithms for Function Optimization , 1989, ICGA.

[5]  In Schoenauer,et al.  Parallel Problem Solving from Nature , 1990, Lecture Notes in Computer Science.

[6]  Bruce W. Schmeiser,et al.  Chapter 7 Simulation experiments , 1990 .

[7]  Genichi Taguchi,et al.  Taguchi methods : design of experiments , 1993 .

[8]  Craig W. Reynolds.  Evolution of corridor following behavior in a noisy world , 1994 .

[9]  William M. Spears,et al.  Adapting Crossover in Evolutionary Algorithms , 1995, Evolutionary Programming.

[10]  Robert E. Smith,et al.  Adaptively Resizing Populations: Algorithm, Analysis, and First Results , 1993, Complex Syst..

[11]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[12]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[13]  Kwong-Sak Leung,et al.  A novel approach in parameter adaptation and diversity maintenance for genetic algorithms , 2003, Soft Comput..

[14]  N. Schraudolph,et al.  Dynamic Parameter Encoding for Genetic Algorithms , 1992, Machine Learning.

[15]  Thomas Philip Runarsson,et al.  Constrained Evolutionary Optimization by Approximate Ranking and Surrogate Models , 2004, PPSN.

[16]  Jason Maassen,et al.  Ibis: a flexible and efficient Java‐based Grid programming environment , 2005, Concurr. Pract. Exp..

[17]  Adrião Duarte Dória Neto,et al.  Logistic regression for parameter tuning on an evolutionary algorithm , 2005, 2005 IEEE Congress on Evolutionary Computation.

[18]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[19]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[20]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[21]  Jonathan E. Fieldsend,et al.  Multi-objective optimisation in the presence of uncertainty , 2005, 2005 IEEE Congress on Evolutionary Computation.

[22]  D. Kudenko,et al.  Sequential Experiment Designs for Screening and Tuning Parameters of Stochastic Heuristics , 2006 .

[23]  H. Jaap van den Herik,et al.  Rapid adaptation of video game AI , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[24]  K. Truong.  How does real affect affect affect recognition in speech , 2009 .

[25]  Riina Hannuli Vuorikari,et al.  Tags and self-organisation: a metadata ecology for learning resources in a multilingual context , 2009 .

[26]  Virginia N. L. Franqueira,et al.  Finding multi-step attacks in computer networks using heuristic search and mobile ambients , 2009 .

[27]  Mike Preuss.  Adaptability of Algorithms for Real-Valued Optimization , 2009, EvoWorkshops.

[28]  Volker Nannen.  Evolutionary Agent-Based Policy Analysis in Dynamic Environments , 2009 .

[29]  A. E. Eiben,et al.  Comparing parameter tuning methods for evolutionary algorithms , 2009, 2009 IEEE Congress on Evolutionary Computation.

[30]  Adriaan ter Mors,et al.  The world according to MARP , 2010 .

[31]  A. E. Eiben,et al.  Beating the ‘world champion’ evolutionary algorithm via REVAC tuning , 2010, IEEE Congress on Evolutionary Computation.

[32]  Selmar K. Smit,et al.  Avoiding simplification strategies by introducing multi-objectiveness in real world problems , 2010, 2010 10th International Conference on Intelligent Systems Design and Applications.

[33]  A. E. Eiben,et al.  An MOEA-based Method to Tune EA Parameters on Multiple Objective Functions , 2010, IJCCI.

[34]  Heike Trautmann,et al.  New Uncertainty Handling Strategies in Multi-objective Evolutionary Optimization , 2010, PPSN.

[35]  V. A. Pijpers.  e3alignment : Exploring Inter-Organizational Business ICT Alignment , 2010 .

[36]  A. E. Eiben,et al.  Using Entropy for Parameter Analysis of Evolutionary Algorithms , 2010, Experimental Methods for the Analysis of Optimization Algorithms.

[37]  S. W. van den Braak.  Sensemaking software for crime analysis , 2010 .

[38]  José Janssen,et al.  Paving the Way for Lifelong Learning. Facilitating competence development through a learning path specification , 2010 .

[39]  Sicco Verwer.  Efficient Identification of Timed Automata: Theory and practice , 2010 .

[40]  A. E. Eiben,et al.  Parameter Tuning of Evolutionary Algorithms: Generalist vs. Specialist , 2010, EvoApplications.

[41]  L. I. Terlouw,et al.  Modularization and Specification of Service-Oriented Systems , 2011 .

[42]  A. E. Eiben,et al.  Multi-Problem Parameter Tuning using BONESA , 2011 .

[43]  Viktor Clerc,et al.  Architectural Knowledge Management in Global Software Development , 2011 .

[44]  E. Broek.  Affective Signal Processing (ASP): Unraveling the mystery of emotions , 2011 .

[45]  Maaike Harbers,et al.  Explaining agent behavior in virtual training , 2011 .

[46]  A. E. Eiben,et al.  Population diversity index: a new measure for population diversity , 2011, GECCO.

[47]  Herman Stehouwer,et al.  Statistical langauge models for alternative sequence selection , 2011 .

[48]  Yujia Cao,et al.  Multimodal information presentation for high-load human computer interaction , 2011 .

[49]  C. N. V. D. Wal.  Social Agents: Agent-Based Modelling of Integrated Internal and Social Dynamics of Cognitive and Affective Processes , 2012 .

[50]  Jiyin He,et al.  Exploring topic structure: coherence, diversity and relatedness , 2012, SIGF.

[51]  M.G.A. Plomp,et al.  Maturing interorganisational information systems , 2012 .

[52]  David Smits,et al.  Towards a generic distributed adaptive hypermedia environment , 2012 .

[53]  Ali Bahramisharif.  Covert visual spatial attention : a robust paradigm for brain-computer interfacing , 2012 .

[54]  N. T. Kakeeto.  Relationship marketing for SMEs in Uganda , 2012 .