Computational Intelligence in Expensive Optimization Problems

In modern science and engineering, laboratory experiments are replaced by high fidelity and computationally expensive simulations. Using such simulations reduces costs and shortens development times but introduces new challenges to design optimization process. Examples of such challenges include limited computational resource for simulation runs, complicated response surface of the simulation inputs-outputs, and etc. Under such difficulties, classical optimization and analysis methods may perform poorly. This motivates the application of computational intelligence methods such as evolutionary algorithms, neural networks and fuzzy logic, which often perform well in such settings. This is the first book to introduce the emerging field of computational intelligence in expensive optimization problems. Topics covered include: dedicated implementations of evolutionary algorithms, neural networks and fuzzy logic. reduction of expensive evaluations (modelling, variable-fidelity, fitness inheritance), frameworks for optimization (model management, complexity control, model selection), parallelization of algorithms (implementation issues on clusters, grids, parallel machines), incorporation of expert systems and human-system interface, single and multiobjective algorithms, data mining and statistical analysis, analysis of real-world cases (such as multidisciplinary design optimization). The edited book provides both theoretical treatments and real-world insights gained by experience, all contributed by leading researchers in the respective fields. As such, it is a comprehensive reference for researchers, practitioners, and advanced-level students interested in both the theory and practice of using computational intelligence for expensive optimization problems.

[1]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[2]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[3]  Fred Glover,et al.  IMPROVED LINEAR PROGRAMMING MODELS FOR DISCRIMINANT ANALYSIS , 1990 .

[4]  J. S. Vesterstrom,et al.  Division of labor in particle swarm optimisation , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[5]  D. Winfield,et al.  Function Minimization by Interpolation in a Data Table , 1973 .

[6]  Kay Chen Tan,et al.  An investigation on evolutionary gradient search for multi-objective optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[7]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[8]  Thomas Philip Runarsson Ordinal Regression in Evolutionary Computation , 2006, PPSN.

[9]  Xin Yao,et al.  Stochastic ranking for constrained evolutionary optimization , 2000, IEEE Trans. Evol. Comput..

[10]  T. Gal,et al.  Multicriteria Decision Making: Advances in MCDM Models, Algorithms, Theory, and Applications , 2012 .

[11]  椹木 義一,et al.  Theory of multiobjective optimization , 1985 .

[12]  Xin Yao,et al.  Differential evolution for high-dimensional function optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[13]  S. Selcuk Erenguc,et al.  Survey of mathematical programming models and experimental results for linear discriminant analysis , 1990 .

[14]  F. Glover,et al.  Simple but powerful goal programming models for discriminant problems , 1981 .

[15]  Alain Ratle,et al.  Accelerating the Convergence of Evolutionary Algorithms by Fitness Landscape Approximation , 1998, PPSN.

[16]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[17]  Carlos Artemio Coello-Coello,et al.  Theoretical and numerical constraint-handling techniques used with evolutionary algorithms: a survey of the state of the art , 2002 .

[18]  Kalyanmoy Deb,et al.  Comparison of multi-modal optimization algorithms based on evolutionary algorithms , 2006, GECCO.

[19]  Tomasz Radzik,et al.  Solving the Biobjective Minimum Spanning Tree problem using a k-best algorithm , 2003 .

[20]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[21]  Janez Brest,et al.  Large Scale Global Optimization using Differential Evolution with self-adaptation and cooperative co-evolution , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[22]  Kay Chen Tan,et al.  An Investigation on Noisy Environments in Evolutionary Multiobjective Optimization , 2007, IEEE Transactions on Evolutionary Computation.

[23]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[24]  David W. Corne,et al.  A Powerful New Encoding for Tree-Based Combinatorial Optimisation Problems , 2004, PPSN.

[25]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[26]  R. S. Laundy,et al.  Multiple Criteria Optimisation: Theory, Computation and Application , 1989 .

[27]  Hirotaka Nakayama,et al.  Optimization for Black-box Objective Functions , 2006 .

[28]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[29]  Hirotaka Nakayama,et al.  Generating Support Vector Machines Using Multi-Objective Optimization and Goal Programming , 2006, Multi-Objective Machine Learning.

[30]  Nicholas J. Radcliffe,et al.  Forma Analysis and Random Respectful Recombination , 1991, ICGA.

[31]  Kalyanmoy Deb,et al.  MULTI-OBJECTIVE FUNCTION OPTIMIZATION USING NON-DOMINATED SORTING GENETIC ALGORITHMS , 1994 .

[32]  Hirotaka Nakayama,et al.  Satisficing Trade-off Method for Multiobjective Programming , 1984 .

[33]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[34]  Peng-Yeng Yin,et al.  A hybrid particle swarm optimization algorithm for optimal task assignment in distributed systems , 2006, Comput. Stand. Interfaces.

[35]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[36]  Hirotaka Nakayama,et al.  Aspiration Level Approach to Interactive Multi-Objective Programming and Its Applications , 1995 .

[37]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[38]  Douglas C. Montgomery,et al.  Response Surface Methodology: Process and Product Optimization Using Designed Experiments , 1995 .

[39]  B. Roy Méthodologie multicritère d'aide à la décision , 1985 .

[40]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.