Baldwinian learning in clonal selection algorithm for optimization

Artificial immune systems are a kind of new computational intelligence methods which draw inspiration from the human immune system. Most immune system inspired optimization algorithms are based on the applications of clonal selection and hypermutation, and known as clonal selection algorithms. These clonal selection algorithms simulate the immune response process based on principles of Darwinian evolution by using various forms of hypermutation as variation operators. The generation of new individuals is a form of the trial and error process. It seems very wasteful not to make use of the Baldwin effect in immune system to direct the genotypic changes. In this paper, based on the Baldwin effect, an improved clonal selection algorithm, Baldwinian Clonal Selection Algorithm, termed as BCSA, is proposed to deal with optimization problems. BCSA evolves and improves antibody population by four operators, clonal proliferation, Baldwinian learning, hypermutation, and clonal selection. It is the first time to introduce the Baldwinian learning into artificial immune systems. The Baldwinian learning operator simulates the learning mechanism in immune system by employing information from within the antibody population to alter the search space. It makes use of the exploration performed by the phenotype to facilitate the evolutionary search for good genotypes. In order to validate the effectiveness of BCSA, eight benchmark functions, six rotated functions, six composition functions and a real-world problem, optimal approximation of linear systems are solved by BCSA, successively. Experimental results indicate that BCSA performs very well in solving most of the test problems and is an effective and robust algorithm for optimization.

[1]  Simon M. Garrett,et al.  How Do We Evaluate Artificial Immune Systems? , 2005, Evolutionary Computation.

[2]  Alan S. Perelson,et al.  Self-nonself discrimination in a computer , 1994, Proceedings of 1994 IEEE Computer Society Symposium on Research in Security and Privacy.

[3]  Jing J. Liang,et al.  Evaluation of Comprehensive Learning Particle Swarm Optimizer , 2004, ICONIP.

[4]  Harry Wechsler,et al.  Visual routines for eye location using learning and evolution , 2000, IEEE Trans. Evol. Comput..

[5]  Fernando José Von Zuben,et al.  Learning and optimization using the clonal selection principle , 2002, IEEE Trans. Evol. Comput..

[6]  Licheng Jiao,et al.  A novel genetic algorithm based on immunity , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[7]  John A. Bullinaria Exploring the Baldwin Effect in Evolving Adaptable Control Systems , 2000, NCPW.

[8]  David G. Stork,et al.  Evolution and Learning in Neural Networks: The Number and Distribution of Learning Trials Affect the Rate of Evolution , 1990, NIPS 1990.

[9]  Michal Bereta,et al.  Immune K-means and negative selection algorithms for data analysis , 2009, Inf. Sci..

[10]  Guan-Chun Luh,et al.  A multi-modal immune algorithm for the job-shop scheduling problem , 2009, Inf. Sci..

[11]  D. Dasgupta,et al.  A formal model of an artificial immune system. , 2000, Bio Systems.

[12]  Weicai Zhong,et al.  A multiagent genetic algorithm for global numerical optimization , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Yoshiteru Ishida Fully distributed diagnosis by PDP learning algorithm: towards immune network PDP model , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[14]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[15]  Yuping Wang,et al.  An orthogonal genetic algorithm with quantization for global numerical optimization , 2001, IEEE Trans. Evol. Comput..

[16]  J. Baldwin A New Factor in Evolution , 1896, The American Naturalist.

[17]  Jonathan Timmis,et al.  Artificial immune systems - a new computational intelligence paradigm , 2002 .

[18]  Fernando José Von Zuben,et al.  BAIS: A Bayesian Artificial Immune System for the effective handling of building blocks , 2009, Inf. Sci..

[19]  Luigi Fortuna,et al.  Model Order Reduction Techniques with Applications in Electrical Engineering , 1992 .

[20]  Jonathan Timmis,et al.  Artificial Immune Systems: A New Computational Intelligence Approach , 2003 .

[21]  Yangyang Li,et al.  Quantum-Inspired Immune Clonal Algorithm for Global Optimization , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Maoguo Gong,et al.  Optimal approximation of linear systems by artificial immune response , 2005, Science in China Series F.

[23]  H.,et al.  The Immune System as a Model for Pattern Recognition and Classification , 1999 .

[24]  Geoffrey E. Hinton,et al.  How Learning Can Guide Evolution , 1996, Complex Syst..

[25]  Diego Federici,et al.  Culture and the Baldwin Effect , 2003, ECAL.

[26]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[27]  Maoguo Gong,et al.  A population-based artificial immune system for numerical optimization , 2008, Neurocomputing.

[28]  Jun He,et al.  A hybrid artificial immune system and Self Organising Map for network intrusion detection , 2008, Inf. Sci..

[29]  D. Dasgupta,et al.  Combining negative selection and classification techniques for anomaly detection , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[30]  L. Darrell Whitley,et al.  Lamarckian Evolution, The Baldwin Effect and Function Optimization , 1994, PPSN.

[31]  Kevin Kok Wai Wong,et al.  Classification of adaptive memetic algorithms: a comparative study , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[32]  Chyi Hwang,et al.  Optimal approximation of linear systems by a differential evolution algorithm , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[33]  Jing J. Liang,et al.  Novel composition test functions for numerical global optimization , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[34]  B. C. Brookes,et al.  Information Sciences , 2020, Cognitive Skills You Need for the 21st Century.

[35]  David H. Ackley,et al.  Interactions between learning and evolution , 1991 .

[36]  T. Fukuda,et al.  Immune Networks Using Genetic Algorithm for Adaptive Production Scheduling , 1993 .

[37]  C. Janeway Immunobiology: The Immune System in Health and Disease , 1996 .

[38]  Jonathan Timmis,et al.  Immune Inspired Somatic Contiguous Hypermutation for Function Optimisation , 2003, GECCO.

[39]  Jianping Wu,et al.  A robust scheduling method based on a multi-objective immune algorithm , 2009, Inf. Sci..

[40]  Peter D. Turney How to Shift Bias: Lessons from the Baldwin Effect , 1996, Evolutionary Computation.

[41]  C. Hwang,et al.  Optimal reduced-order models for unstable and nonminimum-phase systems , 1996 .

[42]  Krzysztof Trojanowski,et al.  Immune-based algorithms for dynamic optimization , 2009, Inf. Sci..

[43]  Robert M. French,et al.  Connectionist Models of Learning, Development and Evolution , 2001, Perspectives in Neural Computing.

[44]  Zhou Ji,et al.  V-detector: An efficient negative selection algorithm with "probably adequate" detector coverage , 2009, Inf. Sci..

[45]  J Timmis,et al.  An artificial immune system for data analysis. , 2000, Bio Systems.

[46]  Maoguo Gong,et al.  Multiobjective Immune Algorithm with Nondominated Neighbor-Based Selection , 2008, Evolutionary Computation.

[47]  Vincenzo Cutello,et al.  Exploring the Capability of Immune Algorithms: A Characterization of Hypermutation Operators , 2004, ICARIS.

[48]  Shinn-Ying Ho,et al.  Intelligent evolutionary algorithms for large parameter optimization problems , 2004, IEEE Trans. Evol. Comput..

[49]  Du Hai-feng,et al.  Optimal approximation of linear systems by artificial immune response , 2006 .

[50]  F. Burnet The clonal selection theory of acquired immunity , 1959 .