Generating Compact Classifier Systems Using a Simple Artificial Immune System

Current artificial immune system (AIS) classifiers have two major problems: 1) their populations of B-cells can grow to huge proportions, and 2) optimizing one B-cell (part of the classifier) at a time does not necessarily guarantee that the B-cell pool (the whole classifier) will be optimized. In this paper, the design of a new AIS algorithm and classifier system called simple AIS is described. It is different from traditional AIS classifiers in that it takes only one B-cell, instead of a B-cell pool, to represent the classifier. This approach ensures global optimization of the whole system, and in addition, no population control mechanism is needed. The classifier was tested on seven benchmark data sets using different classification techniques and was found to be very competitive when compared to other classifiers.

[1]  R. Malhotra,et al.  Evaluating Consumer Loans Using Neural Networks , 2001 .

[2]  Dipankar Dasgupta,et al.  Novelty detection in time series data using ideas from immunology , 1996 .

[3]  Jonathan Timmis,et al.  Artificial immune systems as a novel soft computing paradigm , 2003, Soft Comput..

[4]  J Timmis,et al.  An artificial immune system for data analysis. , 2000, Bio Systems.

[5]  R. Gershon,et al.  "Clonal selection and after," and after. , 1979, The New England journal of medicine.

[6]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[7]  David W. Aha,et al.  Instance-Based Learning Algorithms , 1991, Machine Learning.

[8]  Guoqiang Peter Zhang,et al.  Neural networks for classification: a survey , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[9]  Liangpei Zhang,et al.  An unsupervised artificial immune classifier for multi/hyperspectral remote sensing imagery , 2006, IEEE Trans. Geosci. Remote. Sens..

[10]  Alper Döyen,et al.  A new approach to solve hybrid flow shop scheduling problems by artificial immune system , 2004, Future Gener. Comput. Syst..

[11]  D. Dasgupta,et al.  A formal model of an artificial immune system. , 2000, Bio Systems.

[12]  Jonathan Timmis,et al.  Artificial Immune Recognition System (AIRS): An Immune-Inspired Supervised Learning Algorithm , 2004, Genetic Programming and Evolvable Machines.

[13]  V. Srinivasan,et al.  Credit Granting: A Comparative Analysis of Classification Procedures , 1987 .

[14]  Jonathan Timmis,et al.  Artificial Immune Systems : Using the Immune System as Inspiration for Data Mining , 2001 .

[15]  Jerne Nk.  Towards a network theory of the immune system. , 1974 .

[16]  Jerzy W. Grzymala-Busse,et al.  A Comparison of Several Approaches to Missing Attribute Values in Data Mining , 2000, Rough Sets and Current Trends in Computing.

[17]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[18]  Andrew Watkins,et al.  Exploiting immunological metaphors in the development of serial, parallel and distributed learning algorithms , 2005 .

[19]  Jonathan Timmis,et al.  A resource limited artificial immune system for data analysis , 2001, Knowl. Based Syst..

[20]  David J. Hand,et al.  Statistical Classification Methods in Consumer Credit Scoring: a Review , 1997 .

[21]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[22]  Alan S. Perelson,et al.  The immune system, adaptation, and machine learning , 1986 .

[23]  Fernando José Von Zuben,et al.  Learning and optimization using the clonal selection principle , 2002, IEEE Trans. Evol. Comput..

[24]  D. Ruppert.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[25]  Leandro Nunes de Castro,et al.  The Clonal Selection Algorithm with Engineering Applications 1 , 2000 .

[26]  A. Perelson.  Immune Network Theory , 1989, Immunological reviews.

[27]  Saeid Nahavandi,et al.  Learning to detect texture objects by artificial immune approaches , 2004, Future Gener. Comput. Syst..

[28]  John Hunt,et al.  Augmenting an artificial immune network , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[29]  Jonathan Crook,et al.  Credit Scoring Models in the Credit Union Environment Using Neural Networks and Genetic Algorithms , 1997 .

[30]  John E. Hunt,et al.  An adaptive, distributed learning system based on the immune system , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[31]  Simon M. Garrett,et al.  Improved Pattern Recognition with Artificial Clonal Selection? , 2003, ICARIS.

[32]  A. B. Watkins,et al.  A resource limited artificial immune classifier , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[33]  Herbert S. Wilf.  Algorithms and complexity (2. ed.) , 2002 .

[34]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[35]  Tony R. Martinez,et al.  Improved Heterogeneous Distance Functions , 1996, J. Artif. Intell. Res..

[36]  Andrew M. Tyrrell,et al.  Immunotronics: Hardware Fault Tolerance Inspired by the Immune System , 2000, ICES.

[37]  C. Janeway.  Immunobiology: The Immune System in Health and Disease , 1996 .

[38]  John E. Hunt,et al.  Learning using an artificial immune system , 1996 .

[39]  Fabio A. González,et al.  An Novel Artificial Immune System Approach to Robust Data Mining , 2002, GECCO Late Breaking Papers.

[40]  Dipankar Dasgupta,et al.  Immunity-Based Intrusion Detection System: A General Framework , 1999 .

[41]  Peter Ross,et al.  Exploiting the Analogy between the Immune System and Sparse Distributed Memories , 2003, Genetic Programming and Evolvable Machines.

[42]  Herbert S. Wilf,et al.  Algorithms and Complexity , 1994, Lecture Notes in Computer Science.

[43]  Graham P. Cook,et al.  Immunobiology: The Immune System in Health and Disease (4th edn) by C.A. Janeway, P. Travers, M. Walport and J.D. Capra , 2000 .

[44]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[45]  Mark Neal,et al.  An artificial immune system for continuous analysis of time-varying data , 2002 .