A new intelligent artificial immune systems based ensemble for high-dimensional data clustering

This paper introduces a new ensemble based on different artificial immune algorithms and it is optimized by using a Particle Swarm algorithm. The new proposed architecture of the ensemble introduces a major enhancement to the data classification. The main focus of this paper is devoted for building an ensemble model that integrates three different AIS techniques towards achieving better classification results. A new AIS-based ensemble architecture with adaptive learning features is proposed by integrating different learning and adaptation techniques to overcome the limitations of the individual algorithms and to achieve synergistic effects through the combination of these techniques. Furthermore, a new method for measuring confidence level of AIS based classifier is introduced in this work as well. On the other hand and in order to enhance the overall performance of the classification process, an optimizer using particle swarm optimization algorithm is going to be adopted. The performance of the proposed ensemble is tested by running several experiments using different medical datasets.

[1]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[2]  Yi Lu,et al.  Knowledge integration in a multiple classifier system , 2004, Applied Intelligence.

[3]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[4]  Arthur Zimek,et al.  Clustering High-Dimensional Data , 2018, Data Clustering: Algorithms and Applications.

[5]  Michał Woźniak.  Chosen Applications of Hybrid Classifiers , 2014 .

[6]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[7]  Yangyang Li,et al.  A particle swarm optimization based simultaneous learning framework for clustering and classification , 2014, Pattern Recognit..

[8]  Leandro Nunes de Castro,et al.  aiNet: An Artificial Immune Network for Data Analysis , 2002 .

[9]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[10]  Eamonn J. Keogh,et al.  Curse of Dimensionality , 2010, Encyclopedia of Machine Learning.

[11]  Ira Assent,et al.  Clustering high dimensional data , 2012 .

[12]  Stefan Wermter,et al.  Hybrid classifiers based on semantic data subspaces for two-level text categorization , 2013, Int. J. Hybrid Intell. Syst..

[13]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[14]  Jan Holmgren,et al.  Mucosal immunity and vaccines , 2005, Nature Medicine.

[15]  Wenjun Zhou,et al.  Spectral clustering of high-dimensional data exploiting sparse representation vectors , 2014, Neurocomputing.

[16]  Blasé Gambino,et al.  Reflections on Accuracy , 2006, Journal of Gambling Studies.

[17]  Zhou Ji,et al.  Real-Valued Negative Selection Algorithm with Variable-Sized Detectors , 2004, GECCO.

[18]  Fakhri Karray,et al.  Soft Computing and Tools of Intelligent Systems Design: Theory and Applications , 2004 .

[19]  Cordelia Schmid,et al.  High-dimensional data clustering , 2006, Comput. Stat. Data Anal..

[20]  Zhou Ji,et al.  Artificial immune system (AIS) research in the last five years , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[21]  Stan Szpakowicz,et al.  Beyond Accuracy, F-Score and ROC: A Family of Discriminant Measures for Performance Evaluation , 2006, Australian Conference on Artificial Intelligence.

[22]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[23]  Ronaldo C. Prati,et al.  Constructing ensembles of symbolic classifiers , 2005, Fifth International Conference on Hybrid Intelligent Systems (HIS'05).

[24]  Xiaoli Z. Fern,et al.  Cluster Ensembles for High Dimensional Clustering: An Empirical Study , 2006 .

[25]  Fernando José Von Zuben,et al.  Learning and optimization using the clonal selection principle , 2002, IEEE Trans. Evol. Comput..

[26]  J.J. Jassbi,et al.  A Comparison of Mandani and Sugeno Inference Systems for a Space Fault Detection Application , 2006, 2006 World Automation Congress.

[27]  Samarjit Kar,et al.  Applications of neuro fuzzy systems: A brief review and future outline , 2014, Appl. Soft Comput..

[28]  Salah Al-Sharhan,et al.  ARTIFICIAL IMMUNE SYSTEMS - MODELS, ALGORITHMS AND APPLICATIONS , 2010 .

[29]  Mahamed G. H. Omran,et al.  A parameter-free barebones particle swarm algorithm for unsupervised pattern classification , 2012, Int. J. Hybrid Intell. Syst..