An OpenCL‐accelerated parallel immunodominance clone selection algorithm for feature selection

Immunodominance clone selection algorithm (ICSA) is a robust and effective metaheuristic method for feature selection problem. However, ICSA is usually slow in finding the optimal solution. In this paper, we propose a parallel immunodominance clone selection algorithm (PICSA) on Graphics Processing Unit (GPU) to improve the speedup of ICSA for feature selection problem. The parallel program can considerably accelerate the feature selection operator. The immunodominance operator, which efficiently connects the local and global information, makes the algorithm able to jump out of the local optimum easily and obtain the global optimum. When comparing with other parallel languages, Open Computing Language (OpenCL) has advantages both in efficiency and portability. Therefore, we use OpenCL to implement this algorithm on Intel many integrated core and different GPU platforms. Experiment results obtained using high‐dimensional UCI machine learning and image texture datasets demonstrate that the PICSA algorithm allows one to achieve good acceleration ratio while maintaining similar classification accuracy to serial ICSA program. Besides, the OpenCL‐based implementation of PICSA shows good portability on many integrated core and different GPU platforms as well. Copyright © 2016 John Wiley & Sons, Ltd.

[1]  Enrique Alba,et al.  Parallel metaheuristics: recent advances and new trends , 2012, Int. Trans. Oper. Res..

[2]  Grzegorz Dudek,et al.  An Artificial Immune System for Classification With Local Feature Selection , 2012, IEEE Transactions on Evolutionary Computation.

[3]  Kazuyuki Murase,et al.  A new local search based hybrid genetic algorithm for feature selection , 2011, Neurocomputing.

[4]  Antoni Wibowo,et al.  Review of state of the art for metaheuristic techniques in Academic Scheduling Problems , 2013, Artificial Intelligence Review.

[5]  Václav Snásel,et al.  Nature-Inspired Meta-Heuristics on Modern GPUs: State of the Art and Brief Survey of Selected Algorithms , 2013, International Journal of Parallel Programming.

[6]  Abdelghani Harrag,et al.  Nature-inspired feature subset selection application to arabic speaker recognition system , 2015, Int. J. Speech Technol..

[7]  Zheng Li-ping,et al.  Master-Slave Parallel Genetic Algorithm Framework on MPI , 2004 .

[8]  Jeffrey O. Kephart,et al.  A biologically inspired immune system for computers , 1994 .

[9]  Kazuyuki Murase,et al.  A new hybrid ant colony optimization algorithm for feature selection , 2012, Expert Syst. Appl..

[10]  Mohamed S. Kamel,et al.  Efficient greedy feature selection for unsupervised learning , 2012, Knowledge and Information Systems.

[11]  Asif Ekbal,et al.  Differential evolution-based feature selection technique for anaphora resolution , 2015, Soft Comput..

[12]  John D. Owens,et al.  GPU Computing , 2008, Proceedings of the IEEE.

[13]  David R. Kaeli,et al.  Heterogeneous Computing with OpenCL - Revised OpenCL 1.2 Edition , 2012 .

[14]  Alan S. Perelson,et al.  The immune system, adaptation, and machine learning , 1986 .

[15]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[16]  Pat Langley,et al.  Selection of Relevant Features and Examples in Machine Learning , 1997, Artif. Intell..

[17]  Stuart J. Russell,et al.  NP-Completeness of Searches for Smallest Possible Feature Sets , 1994 .

[18]  나극환,et al.  SAR(Synthetic Aperture Radar)시스템 요동보상기법 연구 , 2013 .

[19]  Petra Perner,et al.  Data Mining - Concepts and Techniques , 2002, Künstliche Intell..

[20]  El-Ghazali Talbi,et al.  GPU Computing for Parallel Local Search Metaheuristic Algorithms , 2013, IEEE Transactions on Computers.

[21]  Jack J. Dongarra,et al.  From CUDA to OpenCL: Towards a performance-portable solution for multi-platform GPU programming , 2012, Parallel Comput..

[22]  Pedro Sequeira,et al.  OpenCL Implementations of a Genetic Algorithm for Feature Selection in Periocular Biometric Recognition , 2012, SEMCCO.

[23]  Byung Ro Moon,et al.  Hybrid Genetic Algorithms for Feature Selection , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Qiang Shen,et al.  Nature inspired feature selection meta-heuristics , 2015, Artificial Intelligence Review.

[25]  Chi-Un Lei,et al.  CPU-GPU hybrid parallel binomial American option pricing , 2012 .

[26]  Helio J. C. Barbosa,et al.  Accelerated parallel genetic programming tree evaluation with OpenCL , 2013, J. Parallel Distributed Comput..

[27]  Gavin Brown,et al.  A scalable implementation of information theoretic feature selection for high dimensional data , 2015, 2015 IEEE International Conference on Big Data (Big Data).

[28]  Liangpei Zhang,et al.  Dimensionality Reduction Based on Clonal Selection for Hyperspectral Imagery , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Hugues Bersini,et al.  Hints for Adaptive Problem Solving Gleaned from Immune Networks , 1990, PPSN.

[30]  Demetris Stathakis,et al.  Feature Evolution for Classification of Remotely Sensed Data , 2007, IEEE Geoscience and Remote Sensing Letters.