Issues on GPU Parallel Implementation of Evolutionary High-Dimensional Multi-objective Feature Selection

The interest on applications that analyse large volumes of high dimensional data has grown recently. Many of these applications related to the so-called Big Data show different implicit parallelism that can benefit from the efficient use, in terms of performance and power consumption, of Graphics Processing Unit (GPU) accelerators. Although the GPU microarchitectures make possible the acceleration of applications by exploiting parallelism at different levels, the characteristics of their memory hierarchy and the location of GPUs as coprocessors require a careful organization of the memory access patterns and data transferences to get efficient speedups. This paper aims to take advantage of heterogeneous parallel codes on GPUs to accelerate evolutionary approaches in Electroencephalogram (EEG) classification and feature selection in the context of Brain Computer Interface (BCI) tasks. The results show the benefits of taking into account not only the data parallelism achievable by GPUs, but also the memory access patterns, in order to increase the speedups achieved by superscalar cores.

[1]  Alexander Mendiburu,et al.  A Survey of Performance Modeling and Simulation Techniques for Accelerator-Based Computing , 2015, IEEE Transactions on Parallel and Distributed Systems.

[2]  Jungwon Kim,et al.  A Performance Model for GPUs with Caches , 2015, IEEE Transactions on Parallel and Distributed Systems.

[3]  Hyesoon Kim,et al.  An analytical model for a GPU architecture with memory-level and thread-level parallelism awareness , 2009, ISCA '09.

[4]  Gernot R. Müller-Putz,et al.  Brain–Computer Interfaces and Assistive Technology , 2014 .

[5]  Enrique Alba,et al.  Parallel metaheuristics: recent advances and new trends , 2012, Int. Trans. Oper. Res..

[6]  Jesús González,et al.  Improving Memory Accesses for Heterogeneous Parallel Multi-objective Feature Selection on EEG Classification , 2016, Euro-Par Workshops.

[7]  Ujjwal Maulik,et al.  A Survey of Multiobjective Evolutionary Algorithms for Data Mining: Part I , 2014, IEEE Transactions on Evolutionary Computation.

[8]  Pedro Sequeira,et al.  OpenCL Implementations of a Genetic Algorithm for Feature Selection in Periocular Biometric Recognition , 2012, SEMCCO.

[9]  Olatz Arbelaitz,et al.  An extensive comparative study of cluster validity indices , 2013, Pattern Recognit..

[10]  J. Q. Gan,et al.  Multiresolution analysis over simple graphs for brain computer interfaces , 2013, Journal of neural engineering.

[11]  Pierre Collet Why GPGPUs for Evolutionary Computation? , 2013, Massively Parallel Evolutionary Computation on GPGPUs.

[12]  Richard Bellman,et al.  Adaptive Control Processes: A Guided Tour , 1961, The Mathematical Gazette.

[13]  Joshua D. Knowles,et al.  Feature subset selection in unsupervised learning via multiobjective optimization , 2006 .

[14]  Man Leung Wong,et al.  Data Mining Using Parallel Multi-objective Evolutionary Algorithms on Graphics Processing Units , 2013, Massively Parallel Evolutionary Computation on GPGPUs.

[15]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[16]  Pierre Collet,et al.  Implementation Techniques for Massively Parallel Multi-objective Optimization , 2013, Massively Parallel Evolutionary Computation on GPGPUs.

[17]  Julio Ortega Lopera,et al.  Leveraging cooperation for parallel multi‐objective feature selection in high‐dimensional EEG data , 2015, Concurr. Comput. Pract. Exp..

[18]  Kalyanmoy Deb,et al.  A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimisation: NSGA-II , 2000, PPSN.

[19]  Meichun Hsu,et al.  Clustering billions of data points using GPUs , 2009, UCHPC-MAW '09.

[20]  D. B. Kulkarni,et al.  Review for K-Means On Graphics Processing Units (GPU) , 2014 .

[21]  Norman Rubin,et al.  A new method for GPU based irregular reductions and its application to k-means clustering , 2011, GPGPU-4.

[22]  Michael Granitzer,et al.  Accelerating K-Means on the Graphics Processor via CUDA , 2009, 2009 First International Conference on Intensive Applications and Services.

[23]  Jesús González,et al.  Assessing Parallel Heterogeneous Computer Architectures for Multiobjective Feature Selection on EEG Classification , 2016, IWBBIO.