Parallel Cooperation for Large-Scale Multiobjective Optimization on Feature Selection Problems

Recently, the interest on multiobjective optimization problems with a large number of decision variables has grown since many significant real problems, for example on machine learning and pattern recognition, imply to process patterns with a high number of components (features). This paper deals with parallel multiobjective optimization on high-dimensional feature selection problems. Thus, several parallel multiobjective evolutionary alternatives based on the cooperation of subpopulations are proposed and experimentally evaluated by using some synthetic and BCI (Brain-Computer Interface) benchmarks. The results obtained show different improvements achieved in the solution quality and speedups, depending on the parallel alternative and benchmark profile. Some alternatives even provide superlinear speedups with only small reductions in the solution quality.

[1]  Nachol Chaiyaratana,et al.  Multi-objective Co-operative Co-evolutionary Genetic Algorithm , 2002, PPSN.

[2]  Kalyanmoy Deb,et al.  A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimisation: NSGA-II , 2000, PPSN.

[3]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[4]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[5]  Kotaro Hirasawa,et al.  Genetic symbiosis algorithm for multiobjective optimization problem , 2000, Proceedings 9th IEEE International Workshop on Robot and Human Interactive Communication. IEEE RO-MAN 2000 (Cat. No.00TH8499).

[6]  Nurettin Acir,et al.  An Application of Support Vector Machine in Bioinformatics: Automated Recognition of Epileptiform Patterns in EEG Using SVM Classifier Designed by a Perturbation Method , 2004, ADVIS.

[7]  Anil K. Jain,et al.  Small Sample Size Effects in Statistical Pattern Recognition: Recommendations for Practitioners , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[9]  Xiaodong Li,et al.  A Cooperative Coevolutionary Multiobjective Algorithm Using Non-dominated Sorting , 2004, GECCO.

[10]  Carlos A. Coello Coello,et al.  A Study of Multiobjective Metaheuristics When Solving Parameter Scalable Problems , 2010, IEEE Transactions on Evolutionary Computation.

[11]  Kay Chen Tan,et al.  A Coevolutionary Paradigm for Dynamic Multi-Objective Optimization , 2009 .

[12]  Kay Chen Tan,et al.  A distributed Cooperative coevolutionary algorithm for multiobjective optimization , 2006, IEEE Transactions on Evolutionary Computation.

[13]  Enrique Alba,et al.  Parallel evolutionary algorithms can achieve super-linear performance , 2002, Inf. Process. Lett..

[14]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[15]  Carlos A. Coello Coello,et al.  Use of cooperative coevolution for solving large scale multiobjective optimization problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[16]  Carlos A. Coello Coello,et al.  A coevolutionary multi-objective evolutionary algorithm , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[17]  Pedro Larrañaga,et al.  A review of feature selection techniques in bioinformatics , 2007, Bioinform..

[18]  Pascal Bouvry,et al.  Achieving super-linear performance in parallel multi-objective evolutionary algorithms by means of cooperative coevolution , 2013, Comput. Oper. Res..

[19]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[20]  Stan Matwin,et al.  Parallelizing Feature Selection , 2006, Algorithmica.

[21]  Kittipong Boonlong,et al.  Multi-objective Optimisation by Co-operative Co-evolution , 2004, PPSN.

[22]  Zhanquan Sun.  Parallel Feature Selection Based on MapReduce , 2014 .

[23]  Joshua D. Knowles,et al.  Feature subset selection in unsupervised learning via multiobjective optimization , 2006 .

[24]  Julio Ortega Lopera,et al.  Feature selection in high-dimensional EEG data by parallel multi-objective optimization , 2014, 2014 IEEE International Conference on Cluster Computing (CLUSTER).

[25]  Zheng Zhao,et al.  Massively parallel feature selection: an approach based on variance preservation , 2012, Machine Learning.