Performance Analysis on Knee Point Selection Methods for Multi-Objective Sparse Optimization Problems

Some multi-objective evolutionary algorithms have been introduced to solve sparse optimization problems in recent years. These multi-objective sparse optimization algorithms obtain a set of solutions with different sparsities. However, for a specific sparse optimization problem, a unique sparse solution should be selected from the whole Pareto Set (PS). Usually, knee point in the PF is a preferred solution if the decision maker has no special preference. An effective knee point selection method plays a pivotal role in multi-objective sparse optimization. In this paper, a study on the knee point selection methods in multiobjective sparse optimization problems has been done. Three knee point selection methods, which are angle-based method, the weighted sum of objective values method and the distance to the extreme line method, are compared and the experimental results indicate that the second method is better than the others. Finally, an analysis of parameter in the best knee point selection method is conducted and an optimal setting range of parameters is given.

[1]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[2]  Allen Y. Yang,et al.  Fast ℓ1-minimization algorithms and an application in robust face recognition: A review , 2010, 2010 IEEE International Conference on Image Processing.

[3]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[4]  Fang Liu,et al.  Compressive Sensing SAR Image Reconstruction Based on Bayesian Framework and Evolutionary Computation , 2011, IEEE Transactions on Image Processing.

[5]  Zongben Xu,et al.  $L_{1/2}$ Regularization: A Thresholding Representation Theory and a Fast Solver , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Qingfu Zhang,et al.  A multi-phase multiobjective approach based on decomposition for sparse reconstruction , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[7]  Ye Tian,et al.  A Knee Point-Driven Evolutionary Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[8]  Zhifeng Zhang,et al.  Adaptive Nonlinear Approximations , 1994 .

[9]  Guillermo Sapiro,et al.  Sparse Representation for Computer Vision and Pattern Recognition , 2010, Proceedings of the IEEE.

[10]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[11]  Indraneel Das On characterizing the “knee” of the Pareto curve based on Normal-Boundary Intersection , 1999 .

[12]  Lily Rachmawati,et al.  Multiobjective Evolutionary Algorithm With Controllable Focus on the Knees of the Pareto Front , 2009, IEEE Transactions on Evolutionary Computation.

[13]  Kalyanmoy Deb,et al.  Multi-Objective Evolutionary Algorithms , 2015, Handbook of Computational Intelligence.

[14]  Qingfu Zhang,et al.  MOEA/D with Iterative Thresholding Algorithm for Sparse Optimization Problems , 2012, PPSN.

[15]  Qi Zhao,et al.  A hybrid evolutionary algorithm for multiobjective sparse reconstruction , 2017, Signal, Image and Video Processing.

[16]  Kalyanmoy Deb,et al.  Finding Knees in Multi-objective Optimization , 2004, PPSN.

[17]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[18]  Maoguo Gong,et al.  A Multiobjective Sparse Feature Learning Model for Deep Neural Networks , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Yong Wang,et al.  A Multiobjective Optimization-Based Evolutionary Algorithm for Constrained Optimization , 2006, IEEE Transactions on Evolutionary Computation.

[20]  Yinghuan Shi,et al.  A learning-based CT prostate segmentation method via joint transductive feature selection and regression , 2016, Neurocomputing.

[21]  Xin Yao,et al.  An Evolutionary Multiobjective Approach to Sparse Reconstruction , 2014, IEEE Transactions on Evolutionary Computation.