Efficiency of New Feature Selection Method Based on Neural Network

In order to monitor a system, the number of measurements and features gathered can be huge. But it is desirable to keep only the important features to reduce the processing demand. The problem is therefore to select a subset of features to obtain the best possible classification performance. In this purpose, many feature selection algorithms have been proposed. In a previous work, we have proposed a new feature selection method inspired by neural network and machine learning. This new method selects the best features using sparse weights of the input features in the neural network. In this paper, we study the performance of this method on simulated data.

[1]  Yuming Zhou,et al.  A Feature Subset Selection Algorithm Automatic Recommendation Method , 2013, J. Artif. Intell. Res..

[2]  Heng Tao Shen,et al.  Dimensionality Reduction , 2009, Encyclopedia of Database Systems.

[3]  Shai Ben-David,et al.  Understanding Machine Learning: From Theory to Algorithms , 2014 .

[4]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[5]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[6]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[7]  Nils J. Nilsson,et al.  Introduction to Machine Learning , 2020, Machine Learning for iOS Developers.

[8]  Rong Jin,et al.  Exclusive Lasso for Multi-task Feature Selection , 2010, AISTATS.

[9]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[10]  P. Bühlmann,et al.  The group lasso for logistic regression , 2008 .

[11]  Larry A. Rendell,et al.  A Practical Approach to Feature Selection , 1992, ML.

[12]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..