New feature selection method based on neural network and machine learning

Feature selection becomes the focus of much research in many areas of applications for which datasets with large number of features are available. Feature selection is a problem of choosing a subset of relevant features to increase the execution speed of the algorithm and the classification accuracy. It also removes inappropriate features to increase the precision and improve the performances. There has been much effort for solving the feature selection problem up to now and many researchers have proposed and developed many feature selection algorithms in this purpose. In this paper, we propose a new feature selection method based on neural network and machine learning. This new algorithm tends to highlight the best features among existing ones: new weighting-based method of the input features is used in the neural network to choose the best features. Performances show that this method selects the best features on simulated data.

[1]  Carsten Peterson,et al.  An introduction to artificial neural networks , 1991 .

[2]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[3]  Huan Liu,et al.  A Dilemma in Assessing Stability of Feature Selection Algorithms , 2011, 2011 IEEE International Conference on High Performance Computing and Communications.

[4]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[5]  Ethem Alpaydin,et al.  Introduction to machine learning , 2004, Adaptive computation and machine learning.

[6]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[7]  Larry A. Rendell,et al.  A Practical Approach to Feature Selection , 1992, ML.

[8]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[9]  Zachary Chase Lipton.  A Critical Review of Recurrent Neural Networks for Sequence Learning , 2015, ArXiv.

[10]  Kevin N. Gurney,et al.  An introduction to neural networks , 2018 .

[11]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[12]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[13]  Nils J. Nilsson,et al.  Introduction to Machine Learning , 2020, Machine Learning for iOS Developers.

[14]  Yuming Zhou,et al.  A Feature Subset Selection Algorithm Automatic Recommendation Method , 2013, J. Artif. Intell. Res..

[15]  Shai Ben-David,et al.  Understanding Machine Learning: From Theory to Algorithms , 2014 .

[16]  Rong Jin,et al.  Exclusive Lasso for Multi-task Feature Selection , 2010, AISTATS.

[17]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[18]  P. Bühlmann,et al.  The group lasso for logistic regression , 2008 .