A novel feature selection approach applied to underwater object classification

A novel filter method for feature selection is presented. In our research, we observed that the feature relevance measures in the literature evaluate the features for classification purposes only with respect to certain aspects, e.g. distance, information theory, etc. Accordingly, the resulting feature selections may only be adapted to a narrow range of classifiers. Our approach jointly considers two relevance measures, i.e. mutual information (MI) and Relief weight (RW) so that the features are assessed more comprehensively. It requires not only the selection to hold sufficient MI, it also forces the features in the selection to have large RWs. In order to avoid an NP hard problem, a heuristic searching scheme is adopted, i.e. sequential forward searching. Moreover, the selection's cardinality can be determined automatically. Finally, this approach is applied to the underwater object classification and its classification results are compared to those of filter methods in the literature.

[1]  Thierry Denoeux A k -Nearest Neighbor Classification Rule Based on Dempster-Shafer Theory , 2008, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[2]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[3]  Chong-Ho Choi,et al.  Input feature selection for classification problems , 2002, IEEE Trans. Neural Networks.

[4]  Larry A. Rendell,et al.  The Feature Selection Problem: Traditional Methods and a New Algorithm , 1992, AAAI.

[5]  J. Moody,et al.  Feature Selection Based on Joint Mutual Information , 1999 .

[6]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[7]  Azriel Rosenfeld,et al.  A Comparative Study of Texture Measures for Terrain Classification , 1975, IEEE Transactions on Systems, Man, and Cybernetics.

[8]  Y Y Tang,et al.  Feature Extraction by Wavelet Sub-Patterns and Divider Dimensions , 2000 .

[9]  Roberto Battiti,et al.  Using mutual information for selecting features in supervised neural net learning , 1994, IEEE Trans. Neural Networks.

[10]  David A. Bell,et al.  A Formalism for Relevance and Its Application in Feature Subset Selection , 2000, Machine Learning.

[11]  Kpalma Kidiyo,et al.  A Survey of Shape Feature Extraction Techniques , 2008 .

[12]  Donald F. Specht,et al.  Probabilistic neural networks , 1990, Neural Networks.

[13]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Kee Tung. Wong,et al.  Texture features for image classification and retrieval. , 2002 .