Fuzzy-rough feature selection aided support vector machines for Mars image classification

This paper presents a novel application of advanced machine learning techniques for Mars terrain image classification. Fuzzy-rough feature selection (FRFS) is adapted and then employed in conjunction with Support Vector Machines (SVMs) to construct image classifiers. These techniques are integrated to address problems in space engineering where the images are of many classes, large-scale, and diverse representational properties. The use of the adapted FRFS allows the induction of low-dimensionality feature sets from feature patterns of a much higher dimensionality. To evaluate the proposed work, K-Nearest Neighbours (KNNs) and decision trees (DTREEs) based image classifiers as well as information gain rank (IGR) based feature selection are also investigated here, as possible alternatives to the underlying machine learning techniques adopted. The results of systematic comparative studies demonstrate that in general, feature selection improves the performance of classifiers that are intended for use in high dimensional domains. In particular, the proposed approach helps to increase the classification accuracy, while enhancing classification efficiency by requiring considerably less features. This is evident in that the resultant SVM-based classifiers which utilise FRFS-selected features generally outperform KNN and DTREE based classifiers and those which use IGR-returned features. The work is therefore shown to be of great potential for on-board or ground-based image classification in future Mars rover missions.

[1]  Changjing Shang,et al.  Combining support vector machines and information gain ranking for classification of mars McMurdo panorama images , 2010, 2010 IEEE International Conference on Image Processing.

[2]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[3]  Roberto Brunelli,et al.  Template Matching Techniques in Computer Vision: Theory and Practice , 2009 .

[4]  Ke Huang,et al.  Wavelet Feature Selection for Image Classification , 2008, IEEE Transactions on Image Processing.

[5]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[6]  Issa A. D. Nesnas,et al.  Rover-Based Visual Target Tracking Validation and Mission Infusion , 2005 .

[7]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[9]  Tossaporn Kachanubal,et al.  Rock Textures Classification Based on Textural and Spectral Features , 2008 .

[10]  David G. Stork,et al.  Pattern Classification , 1973 .

[11]  Peter E. Hart,et al.  How the Hough Transform Was Invented , 2009 .

[12]  Domenec Puig,et al.  Automatic texture feature selection for image pixel classification , 2006, Pattern Recognit..

[13]  Janusz Zalewski,et al.  Rough sets: Theoretical aspects of reasoning about data , 1996 .

[14]  Tony Lindeberg,et al.  Edge Detection and Ridge Detection with Automatic Scale Selection , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Qiang Shen,et al.  Facilitating efficient Mars terrain image classification with fuzzy-rough feature selection , 2011, Int. J. Hybrid Intell. Syst..

[16]  Gert de Cooman,et al.  A behavioural model for vague probability assessments , 2005, Fuzzy Sets Syst..

[17]  Soo-Young Lee,et al.  Efficient feature selection based on information gain criterion for face recognition , 2007, 2007 International Conference on Information Acquisition.

[18]  Andrzej Skowron,et al.  Rudiments of rough sets , 2007, Inf. Sci..

[19]  Qiang Shen,et al.  Feature Selection With Harmony Search , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  A. F. C. Haldemann,et al.  Pyroclastic Activity at Home Plate in Gusev Crater, Mars , 2007, Science.

[21]  D.R. Thompson,et al.  Performance Comparison of Rock Detection Algorithms for Autonomous Planetary Geology , 2007, 2007 IEEE Aerospace Conference.

[22]  John Platt,et al.  Fast training of svms using sequential minimal optimization , 1998 .

[23]  R. Castano,et al.  Current results from a rover science data analysis system , 2005, 2005 IEEE Aerospace Conference.

[24]  P.E. Hart,et al.  How the Hough transform was invented [DSP History] , 2009, IEEE Signal Processing Magazine.

[25]  Qiang Shen,et al.  Semantics-preserving dimensionality reduction: rough and fuzzy-rough-based approaches , 2004, IEEE Transactions on Knowledge and Data Engineering.

[26]  Qiang Shen,et al.  Are More Features Better? A Response to Attributes Reduction Using Fuzzy Rough Sets , 2009, IEEE Transactions on Fuzzy Systems.

[27]  Qiang Shen,et al.  Computational Intelligence and Feature Selection - Rough and Fuzzy Approaches , 2008, IEEE Press series on computational intelligence.

[28]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[30]  Patrick Haffner,et al.  Support vector machines for histogram-based image classification , 1999, IEEE Trans. Neural Networks.

[31]  Mark Woods,et al.  Terrain Adaptive Navigation for planetary rovers , 2009 .

[32]  E. Newport,et al.  Science Current Directions in Psychological Statistical Learning : from Acquiring Specific Items to Forming General Rules on Behalf Of: Association for Psychological Science , 2022 .

[33]  Qiang Shen,et al.  Are More Features Better? A Response to Attributes Reduction Using Fuzzy Rough Sets , 2009, IEEE Transactions on Fuzzy Systems.

[34]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[35]  Qiang Shen,et al.  New Approaches to Fuzzy-Rough Feature Selection , 2009, IEEE Transactions on Fuzzy Systems.

[36]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.