Feature Selection and Ranking for Pattern Classification in Wireless Sensor Networks

Feature selection is a classical problem in the discipline of pattern recognition, for which many solutions have been proposed in the literature. In the current paper we consider feature selection in the context of pattern classification in wireless sensor networks. One of the main objectives in the design of wireless sensor networks is to keep the energy consumption of sensors low. This is due to the restricted battery capacity of today’s sensors. Assuming that the features of a pattern recognition systems are acquired by the network’s sensors, the objective of keeping the energy consumption of the sensors low becomes equivalent to minimizing the number of features employed in object classification. In fact, this objective is related with, but not identical to, classical feature selection, where one wants to optimize the recognition performance of a system by detecting and eliminating noisy, redundant, and irrelevant features. This paper introduces a general framework for pattern classification in wireless sensor networks that aims at increasing the lifetime of the underlying system by using a number of features as small as possible in order to reach a certain recognition performance. In experiments with data from the UCI repository, we demonstrate the feasibility of this approach. We also compare a number of classical procedures for feature subset selection in the context of pattern classification in wireless sensor networks.

[1]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[2]  Blaise Hanczar,et al.  Classification with reject option in gene expression data , 2008, Bioinform..

[3]  Byung Ro Moon,et al.  Hybrid Genetic Algorithms for Feature Selection , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Kent Larson,et al.  Using a Live-In Laboratory for Ubiquitous Computing Research , 2006, Pervasive.

[5]  Nirvana Meratnia,et al.  A distributed and self-organizing scheduling algorithm for energy-efficient data aggregation in wireless sensor networks , 2007, TOSN.

[6]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[7]  Yu Hen Hu,et al.  Vehicle classification in distributed sensor networks , 2004, J. Parallel Distributed Comput..

[8]  H. Hornich,et al.  Automorphic functions , 1935 .

[9]  Fabio Roli,et al.  Reject option with multiple thresholds , 2000, Pattern Recognit..

[10]  Jason Weston,et al.  Gene Selection for Cancer Classification using Support Vector Machines , 2002, Machine Learning.

[11]  Masoud Nikravesh,et al.  Feature Extraction - Foundations and Applications , 2006, Feature Extraction.

[12]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[13]  I. Jolliffe Principal Component Analysis , 2002 .

[14]  Ying Sun,et al.  Dynamic target classification in wireless sensor networks , 2008, 2008 19th International Conference on Pattern Recognition.

[15]  Yang Xiao,et al.  Handbook on Sensor Networks , 2010 .

[16]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[17]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[18]  Jack Sklansky,et al.  On Automatic Feature Selection , 1988, Int. J. Pattern Recognit. Artif. Intell..

[19]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[20]  Andreas Krause,et al.  Simultaneous placement and scheduling of sensors , 2009, 2009 International Conference on Information Processing in Sensor Networks.

[21]  Larry A. Rendell,et al.  The Feature Selection Problem: Traditional Methods and a New Algorithm , 1992, AAAI.

[22]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[23]  Di Tian,et al.  A coverage-preserving node scheduling scheme for large wireless sensor networks , 2002, WSNA '02.

[24]  C. K. Chow,et al.  On optimum recognition error and reject tradeoff , 1970, IEEE Trans. Inf. Theory.

[25]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[26]  Pavel Pudil,et al.  Dynamic Oscillating Search algorithm for feature selection , 2008, 2008 19th International Conference on Pattern Recognition.

[27]  Yang Xiao,et al.  A Survey of Energy-Efficient Scheduling Mechanisms in Sensor Networks , 2006, Mob. Networks Appl..