Characteristics and classification of outlier detection techniques for wireless sensor networks in harsh environments: a survey

Wireless sensor networks (WSNs) have received considerable attention for multiple types of applications. In particular, outlier detection in WSNs has been an area of vast interest. Outlier detection becomes even more important for the applications involving harsh environments, however, it has not received extensive treatment in the literature. The identification of outliers in WSNs can be used for filtration of false data, find faulty nodes and discover events of interest. This paper presents a survey of the essential characteristics for the analysis of outlier detection techniques in harsh environments. These characteristics include, input data type, spatio-temporal and attribute correlations, user specified thresholds, outlier types(local and global), type of approach(distributed/centralized), outlier identification(event or error), outlier degree, outlier score, susceptibility to dynamic topology, non-stationarity and inhomogeneity. Moreover, the prioritization of various characteristics has been discussed for outlier detection techniques in harsh environments. The paper also gives a brief overview of the classification strategies for outlier detection techniques in WSNs and discusses the feasibility of various types of techniques for WSNs deployed in harsh environments.

[1]  Tu Xu,et al.  A New Sphere-Structure Multi-Class Classifier , 2009, 2009 Pacific-Asia Conference on Circuits, Communications and Systems.

[2]  Xiuzhen Cheng,et al.  Robust Event Boundary Detection in Sensor Networks - A Mixture Model Based Approach , 2009, IEEE INFOCOM 2009.

[3]  Özgür B. Akan,et al.  InterPlaNetary Internet: state-of-the-art and research challenges , 2003, Comput. Networks.

[4]  Xiuzhen Cheng,et al.  Localized fault-tolerant event boundary detection in sensor networks , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[5]  Matt Welsh,et al.  Simulating the power consumption of large-scale sensor network applications , 2004, SenSys '04.

[6]  Jung-Hsien Chiang,et al.  A new maximal-margin spherical-structured multi-class support vector machine , 2009, Applied Intelligence.

[7]  Zahra Taghikhaki,et al.  Distributed Event Detection in Wireless Sensor Networks for Disaster Management , 2010, 2010 International Conference on Intelligent Networking and Collaborative Systems.

[8]  Xiuzhen Cheng,et al.  Localized Outlying and Boundary Data Detection in Sensor Networks , 2007 .

[9]  M. Palaniswami,et al.  Distributed Anomaly Detection in Wireless Sensor Networks , 2006, 2006 10th IEEE Singapore International Conference on Communication Systems.

[10]  Aric A. Hagberg,et al.  Separating the Wheat from the Chaff: Practical Anomaly Detection Schemes in Ecological Applications of Distributed Sensor Networks , 2007, DCOSS.

[11]  Panganamala Ramana Kumar,et al.  RHEINISCH-WESTFÄLISCHE TECHNISCHE HOCHSCHULE AACHEN , 2001 .

[12]  Marimuthu Palaniswami,et al.  Incremental Elliptical Boundary Estimation for Anomaly Detection in Wireless Sensor Networks , 2011, 2011 IEEE 11th International Conference on Data Mining.

[13]  Yang Xiao,et al.  Outlier detection based fault tolerant data aggregation for wireless sensor networks , 2011, 2011 5th International Conference on Application of Information and Communication Technologies (AICT).

[14]  Marimuthu Palaniswami,et al.  CESVM: Centered Hyperellipsoidal Support Vector Machine Based Anomaly Detection , 2008, 2008 IEEE International Conference on Communications.

[15]  Chuan Tang,et al.  An Improved Method for Multi-class Support Vector Machines , 2010, 2010 International Conference on Measuring Technology and Mechatronics Automation.

[16]  George Roussos,et al.  Escalation: Complex Event Detection in Wireless Sensor Networks , 2007, EuroSSC.

[17]  Wei Hong,et al.  Proceedings of the 5th Symposium on Operating Systems Design and Implementation Tag: a Tiny Aggregation Service for Ad-hoc Sensor Networks , 2022 .

[18]  Dimitrios Gunopulos,et al.  Online outlier detection in sensor data using non-parametric models , 2006, VLDB.

[19]  M. Aly.  Survey on Multiclass Classification Methods , 2005 .

[20]  S. Sitharama Iyengar,et al.  Distributed Bayesian algorithms for fault-tolerant event region detection in wireless sensor networks , 2004, IEEE Transactions on Computers.

[21]  Zhang Yang,et al.  An online outlier detection technique for wireless sensor networks using unsupervised quarter-sphere support vector machine , 2008, 2008 International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[22]  Yozo Hida,et al.  Aggregation Query Under Uncertainty in Sensor Networks CS 252 Project , 2003 .

[23]  Marimuthu Palaniswami,et al.  Centered Hyperspherical and Hyperellipsoidal One-Class Support Vector Machines for Anomaly Detection in Sensor Networks , 2010, IEEE Transactions on Information Forensics and Security.

[24]  Dario Pompili,et al.  Underwater acoustic sensor networks: research challenges , 2005, Ad Hoc Networks.

[25]  Nirvana Meratnia,et al.  Automatic Fire Detection: A Survey from Wireless Sensor Network Perspective , 2008 .

[26]  Joakim Ekström,et al.  Mahalanobis' Distance Beyond Normal Distributions , 2011 .

[27]  Bo Wang,et al.  An Improved Hyper-sphere Support Vector Machine , 2007, Third International Conference on Natural Computation (ICNC 2007).

[28]  Rachel Cardell-Oliver,et al.  A Reactive Soil Moisture Sensor Network: Design and Field Evaluation , 2005, Int. J. Distributed Sens. Networks.

[29]  Jianzhong Li,et al.  Unsupervised Outlier Detection in Sensor Networks Using Aggregation Tree , 2007, ADMA.

[30]  Arun Somani,et al.  Distributed fault detection of wireless sensor networks , 2006, DIWANS '06.

[31]  Lei Chen,et al.  In-network Outlier Cleaning for Data Collection in Sensor Networks , 2006, CleanDB.

[32]  James M. Keller,et al.  Clustering elliptical anomalies in sensor networks , 2010, International Conference on Fuzzy Systems.

[33]  Eyal Amir,et al.  Real-time Bayesian Anomaly Detection for Environmental Sensor Data , 2007 .

[34]  Chih-Jen Lin,et al.  A sequential dual method for large scale multi-class linear svms , 2008, KDD.

[35]  Marimuthu Palaniswami,et al.  Measures for clustering and anomaly detection in sets of higher dimensional ellipsoids , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[36]  Mohamed Medhat Gaber,et al.  Knowledge Discovery from Sensor Data , 2008 .

[37]  Nirvana Meratnia,et al.  Use of event detection approaches for outlier detection in wireless sensor networks , 2009, 2009 International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP).

[38]  Dimitrios Gunopulos,et al.  Distributed deviation detection in sensor networks , 2003, SGMD.

[39]  Bo,et al.  [IEEE Eighth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing (SNPD 2007) - Qingdao, China (2007.07.30-2007.08.1)] Eighth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Para , 2007 .

[40]  Marimuthu Palaniswami,et al.  Clustering ellipses for anomaly detection , 2011, Pattern Recognit..

[41]  Saad B. Qaisar,et al.  Quarter-Sphere SVM: Attribute and Spatio-Temporal correlations based Outlier & Event Detection in wireless sensor networks , 2012, 2012 IEEE Wireless Communications and Networking Conference (WCNC).

[42]  B. R. Badrinath,et al.  Context-Aware Sensors , 2004, EWSN.

[43]  Dorothea Wagner,et al.  Efficient Algorithms for Distributed Detection of Holes and Boundaries in Wireless Networks , 2011, SEA.

[44]  Wei Zhou,et al.  DistressNet: a wireless ad hoc and sensor network architecture for situation management in disaster response , 2010, IEEE Communications Magazine.

[45]  Ran Wolff,et al.  In-Network Outlier Detection in Wireless Sensor Networks , 2006, ICDCS.

[46]  Yang Zhang,et al.  Observing the unobservable : distributed online outlier detection in wireless sensor networks , 2010 .

[47]  Kate Smith-Miles,et al.  A Comprehensive Survey of Data Mining-based Fraud Detection Research , 2010, ArXiv.

[48]  Raymond T. Ng,et al.  Algorithms for Mining Distance-Based Outliers in Large Datasets , 1998, VLDB.

[49]  Marimuthu Palaniswami,et al.  Quarter Sphere Based Distributed Anomaly Detection in Wireless Sensor Networks , 2007, 2007 IEEE International Conference on Communications.

[50]  Sridhar Ramaswamy,et al.  Efficient algorithms for mining outliers from large data sets , 2000, SIGMOD '00.

[51]  Dake He,et al.  A New Orientation for Multi-Class SVM , 2007 .

[52]  Prasant Misra,et al.  Safety assurance and rescue communication systems in high-stress environments: A mining case study , 2010, IEEE Communications Magazine.

[53]  Ajay Gupta,et al.  Anomaly intrusion detection in wireless sensor networks , 2006, J. High Speed Networks.

[54]  George H. John.  Robust Decision Trees: Removing Outliers from Databases , 1995, KDD.

[55]  Daniel T. Larose,et al.  Discovering Knowledge in Data: An Introduction to Data Mining , 2005 .

[56]  Nirvana Meratnia,et al.  A taxonomy framework for unsupervised outlier detection techniques for multi-type data sets , 2007 .

[57]  Nirvana Meratnia,et al.  Use of AI Techniques for Residential Fire Detection in Wireless Sensor Networks , 2009, AIAI Workshops.

[58]  D. Janakiram,et al.  Outlier Detection in Wireless Sensor Networks using Bayesian Belief Networks , 2006, 2006 1st International Conference on Communication Systems Software & Middleware.

[59]  Ray L. Somorjai,et al.  Class proximity measures - Dissimilarity-based classification and display of high-dimensional data , 2011, J. Biomed. Informatics.

[60]  Yunhao Liu,et al.  Contour map matching for event detection in sensor networks , 2006, SIGMOD Conference.

[61]  Carlos F. García-Hernández,et al.  Wireless Sensor Networks and Applications: a Survey , 2007 .

[62]  Marimuthu Palaniswami,et al.  Labelled data collection for anomaly detection in wireless sensor networks , 2010, 2010 Sixth International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[63]  Christopher Leckie,et al.  Sensor data boundary estimation for anomaly detection in wireless sensor networks , 2010, The 7th IEEE International Conference on Mobile Ad-hoc and Sensor Systems (IEEE MASS 2010).

[64]  Marimuthu Palaniswami,et al.  Anomaly Detection in Environmental Monitoring Networks [Application Notes] , 2011, IEEE Computational Intelligence Magazine.

[65]  Nirvana Meratnia,et al.  Adaptive and Online One-Class Support Vector Machine-Based Outlier Detection Techniques for Wireless Sensor Networks , 2009, 2009 International Conference on Advanced Information Networking and Applications Workshops.

[66]  Nirvana Meratnia,et al.  Sensor fusion-based event detection in Wireless Sensor Networks , 2009, 2009 6th Annual International Mobile and Ubiquitous Systems: Networking & Services, MobiQuitous.

[67]  Yannis Theodoridis,et al.  TACO: tunable approximate computation of outliers in wireless sensor networks , 2010, SIGMOD Conference.

[68]  VARUN CHANDOLA,et al.  Outlier Detection : A Survey , 2007 .

[69]  Robert P. W. Duin,et al.  Data domain description using support vectors , 1999, ESANN.

[70]  Antonio Alfredo Ferreira Loureiro,et al.  Decentralized intrusion detection in wireless sensor networks , 2005, Q2SWinet '05.

[71]  Nirvana Meratnia,et al.  Fast and Accurate Residential Fire Detection Using Wireless Sensor Networks , 2010 .

[72]  Yunhao Liu,et al.  LANDMARC: Indoor Location Sensing Using Active RFID , 2004, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..

[73]  Miao Xie,et al.  Anomaly Detection in Wireless Sensor Networks , 2013 .

[74]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[75]  Bo Sheng,et al.  Outlier detection in sensor networks , 2007, MobiHoc '07.

[76]  Berend Jan van der Zwaag,et al.  Fire data analysis and feature reduction using computational intelligence methods , 2010 .

[77]  Nirvana Meratnia,et al.  Outlier Detection Techniques for Wireless Sensor Networks: A Survey , 2008, IEEE Communications Surveys & Tutorials.

[78]  Victoria J. Hodge,et al.  A Survey of Outlier Detection Methodologies , 2004, Artificial Intelligence Review.

[79]  Nirvana Meratnia,et al.  Hyperellipsoidal SVM-Based Outlier Detection Technique for Geosensor Networks , 2009, GSN.

[80]  C.-C. Jay Kuo,et al.  Distributed spatio-temporal outlier detection in sensor networks , 2005, SPIE Defense + Commercial Sensing.

[81]  Christopher Leckie,et al.  An efficient hyperellipsoidal clustering algorithm for resource-constrained environments , 2011, Pattern Recognit..

[82]  Saad B. Qaisar,et al.  Real time energy efficient approach to Outlier & event detection in wireless sensor networks , 2012, 2012 IEEE International Conference on Communication Systems (ICCS).

[83]  Shigeo Abe.  Support Vector Machines for Pattern Classification , 2010, Advances in Pattern Recognition.

[84]  Ramesh Govindan,et al.  Sensor faults: Detection methods and prevalence in real-world datasets , 2010, TOSN.

[85]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[86]  N. Shahid,et al.  Energy efficient outlier detection in WSNs based on temporal and attribute correlations , 2011, 2011 7th International Conference on Emerging Technologies.

[87]  Dimitris K. Tasoulis,et al.  Online annotation and prediction for regime switching data streams , 2009, SAC '09.

[88]  Guoliang Xing,et al.  Watchdog: Confident Event Detection in Heterogeneous Sensor Networks , 2010, 2010 16th IEEE Real-Time and Embedded Technology and Applications Symposium.

[89]  Y. Zhang,et al.  – 20 Statistics-based outlier detection for wireless sensor networks , 2012 .

[90]  Ming Dong,et al.  On distributed fault-tolerant detection in wireless sensor networks , 2006, IEEE Transactions on Computers.

[91]  Jaideep Srivastava,et al.  A Comparative Study of Anomaly Detection Schemes in Network Intrusion Detection , 2003, SDM.

[92]  Miguel Lázaro-Gredilla,et al.  Adaptive One-Class Support Vector Machine , 2011, IEEE Transactions on Signal Processing.

[93]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.

[94]  Maria E. Orlowska,et al.  On the Optimal Robot Routing Problem in Wireless Sensor Networks , 2007 .

[95]  Ramesh Govindan,et al.  Localized edge detection in sensor fields , 2003, Ad Hoc Networks.

[96]  Nikos Giatrakos,et al.  PAO: power-efficient attribution of outliers in wireless sensor networks , 2010, DMSN '10.

[97]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[98]  Vic Barnett,et al.  Outliers in Statistical Data , 1980 .

[99]  Thomas G. Dietterich,et al.  Spatiotemporal Models for Data-Anomaly Detection in Dynamic Environmental Monitoring Campaigns , 2011, TOSN.

[100]  John Anderson,et al.  Wireless sensor networks for habitat monitoring , 2002, WSNA '02.

[101]  Marimuthu Palaniswami,et al.  Elliptical anomalies in wireless sensor networks , 2009, TOSN.

[102]  Defeng Wang,et al.  Structured One-Class Classification , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).