Combined multiclass classification and anomaly detection for large-scale Wireless Sensor Networks

A smart wireless sensor network analytics requirement, beyond routine data collection, aggregation and analysis, in large-scale applications, is the automatic classification of emerging unknown events (classes) from the known classes. In this paper we present a new form of SVM that combines multiclass classification and anomaly detection into a single step to improve performance when data contains vectors from classes not represented in the training set. We demonstrate how the concepts of structural risk minimisation and anomaly detection are combined and analysing the effect of the various training parameters. The evaluations on several benchmark datasets reveal its ability to accurately classify unknown classes and known classes simultaneously.

[1]  Marimuthu Palaniswami,et al.  Anomaly Detection in Environmental Monitoring Networks [Application Notes] , 2011, IEEE Computational Intelligence Magazine.

[2]  Yoram Singer,et al.  Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers , 2000, J. Mach. Learn. Res..

[3]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[4]  R. Shah,et al.  Least Squares Support Vector Machines , 2022 .

[5]  Malik Yousef,et al.  One-Class SVMs for Document Classification , 2002, J. Mach. Learn. Res..

[6]  Brijesh Verma,et al.  Pattern Recognition Technologies and Applications: Recent Advances , 2008 .

[7]  Robert Tibshirani,et al.  Classification by Pairwise Coupling , 1997, NIPS.

[8]  Jason Weston,et al.  Support vector machines for multi-class pattern recognition , 1999, ESANN.

[9]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[10]  Marimuthu Palaniswami,et al.  Centered Hyperspherical and Hyperellipsoidal One-Class Support Vector Machines for Anomaly Detection in Sensor Networks , 2010, IEEE Transactions on Information Forensics and Security.

[11]  J. Mercer.  Functions of Positive and Negative Type, and their Connection with the Theory of Integral Equations , 1909 .

[12]  Koby Crammer,et al.  On the Algorithmic Implementation of Multiclass Kernel-based Vector Machines , 2002, J. Mach. Learn. Res..

[13]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[14]  Arkadi Nemirovski,et al.  Lectures on modern convex optimization - analysis, algorithms, and engineering applications , 2001, MPS-SIAM series on optimization.

[15]  Marimuthu Palaniswami,et al.  Distributed training of multiclass conic-segmentation support vector machines on communication constrained networks , 2010, 2010 Sixth International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[16]  J. A. Cochran.  The analysis of linear integral equations , 1973 .

[17]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[18]  J. K. Hunter,et al.  Measure Theory , 2007 .

[19]  Gert Cauwenberghs,et al.  SVM incremental learning, adaptation and optimization , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[20]  Marimuthu Palaniswami,et al.  The conic-segmentation support vector machine - a target space method for multiclass classification , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).