Discovering novelty in spatio/temporal data using one-class support vector machines

Novelty or anomaly detection in spatio/temporal data refers to the automatic identification of novel or abnormal events embedded in data that occur at a specific location/time. Traditional techniques used in process control to identify novelties are not robust for noise in the data set. We present an algorithm based on the support vector machine approach for domain description. This technique is intrinsicly robust for outliers in the data set but to make it work, several extensions are needed which form the contribution of this work: an extended representation of the spatio/temporal data, a tensor product kernel to separately deal with the distinct features of time and measurements, and a voting function which identifies novelties based on different representations of the time series in a robust way. Experimental results on both artificial and real data demonstrate that our algorithm performs significantly better than other standard techniques used in process control.

[1]  Ignacio Santamaría,et al.  A spectral clustering algorithm for decoding fast time-varying BPSK mimo channels , 2007, 2007 15th European Signal Processing Conference.

[2]  James P. Crutchfield,et al.  Geometry from a Time Series , 1980 .

[3]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[4]  Theodora Kourti,et al.  Model Predictive Monitoring for Batch Processes , 2004 .

[5]  Bernhard Schölkopf,et al.  Support Vector Novelty Detection Applied to Jet Engine Vibration Spectra , 2000, NIPS.

[6]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[7]  Jonathan D. Cryer,et al.  Time Series Analysis , 1986 .

[8]  Sanjay Chawla,et al.  On local spatial outliers , 2004, Fourth IEEE International Conference on Data Mining (ICDM'04).

[9]  James T. Kwok,et al.  Kernel eigenvoice speaker adaptation , 2005, IEEE Transactions on Speech and Audio Processing.

[10]  V. Svetnik,et al.  Novelty Detection in Mass Spectral Data using a Support Vector Machine Method , 2002 .

[11]  S. Canu,et al.  Context changes detection by one-class SVMs ? , 2005 .

[12]  Junshui Ma,et al.  Online novelty detection on temporal sequences , 2003, KDD '03.

[13]  Brian Litt,et al.  One-Class Novelty Detection for Seizure Analysis from Intracranial EEG , 2006, J. Mach. Learn. Res..

[14]  Chandan Srivastava,et al.  Support Vector Data Description , 2011 .

[15]  S. Marsland Novelty Detection in Learning Systems , 2008 .

[16]  Chao Yuan,et al.  Support vector methods and use of hidden variables for power plant monitoring , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[17]  J. Ma,et al.  Time-series novelty detection using one-class support vector machines , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[18]  Bojan Cukic,et al.  Validating a neural network-based online adaptive system , 2005 .

[19]  Arthur Gretton,et al.  An online support vector machine for abnormal events detection , 2006, Signal Process..

[20]  J. A. Stewart,et al.  Nonlinear Time Series Analysis , 2015 .