Distributed vector decorrelation and anomaly detection using the vector Sparse Matrix Transform

Here, we propose the vector Sparse Matrix Transform (SMT), a novel decorrelating transform suitable for performing distributed processing of high dimensional signals in sensor networks. We assume that each sensor in the network encodes its measurements into vector outputs instead of scalar ones. The proposed transform decorrelates a sequence of pairs of vector sensor outputs, until these vectors are decorrelated. In our experiments, we simulate distributed anomaly detection by a camera network monitoring a spatial region. Each camera records an image of the monitored environment from its particular viewpoint and outputs a vector encoding the image. Results show that the vector SMT effectively decorrelates images from the multiple cameras in the network and significantly improves anomaly detection accuracy while requiring low overall communication energy.

[1]  Charles A. Bouman,et al.  Communication efficient signal detection in correlated clutter for wireless sensor networks , 2010, 2010 Conference Record of the Forty Fourth Asilomar Conference on Signals, Systems and Computers.

[2]  Antonio Ortega,et al.  Energy-efficient graph-based wavelets for distributed coding in Wireless Sensor Networks , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[3]  Olivier Ledoit,et al.  Improved estimation of the covariance matrix of stock returns with an application to portfolio selection , 2003 .

[4]  Steven Soderbergh Ocean's eleven : film , 2001 .

[5]  Pramod K. Varshney,et al.  Distributed Detection and Data Fusion , 1996 .

[6]  Michael Gastpar,et al.  The Distributed Karhunen–Loève Transform , 2006, IEEE Transactions on Information Theory.

[7]  Charles A. Bouman,et al.  The Sparse Matrix Transform for Covariance Estimation and Analysis of High Dimensional Signals , 2011, IEEE Transactions on Image Processing.

[8]  Alfred O. Hero,et al.  Decomposable Principal Component Analysis , 2009, IEEE Transactions on Signal Processing.

[9]  Boris N. Oreshkin,et al.  Machine learning approaches to network anomaly detection , 2007 .

[10]  R. Tibshirani,et al.  Sparse inverse covariance estimation with the graphical lasso. , 2008, Biostatistics.

[11]  J.-F. Chamberland,et al.  Wireless Sensors in Distributed Detection Applications , 2007, IEEE Signal Processing Magazine.

[12]  Michael Gastpar,et al.  A greedy approach to the distributed Karhunen-Loève transform , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[13]  Charles A. Bouman,et al.  Sparse Matrix Transform for Hyperspectral Image Processing , 2011, IEEE Journal of Selected Topics in Signal Processing.

[14]  Antonio Ortega,et al.  A distributed wavelet compression algorithm for wireless sensor networks using lifting , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[15]  Christophe Diot,et al.  Diagnosing network-wide traffic anomalies , 2004, SIGCOMM.

[16]  Bir Bhanu,et al.  VideoWeb Dataset for Multi-camera Activities and Non-verbal Communication , 2011 .

[17]  Charles A. Bouman,et al.  Hypothesis testing in high-dimensional space with the Sparse Matrix Transform , 2010, 2010 IEEE Sensor Array and Multichannel Signal Processing Workshop.

[18]  Sylvain Raybaud,et al.  Distributed Principal Component Analysis for Wireless Sensor Networks , 2008, Sensors.

[19]  James Theiler,et al.  The incredible shrinking covariance estimator , 2012, Defense + Commercial Sensing.

[20]  R. Kass,et al.  Shrinkage Estimators for Covariance Matrices , 2001, Biometrics.

[21]  David A. Landgrebe,et al.  Covariance Matrix Estimation and Classification With Limited Training Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Mark Crovella,et al.  Mining anomalies using traffic feature distributions , 2005, SIGCOMM '05.

[23]  Antonio Ortega,et al.  Energy-efficient data representation and routing for wireless sensor networks based on a distributed wavelet compression algorithm , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[24]  Don R. Hush,et al.  Statistics for characterizing data on the periphery , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[25]  Charles A. Bouman,et al.  Evaluating and improving local hyperspectral anomaly detectors , 2011, 2011 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[26]  Jean-Franois Cardoso High-Order Contrasts for Independent Component Analysis , 1999, Neural Computation.