Towards a robust sparse data representation in wireless sensor networks

Compressive sensing has been successfully used for optimized operations in wireless sensor networks. However, raw data collected by sensors may be neither originally sparse nor easily transformed into a sparse data representation. This paper addresses the problem of transforming source data collected by sensor nodes into a sparse representation with a few nonzero elements. Our contributions that address three major issues include: 1) an effective method that extracts population sparsity of the data, 2) a sparsity ratio guarantee scheme, and 3) a customized learning algorithm of the sparsifying dictionary. We introduce an unsupervised neural network to extract an intrinsic sparse coding of the data. The sparse codes are generated at the activation of the hidden layer using a sparsity nomination constraint and a shrinking mechanism. Our analysis using real data samples shows that the proposed method outperforms conventional sparsity-inducing methods. Abstract—Sparse coding, compressive sensing, sparse autoencoders, wireless sensor networks.

[1]  Dongming Lu,et al.  Path Reconstruction in Dynamic Wireless Sensor Networks Using Compressive Sensing , 2014, IEEE/ACM Transactions on Networking.

[2]  Saad B. Qaisar,et al.  Compressive sensing: From theory to applications, a survey , 2013, Journal of Communications and Networks.

[3]  Prasant Misra,et al.  Efficient cross-correlation via sparse representation in sensor networks , 2012, 2012 ACM/IEEE 11th International Conference on Information Processing in Sensor Networks (IPSN).

[4]  Yann LeCun,et al.  Learning Invariant Feature Hierarchies , 2012, ECCV Workshops.

[5]  Pedro M. Domingos A few useful things to know about machine learning , 2012, Commun. ACM.

[6]  Milica Stojanovic,et al.  Random Access Compressed Sensing over Fading and Noisy Communication Channels , 2012, IEEE Transactions on Wireless Communications.

[7]  Yoshua Bengio,et al.  Practical Recommendations for Gradient-Based Training of Deep Architectures , 2012, Neural Networks: Tricks of the Trade.

[8]  Mingyan Liu,et al.  In-situ soil moisture sensing: Measurement scheduling and estimation using compressive sensing , 2012, 2012 ACM/IEEE 11th International Conference on Information Processing in Sensor Networks (IPSN).

[9]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[10]  Zeng-Guang Hou,et al.  Compressive sensing approach based mapping and localization for mobile robot in an indoor wireless sensor network , 2010, 2010 International Conference on Networking, Sensing and Control (ICNSC).

[11]  Jörg Widmer,et al.  Data Acquisition through Joint Compressive Sensing and Principal Component Analysis , 2009, GLOBECOM 2009 - 2009 IEEE Global Telecommunications Conference.

[12]  Jun Sun,et al.  Compressive data gathering for large-scale wireless sensor networks , 2009, MobiCom '09.

[13]  Guillermo Sapiro,et al.  Online dictionary learning for sparse coding , 2009, ICML '09.

[14]  Michele Zorzi,et al.  On the interplay between routing and signal representation for Compressive Sensing in wireless sensor networks , 2009, 2009 Information Theory and Applications Workshop.

[15]  Zhu Han,et al.  Sparse event detection in wireless sensor networks using compressive sensing , 2009, 2009 43rd Annual Conference on Information Sciences and Systems.

[16]  Anthony Griffin,et al.  Compressed sensing of audio signals using multiple sensors , 2008, 2008 16th European Signal Processing Conference.

[17]  Zhen Zhu,et al.  Optimized Approximation Algorithm in Neural Networks Without Overfitting , 2008, IEEE Transactions on Neural Networks.

[18]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[19]  Honglak Lee,et al.  Sparse deep belief net model for visual area V2 , 2007, NIPS.

[20]  Gregory J. Pottie,et al.  Sensor network data fault types , 2007, TOSN.

[21]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[22]  J. Haupt,et al.  Compressive wireless sensing , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[23]  Zizhong Chen,et al.  Condition Numbers of Gaussian Random Matrices , 2005, SIAM J. Matrix Anal. Appl..

[24]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[25]  E. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[26]  P. Lennie The Cost of Cortical Computation , 2003, Current Biology.

[27]  Gregory J. Pottie,et al.  Wireless integrated network sensors , 2000, Commun. ACM.

[28]  J. Nocedal,et al.  A Limited Memory Algorithm for Bound Constrained Optimization , 1995, SIAM J. Sci. Comput..

[29]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[30]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[31]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .