Error-resilient and complexity-constrained distributed coding for large scale sensor networks

There has been considerable interest in distributed source coding within the compression and sensor network research communities in recent years, primarily due to its potential contributions to low-power sensor networks. However, two major obstacles pose an existential threat on practical deployment of such techniques in real world sensor networks, namely, the exponential growth of decoding complexity with network size and coding rates, and the critical requirement for error-resilience given the severe channel conditions in many wireless sensor networks. Motivated by these chal-lenges, this paper proposes a novel, unified approach for large scale, error-resilient distributed source coding, based on an optimally designed classifier-based decoding frame-work, where the design explicitly controls the decoding com-plexity. We also present a deterministic annealing (DA) based global optimization algorithm for the design due to the highly non-convex nature of the cost function, which further enhances the performance over basic greedy iterative descent technique. Simulation results on data, both synthetic and from real sensor networks, provide strong evidence that the approach opens the door to practical deployment of distributed coding in large sensor networks. It not only yields substantial gains in terms of overall distortion, compared to other state-of-the-art techniques, but also demonstrates how its decoder naturally scales to large networks while constraining the complexity, thereby enabling performance gains that increase with network size.

[1]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[2]  Kenneth Rose,et al.  A global optimization technique for statistical classifier design , 1996, IEEE Trans. Signal Process..

[3]  João Barros,et al.  Scalable decoding on factor trees: a practical solution for wireless sensor networks , 2006, IEEE Transactions on Communications.

[4]  Michael Fleming,et al.  Network vector quantization , 2001, IEEE Transactions on Information Theory.

[5]  Zixiang Xiong,et al.  Distributed source coding for sensor networks , 2004, IEEE Signal Processing Magazine.

[6]  Pradeepa Yahampath,et al.  Design of scalable decoders for sensor networks via Bayesian network learning , 2009, IEEE Transactions on Communications.

[7]  K. Rose Deterministic annealing for clustering, compression, classification, regression, and related optimization problems , 1998, Proc. IEEE.

[8]  Patrick Mitran,et al.  Coding for the Slepian-Wolf problem with turbo codes , 2001, GLOBECOM'01. IEEE Global Telecommunications Conference (Cat. No.01CH37270).

[9]  Ramesh Govindan,et al.  The impact of spatial correlation on routing with compression in wireless sensor networks , 2008, TOSN.

[10]  Gerhard Maierbacher,et al.  Low-complexity coding and source-optimized clustering for large-scale sensor networks , 2008, TOSN.

[11]  Pradeepa Yahampath,et al.  Joint source decoding in large scale sensor networks using Markov random field models , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  Kenneth Rose,et al.  Towards large scale distributed coding , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[13]  Rui Zhang,et al.  Design of optimal quantizers for distributed source coding , 2003, Data Compression Conference, 2003. Proceedings. DCC 2003.

[14]  Kannan Ramchandran,et al.  Distributed source coding using syndromes (DISCUS): design and construction , 2003, IEEE Trans. Inf. Theory.

[15]  Kenneth Rose,et al.  Robust Distributed Source Coder Design by Deterministic Annealing , 2010, IEEE Transactions on Signal Processing.

[16]  Kenneth Rose,et al.  A classifier-based decoding approach for large scale distributed coding , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[17]  Baltasar Beferull-Lozano,et al.  Networked Slepian-Wolf: theory, algorithms, and scaling laws , 2005, IEEE Transactions on Information Theory.

[18]  Robert M. Gray,et al.  Encoding of correlated observations , 1987, IEEE Trans. Inf. Theory.

[19]  Kenneth Rose,et al.  A Deterministic Annealing Approach for Parsimonious Design of Piecewise Regression Models , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Kenneth Rose,et al.  Distributed Predictive Coding for Spatio-Temporally Correlated Sources , 2009, IEEE Transactions on Signal Processing.