Sequential signal encoding from noisy measurements using quantizers with dynamic bias control

Signal estimation from a sequential encoding in the form of quantized noisy measurements is considered. As an example context, this problem arises in a number of remote sensing applications, where a central site estimates an information-bearing signal from low-bandwidth digitized information received from remote sensors, and may or may not broadcast feedback information to the sensors. We demonstrate that the use of an appropriately designed and often easily implemented additive control input before signal quantization at the sensor can significantly enhance overall system performance. In particular, we develop efficient estimators in conjunction with optimized random, deterministic, and feedback-based control inputs, resulting in a hierarchy of systems that trade performance for complexity.

[1]  J. Morris The Performance of Quantizers for a Class of Noise-Corrupted Signal Sources , 1976, IEEE Trans. Commun..

[2]  E. Parzen 1. Random Variables and Stochastic Processes , 1999 .

[3]  John Vanderkooy,et al.  A Theory of Non-Subtractive Dither , 2003 .

[4]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[5]  Pramod K. Varshney,et al.  Distributed detection with multiple sensors I. Fundamentals , 1997, Proc. IEEE.

[6]  Rick S. Blum,et al.  Optimum distributed detection of weak signals in dependent sensors , 1992, IEEE Trans. Inf. Theory.

[7]  A. Willsky,et al.  A multiresolution methodology for signal-level fusion and data assimilation with applications to remote sensing , 1997, Proc. IEEE.

[8]  Lawrence G. Roberts,et al.  Picture coding using pseudo-random noise , 1962, IRE Trans. Inf. Theory.

[9]  Harry L. Van Trees,et al.  Detection, Estimation, and Modulation Theory, Part I , 1968 .

[10]  Y. Bar-Shalom,et al.  IMM estimation for multitarget-multisensor air traffic surveillance , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[11]  Allen Gersho,et al.  Principles of quantization , 1978 .

[12]  D. Teneketzis,et al.  Coordinator , 2020, EuroPLoP.

[13]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[14]  Axthonv G. Oettinger,et al.  IEEE Transactions on Information Theory , 1998 .

[15]  Moshe Kam,et al.  Sensor Fusion for Mobile Robot Navigation , 1997, Proc. IEEE.

[16]  Maurizio Longo,et al.  Quantization for decentralized hypothesis testing under communication constraints , 1990, IEEE Trans. Inf. Theory.

[17]  D. Warren,et al.  Optimal Decentralized Detection for Conditionally Independent Sensors , 1989, 1989 American Control Conference.

[18]  Toby Berger,et al.  Multiterminal Source Coding with High Resolution , 1999, IEEE Trans. Inf. Theory.

[19]  L. Schuchman Dither Signals and Their Effect on Quantization Noise , 1964 .

[20]  Haralabos C. Papadopoulos Efficient digital encoding and estimation of noisy signals , 1998 .

[21]  John N. Tsitsiklis,et al.  Data fusion with minimal communication , 1994, IEEE Trans. Inf. Theory.

[22]  Rama Chellappa,et al.  On the positioning of multisensor imagery for exploitation and target recognition , 1997 .

[23]  Jack K. Wolf,et al.  Transmission of noisy information to a noisy receiver with minimum distortion , 1970, IEEE Trans. Inf. Theory.

[24]  John P. Miller,et al.  Broadband neural encoding in the cricket cereal sensory system enhanced by stochastic resonance , 1996, Nature.

[25]  Frank Moss,et al.  Noise enhancement of information transfer in crayfish mechanoreceptors by stochastic resonance , 1993, Nature.

[26]  Ian B. Rhodes,et al.  Decentralized sequential detection , 1989, IEEE Trans. Inf. Theory.

[27]  R. T. Antony,et al.  Database support to data fusion automation , 1997, Proc. IEEE.

[28]  John N. Tsitsiklis,et al.  Decentralized detection by a large number of sensors , 1988, Math. Control. Signals Syst..

[29]  John Vanderkooy,et al.  Quantization and Dither: A Theoretical Survey , 1992 .

[30]  Hugh F. Durrant-Whyte,et al.  A Fully Decentralized Multi-Sensor System For Tracking and Surveillance , 1993, Int. J. Robotics Res..

[31]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[32]  Toby Berger,et al.  The CEO problem [multiterminal source coding] , 1996, IEEE Trans. Inf. Theory.

[33]  H. C. Papadopoulos Sequential signal encoding and estimation for wireless sensor networks , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[34]  A. Sutera,et al.  The mechanism of stochastic resonance , 1981 .

[35]  P.K. Varshney,et al.  Optimal Data Fusion in Multiple Sensor Detection Systems , 1986, IEEE Transactions on Aerospace and Electronic Systems.

[36]  Robert M. Gray,et al.  Encoding of correlated observations , 1987, IEEE Trans. Inf. Theory.

[37]  F. Moss,et al.  Non-Dynamical Stochastic Resonance: Theory and Experiments with White and Arbitrarily Coloured Noise , 1995 .

[38]  Zhen Zhang,et al.  On the CEO problem , 1994, Proceedings of 1994 IEEE International Symposium on Information Theory.

[39]  Rick S. Blum,et al.  Distributed detection with multiple sensors I. Advanced topics , 1997, Proc. IEEE.

[40]  Robert M. Gray,et al.  A unified approach for encoding clean and noisy sources by means of waveform and autoregressive model vector quantization , 1988, IEEE Trans. Inf. Theory.

[41]  Po-Ning Chen,et al.  Error bounds for parallel distributed detection under the Neyman-Pearson criterion , 1995, IEEE Trans. Inf. Theory.

[42]  John Vanderkooy,et al.  A theory of nonsubtractive dither , 2000, IEEE Trans. Signal Process..

[43]  Eric B. Hall,et al.  Some aspects of fusion in estimation theory , 1991, IEEE Trans. Inf. Theory.

[44]  William Bialek,et al.  Information flow in sensory neurons , 1995 .

[45]  H. Vincent Poor,et al.  Decentralized Sequential Detection with a Fusion Center Performing the Sequential Test , 1992 .

[46]  K. C. Chou,et al.  Multiscale recursive estimation, data fusion, and regularization , 1994, IEEE Trans. Autom. Control..

[47]  R. Gray,et al.  Dithered Quantizers , 1993, Proceedings. 1991 IEEE International Symposium on Information Theory.

[48]  H. V. Poor,et al.  Applications of Ali-Silvey Distance Measures in the Design of Generalized Quantizers for Binary Decision Systems , 1977, IEEE Trans. Commun..